Note: This is test shard 8 of 8.
[==========] Running 7 tests from 6 test suites.
[----------] Global test environment set-up.
[----------] 1 test from TableRangeRebalancingTest
[ RUN ] TableRangeRebalancingTest.Basic
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240502 01:57:57.585055 10775 test_util.cc:268] Using random seed: -291487611
I20240502 01:57:57.591435 10775 ts_itest-base.cc:112] Starting cluster with:
I20240502 01:57:57.591545 10775 ts_itest-base.cc:113] --------------
I20240502 01:57:57.591598 10775 ts_itest-base.cc:114] 3 tablet servers
I20240502 01:57:57.591630 10775 ts_itest-base.cc:115] 3 replicas per TS
I20240502 01:57:57.591645 10775 ts_itest-base.cc:116] --------------
2024-05-02T01:57:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T01:57:57Z Disabled control of system clock
I20240502 01:57:57.600574 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.133.254:39197
--webserver_interface=127.10.133.254
--webserver_port=0
--builtin_ntp_servers=127.10.133.212:40157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.133.254:39197
--tserver_unresponsive_timeout_ms=3000
--enable_range_replica_placement=false
--raft_prepare_replacement_before_eviction=true
--enable_range_replica_placement=false with env {}
W20240502 01:57:57.702340 10787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:57:57.702553 10787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:57:57.702617 10787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:57:57.705543 10787 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:57:57.705606 10787 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 01:57:57.705646 10787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:57:57.705680 10787 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 01:57:57.705724 10787 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 01:57:57.709192 10787 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:40157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
--enable_range_replica_placement=false
--ipki_ca_key_size=768
--master_addresses=127.10.133.254:39197
--tserver_unresponsive_timeout_ms=3000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.133.254:39197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.133.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.10787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:57:57.710059 10787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:57:57.711107 10787 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240502 01:57:57.718240 10787 server_base.cc:1034] running on GCE node
W20240502 01:57:57.718631 10795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:57:57.718863 10792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:57:57.719398 10793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:57:57.719822 10787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:57:57.720599 10787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:57:57.721735 10787 hybrid_clock.cc:648] HybridClock initialized: now 1714615077721710 us; error 34 us; skew 500 ppm
I20240502 01:57:57.727571 10787 webserver.cc:460] Webserver started at http://127.10.133.254:37671/ using document root <none> and password file <none>
I20240502 01:57:57.728107 10787 fs_manager.cc:359] Metadata directory not provided
I20240502 01:57:57.728163 10787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:57:57.728340 10787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:57:57.729890 10787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "4ab96203b4aa40dfbdbc270e2f6f90ed"
format_stamp: "Formatted at 2024-05-02 01:57:57 on dist-test-slave-dr9f"
I20240502 01:57:57.730408 10787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "4ab96203b4aa40dfbdbc270e2f6f90ed"
format_stamp: "Formatted at 2024-05-02 01:57:57 on dist-test-slave-dr9f"
I20240502 01:57:57.733515 10787 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20240502 01:57:57.735569 10801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:57:57.736464 10787 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 01:57:57.736578 10787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
uuid: "4ab96203b4aa40dfbdbc270e2f6f90ed"
format_stamp: "Formatted at 2024-05-02 01:57:57 on dist-test-slave-dr9f"
I20240502 01:57:57.736662 10787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:57:57.757721 10787 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:57:57.758353 10787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:57:57.758517 10787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:57:57.764817 10787 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.254:39197
I20240502 01:57:57.764822 10853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.254:39197 every 8 connection(s)
I20240502 01:57:57.765784 10787 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20240502 01:57:57.768170 10854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:57:57.772876 10854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed: Bootstrap starting.
I20240502 01:57:57.774969 10854 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed: Neither blocks nor log segments found. Creating new log.
I20240502 01:57:57.775722 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 10787
I20240502 01:57:57.775789 10854 log.cc:824] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed: Log is configured to *not* fsync() on all Append() calls
I20240502 01:57:57.775866 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal/instance
I20240502 01:57:57.777626 10854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed: No bootstrap required, opened a new log
I20240502 01:57:57.780849 10854 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ab96203b4aa40dfbdbc270e2f6f90ed" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 39197 } }
I20240502 01:57:57.781054 10854 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:57:57.781113 10854 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ab96203b4aa40dfbdbc270e2f6f90ed, State: Initialized, Role: FOLLOWER
I20240502 01:57:57.781571 10854 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ab96203b4aa40dfbdbc270e2f6f90ed" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 39197 } }
I20240502 01:57:57.781716 10854 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:57:57.781782 10854 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:57:57.781877 10854 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:57:57.782734 10854 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ab96203b4aa40dfbdbc270e2f6f90ed" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 39197 } }
I20240502 01:57:57.783023 10854 leader_election.cc:302] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ab96203b4aa40dfbdbc270e2f6f90ed; no voters:
I20240502 01:57:57.783272 10854 leader_election.cc:288] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:57:57.783361 10859 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:57:57.783664 10859 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed [term 1 LEADER]: Becoming Leader. State: Replica: 4ab96203b4aa40dfbdbc270e2f6f90ed, State: Running, Role: LEADER
I20240502 01:57:57.783977 10859 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ab96203b4aa40dfbdbc270e2f6f90ed" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 39197 } }
I20240502 01:57:57.784448 10854 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed [sys.catalog]: configured and running, proceeding with master startup.
I20240502 01:57:57.785068 10860 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ab96203b4aa40dfbdbc270e2f6f90ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ab96203b4aa40dfbdbc270e2f6f90ed" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 39197 } } }
I20240502 01:57:57.785174 10860 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed [sys.catalog]: This master's current role is: LEADER
I20240502 01:57:57.785373 10861 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ab96203b4aa40dfbdbc270e2f6f90ed. Latest consensus state: current_term: 1 leader_uuid: "4ab96203b4aa40dfbdbc270e2f6f90ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ab96203b4aa40dfbdbc270e2f6f90ed" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 39197 } } }
I20240502 01:57:57.785434 10861 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed [sys.catalog]: This master's current role is: LEADER
I20240502 01:57:57.785774 10864 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 01:57:57.788947 10864 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 01:57:57.793597 10864 catalog_manager.cc:1347] Generated new cluster ID: 482f6b5f046a4471b5a33d4b356de3b3
I20240502 01:57:57.793660 10864 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 01:57:57.810014 10864 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 01:57:57.810839 10864 catalog_manager.cc:1504] Loading token signing keys...
I20240502 01:57:57.820582 10864 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 4ab96203b4aa40dfbdbc270e2f6f90ed: Generated new TSK 0
I20240502 01:57:57.821226 10864 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 01:57:57.833567 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.193:0
--local_ip_for_outbound_sockets=127.10.133.193
--webserver_interface=127.10.133.193
--webserver_port=0
--tserver_master_addrs=127.10.133.254:39197
--builtin_ntp_servers=127.10.133.212:40157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 01:57:57.938871 10878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:57:57.939087 10878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:57:57.939153 10878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:57:57.942265 10878 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:57:57.942337 10878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:57:57.942425 10878 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.193
I20240502 01:57:57.945963 10878 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:40157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.133.193
--webserver_port=0
--tserver_master_addrs=127.10.133.254:39197
--never_fsync=true
--heap_profile_path=/tmp/kudu.10878
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.193
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:57:57.946877 10878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:57:57.947924 10878 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:57:57.955543 10886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:57:57.956084 10883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:57:57.956727 10884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:57:57.957264 10878 server_base.cc:1034] running on GCE node
I20240502 01:57:57.957630 10878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:57:57.958201 10878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:57:57.959357 10878 hybrid_clock.cc:648] HybridClock initialized: now 1714615077959340 us; error 29 us; skew 500 ppm
I20240502 01:57:57.961374 10878 webserver.cc:460] Webserver started at http://127.10.133.193:38523/ using document root <none> and password file <none>
I20240502 01:57:57.961901 10878 fs_manager.cc:359] Metadata directory not provided
I20240502 01:57:57.961957 10878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:57:57.962177 10878 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:57:57.963783 10878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "951c7a4ceb3945818592a3e66350b8d0"
format_stamp: "Formatted at 2024-05-02 01:57:57 on dist-test-slave-dr9f"
I20240502 01:57:57.964236 10878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "951c7a4ceb3945818592a3e66350b8d0"
format_stamp: "Formatted at 2024-05-02 01:57:57 on dist-test-slave-dr9f"
I20240502 01:57:57.967398 10878 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20240502 01:57:57.969381 10892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:57:57.970321 10878 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20240502 01:57:57.970427 10878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "951c7a4ceb3945818592a3e66350b8d0"
format_stamp: "Formatted at 2024-05-02 01:57:57 on dist-test-slave-dr9f"
I20240502 01:57:57.970516 10878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:57:57.984850 10878 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:57:57.985464 10878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:57:57.985623 10878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:57:57.986172 10878 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:57:57.987023 10878 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:57:57.987074 10878 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:57:57.987131 10878 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:57:57.987164 10878 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:57:57.995772 10878 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.193:34093
I20240502 01:57:57.995796 11007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.193:34093 every 8 connection(s)
I20240502 01:57:57.996672 10878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20240502 01:57:57.998873 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 10878
I20240502 01:57:57.998966 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20240502 01:57:58.000979 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.194:0
--local_ip_for_outbound_sockets=127.10.133.194
--webserver_interface=127.10.133.194
--webserver_port=0
--tserver_master_addrs=127.10.133.254:39197
--builtin_ntp_servers=127.10.133.212:40157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:57:58.005857 11008 heartbeater.cc:347] Connected to a master server at 127.10.133.254:39197
I20240502 01:57:58.006147 11008 heartbeater.cc:464] Registering TS with master...
I20240502 01:57:58.006867 11008 heartbeater.cc:511] Master 127.10.133.254:39197 requested a full tablet report, sending...
I20240502 01:57:58.008353 10818 ts_manager.cc:194] Registered new tserver with Master: 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093)
I20240502 01:57:58.009474 10818 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.193:33517
W20240502 01:57:58.104635 11011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:57:58.104828 11011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:57:58.104869 11011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:57:58.107659 11011 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:57:58.107712 11011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:57:58.107769 11011 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.194
I20240502 01:57:58.111101 11011 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:40157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.133.194
--webserver_port=0
--tserver_master_addrs=127.10.133.254:39197
--never_fsync=true
--heap_profile_path=/tmp/kudu.11011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.194
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:57:58.111907 11011 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:57:58.112951 11011 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:57:58.120757 11016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:57:58.121166 11019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:57:58.121315 11017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:57:58.122064 11011 server_base.cc:1034] running on GCE node
I20240502 01:57:58.122375 11011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:57:58.122876 11011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:57:58.124017 11011 hybrid_clock.cc:648] HybridClock initialized: now 1714615078124009 us; error 26 us; skew 500 ppm
I20240502 01:57:58.125602 11011 webserver.cc:460] Webserver started at http://127.10.133.194:40013/ using document root <none> and password file <none>
I20240502 01:57:58.126133 11011 fs_manager.cc:359] Metadata directory not provided
I20240502 01:57:58.126196 11011 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:57:58.126384 11011 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:57:58.127916 11011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "a10d08940e88404aa65d42eff8c0fce8"
format_stamp: "Formatted at 2024-05-02 01:57:58 on dist-test-slave-dr9f"
I20240502 01:57:58.128401 11011 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "a10d08940e88404aa65d42eff8c0fce8"
format_stamp: "Formatted at 2024-05-02 01:57:58 on dist-test-slave-dr9f"
I20240502 01:57:58.131438 11011 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s
I20240502 01:57:58.133533 11025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:57:58.134479 11011 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240502 01:57:58.134578 11011 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "a10d08940e88404aa65d42eff8c0fce8"
format_stamp: "Formatted at 2024-05-02 01:57:58 on dist-test-slave-dr9f"
I20240502 01:57:58.134654 11011 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:57:58.153728 11011 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:57:58.154352 11011 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:57:58.154502 11011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:57:58.154981 11011 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:57:58.155810 11011 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:57:58.155856 11011 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:57:58.155912 11011 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:57:58.155939 11011 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:57:58.163910 11011 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.194:45753
I20240502 01:57:58.163942 11139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.194:45753 every 8 connection(s)
I20240502 01:57:58.164754 11011 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20240502 01:57:58.166677 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 11011
I20240502 01:57:58.166775 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20240502 01:57:58.168663 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.195:0
--local_ip_for_outbound_sockets=127.10.133.195
--webserver_interface=127.10.133.195
--webserver_port=0
--tserver_master_addrs=127.10.133.254:39197
--builtin_ntp_servers=127.10.133.212:40157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:57:58.173306 11140 heartbeater.cc:347] Connected to a master server at 127.10.133.254:39197
I20240502 01:57:58.173558 11140 heartbeater.cc:464] Registering TS with master...
I20240502 01:57:58.174080 11140 heartbeater.cc:511] Master 127.10.133.254:39197 requested a full tablet report, sending...
I20240502 01:57:58.175107 10818 ts_manager.cc:194] Registered new tserver with Master: a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753)
I20240502 01:57:58.175900 10818 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.194:43855
W20240502 01:57:58.275362 11143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:57:58.275625 11143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:57:58.275717 11143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:57:58.279136 11143 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:57:58.279212 11143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:57:58.279297 11143 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.195
I20240502 01:57:58.282835 11143 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:40157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.133.195
--webserver_port=0
--tserver_master_addrs=127.10.133.254:39197
--never_fsync=true
--heap_profile_path=/tmp/kudu.11143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.195
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:57:58.283674 11143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:57:58.284767 11143 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:57:58.292737 11151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:57:58.292905 11149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:57:58.293473 11148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:57:58.294175 11143 server_base.cc:1034] running on GCE node
I20240502 01:57:58.294493 11143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:57:58.294976 11143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:57:58.296130 11143 hybrid_clock.cc:648] HybridClock initialized: now 1714615078296114 us; error 38 us; skew 500 ppm
I20240502 01:57:58.297694 11143 webserver.cc:460] Webserver started at http://127.10.133.195:45731/ using document root <none> and password file <none>
I20240502 01:57:58.298241 11143 fs_manager.cc:359] Metadata directory not provided
I20240502 01:57:58.298300 11143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:57:58.298457 11143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:57:58.299942 11143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "1acde06f8a9b403695365a61c41ab905"
format_stamp: "Formatted at 2024-05-02 01:57:58 on dist-test-slave-dr9f"
I20240502 01:57:58.300354 11143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "1acde06f8a9b403695365a61c41ab905"
format_stamp: "Formatted at 2024-05-02 01:57:58 on dist-test-slave-dr9f"
I20240502 01:57:58.303421 11143 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20240502 01:57:58.305351 11157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:57:58.306304 11143 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:57:58.306402 11143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "1acde06f8a9b403695365a61c41ab905"
format_stamp: "Formatted at 2024-05-02 01:57:58 on dist-test-slave-dr9f"
I20240502 01:57:58.306475 11143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:57:58.316183 11143 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:57:58.316682 11143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:57:58.316821 11143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:57:58.317262 11143 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:57:58.318055 11143 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:57:58.318100 11143 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:57:58.318157 11143 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:57:58.318184 11143 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:57:58.326257 11143 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.195:44473
I20240502 01:57:58.326283 11270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.195:44473 every 8 connection(s)
I20240502 01:57:58.327085 11143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20240502 01:57:58.334321 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 11143
I20240502 01:57:58.334426 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TableRangeRebalancingTest.Basic.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20240502 01:57:58.334653 11271 heartbeater.cc:347] Connected to a master server at 127.10.133.254:39197
I20240502 01:57:58.334841 11271 heartbeater.cc:464] Registering TS with master...
I20240502 01:57:58.335287 11271 heartbeater.cc:511] Master 127.10.133.254:39197 requested a full tablet report, sending...
I20240502 01:57:58.336198 10817 ts_manager.cc:194] Registered new tserver with Master: 1acde06f8a9b403695365a61c41ab905 (127.10.133.195:44473)
I20240502 01:57:58.336742 10817 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.195:33235
I20240502 01:57:58.348043 10775 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20240502 01:57:58.358347 10775 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20240502 01:57:59.012179 11008 heartbeater.cc:503] Master 127.10.133.254:39197 was elected leader, sending a full tablet report...
I20240502 01:57:59.177624 11140 heartbeater.cc:503] Master 127.10.133.254:39197 was elected leader, sending a full tablet report...
I20240502 01:57:59.338439 11271 heartbeater.cc:503] Master 127.10.133.254:39197 was elected leader, sending a full tablet report...
I20240502 01:58:02.111042 10817 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60910:
name: "rebalance_test_table_0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\200\007\001\000\000\000\000\000\006\001\000\000\000\000\000\007\001\000\377\377\377\177"
indirect_data: "<redacted>"""
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 8
seed: 0
}
}
W20240502 01:58:02.114089 10817 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20240502 01:58:02.132948 11205 tablet_service.cc:1467] Processing CreateTablet for tablet 695664285e004216ad89b4a786b6387d (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.133610 10940 tablet_service.cc:1467] Processing CreateTablet for tablet bd693e8dde084bd5a2010d1d77e41c3c (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.133895 10929 tablet_service.cc:1467] Processing CreateTablet for tablet 278a862211994821b286e97ab507b24e (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.134104 10934 tablet_service.cc:1467] Processing CreateTablet for tablet 291a8288505146f2bbefae74ba06b06a (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.134284 11203 tablet_service.cc:1467] Processing CreateTablet for tablet 619a326e88e14afab664fdd75e049ddd (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.134333 10933 tablet_service.cc:1467] Processing CreateTablet for tablet b7354329657c446ca93a760b45286859 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.133404 10941 tablet_service.cc:1467] Processing CreateTablet for tablet 695664285e004216ad89b4a786b6387d (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.133406 10939 tablet_service.cc:1467] Processing CreateTablet for tablet 619a326e88e14afab664fdd75e049ddd (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.134644 10940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd693e8dde084bd5a2010d1d77e41c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.133402 10930 tablet_service.cc:1467] Processing CreateTablet for tablet f43d8bb63caa47d68e7193c54c8263d4 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.134737 11202 tablet_service.cc:1467] Processing CreateTablet for tablet 5eb4a838865b4ef68984481d70518380 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.134812 10937 tablet_service.cc:1467] Processing CreateTablet for tablet f62417ff2a8f4bb580eeebf11627487a (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.135035 10939 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 619a326e88e14afab664fdd75e049ddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.135025 10938 tablet_service.cc:1467] Processing CreateTablet for tablet 5eb4a838865b4ef68984481d70518380 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.135169 11200 tablet_service.cc:1467] Processing CreateTablet for tablet 71368a3e53d84be6a5c35a872b502d21 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.135250 10936 tablet_service.cc:1467] Processing CreateTablet for tablet 71368a3e53d84be6a5c35a872b502d21 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.135476 11196 tablet_service.cc:1467] Processing CreateTablet for tablet 8333a34264964548a99bd736c94dadd2 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.133821 10931 tablet_service.cc:1467] Processing CreateTablet for tablet 8333a34264964548a99bd736c94dadd2 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.135991 10933 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7354329657c446ca93a760b45286859. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.135929 11204 tablet_service.cc:1467] Processing CreateTablet for tablet bd693e8dde084bd5a2010d1d77e41c3c (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.136153 10936 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71368a3e53d84be6a5c35a872b502d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.136269 10934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 291a8288505146f2bbefae74ba06b06a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.136226 11201 tablet_service.cc:1467] Processing CreateTablet for tablet f62417ff2a8f4bb580eeebf11627487a (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.136526 10938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eb4a838865b4ef68984481d70518380. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.136539 11195 tablet_service.cc:1467] Processing CreateTablet for tablet f43d8bb63caa47d68e7193c54c8263d4 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.133527 10935 tablet_service.cc:1467] Processing CreateTablet for tablet c1c75d212ed94340a46b3fc6d509ff03 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.136780 10935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1c75d212ed94340a46b3fc6d509ff03. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.136885 11199 tablet_service.cc:1467] Processing CreateTablet for tablet c1c75d212ed94340a46b3fc6d509ff03 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.137020 10929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 278a862211994821b286e97ab507b24e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.137161 11197 tablet_service.cc:1467] Processing CreateTablet for tablet b7354329657c446ca93a760b45286859 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.137446 11198 tablet_service.cc:1467] Processing CreateTablet for tablet 291a8288505146f2bbefae74ba06b06a (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.138096 11205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 695664285e004216ad89b4a786b6387d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.138888 10937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f62417ff2a8f4bb580eeebf11627487a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.139539 10931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8333a34264964548a99bd736c94dadd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.139668 11199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1c75d212ed94340a46b3fc6d509ff03. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.141361 11196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8333a34264964548a99bd736c94dadd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.142158 11197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7354329657c446ca93a760b45286859. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.142431 10941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 695664285e004216ad89b4a786b6387d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.142733 10930 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f43d8bb63caa47d68e7193c54c8263d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.143661 11204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd693e8dde084bd5a2010d1d77e41c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.145542 11195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f43d8bb63caa47d68e7193c54c8263d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.145998 11202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eb4a838865b4ef68984481d70518380. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.147919 11201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f62417ff2a8f4bb580eeebf11627487a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.148451 11291 tablet_bootstrap.cc:492] T 8333a34264964548a99bd736c94dadd2 P 1acde06f8a9b403695365a61c41ab905: Bootstrap starting.
I20240502 01:58:02.148756 11198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 291a8288505146f2bbefae74ba06b06a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.150105 11201 tablet_service.cc:1467] Processing CreateTablet for tablet 278a862211994821b286e97ab507b24e (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.150321 11201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 278a862211994821b286e97ab507b24e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.151036 11291 tablet_bootstrap.cc:654] T 8333a34264964548a99bd736c94dadd2 P 1acde06f8a9b403695365a61c41ab905: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.151571 10929 tablet_service.cc:1467] Processing CreateTablet for tablet 7f91469e0fe244b69d27c7245a8f064f (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.151810 10929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f91469e0fe244b69d27c7245a8f064f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.151924 11291 log.cc:824] T 8333a34264964548a99bd736c94dadd2 P 1acde06f8a9b403695365a61c41ab905: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:02.152575 11201 tablet_service.cc:1467] Processing CreateTablet for tablet 7f91469e0fe244b69d27c7245a8f064f (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.153086 11200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71368a3e53d84be6a5c35a872b502d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.153196 11201 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f91469e0fe244b69d27c7245a8f064f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.153321 11203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 619a326e88e14afab664fdd75e049ddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.154268 11060 tablet_service.cc:1467] Processing CreateTablet for tablet b5448e58213f494bbd967d92a8f986b9 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.154765 11063 tablet_service.cc:1467] Processing CreateTablet for tablet f43d8bb63caa47d68e7193c54c8263d4 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.155128 11065 tablet_service.cc:1467] Processing CreateTablet for tablet b7354329657c446ca93a760b45286859 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.155439 11063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f43d8bb63caa47d68e7193c54c8263d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.155496 11066 tablet_service.cc:1467] Processing CreateTablet for tablet 291a8288505146f2bbefae74ba06b06a (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.155730 11066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 291a8288505146f2bbefae74ba06b06a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.156520 11062 tablet_service.cc:1467] Processing CreateTablet for tablet 278a862211994821b286e97ab507b24e (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.156751 11062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 278a862211994821b286e97ab507b24e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.157263 11068 tablet_service.cc:1467] Processing CreateTablet for tablet 71368a3e53d84be6a5c35a872b502d21 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.157320 11061 tablet_service.cc:1467] Processing CreateTablet for tablet 7f91469e0fe244b69d27c7245a8f064f (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.157487 11068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 71368a3e53d84be6a5c35a872b502d21. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.157760 11059 tablet_service.cc:1467] Processing CreateTablet for tablet b1947fc743d14c4fae1497a2bd3c792c (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.157999 11059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1947fc743d14c4fae1497a2bd3c792c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.159615 11290 tablet_bootstrap.cc:492] T 291a8288505146f2bbefae74ba06b06a P 951c7a4ceb3945818592a3e66350b8d0: Bootstrap starting.
I20240502 01:58:02.160254 11071 tablet_service.cc:1467] Processing CreateTablet for tablet 619a326e88e14afab664fdd75e049ddd (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.160512 11071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 619a326e88e14afab664fdd75e049ddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.161077 11058 tablet_service.cc:1467] Processing CreateTablet for tablet 8635b3048c3d406d9f5a79b9a827930d (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.161286 11058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8635b3048c3d406d9f5a79b9a827930d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.161589 11290 tablet_bootstrap.cc:654] T 291a8288505146f2bbefae74ba06b06a P 951c7a4ceb3945818592a3e66350b8d0: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.161703 11292 tablet_bootstrap.cc:492] T b1947fc743d14c4fae1497a2bd3c792c P a10d08940e88404aa65d42eff8c0fce8: Bootstrap starting.
I20240502 01:58:02.162266 11069 tablet_service.cc:1467] Processing CreateTablet for tablet f62417ff2a8f4bb580eeebf11627487a (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.162374 11290 log.cc:824] T 291a8288505146f2bbefae74ba06b06a P 951c7a4ceb3945818592a3e66350b8d0: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:02.162504 11069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f62417ff2a8f4bb580eeebf11627487a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.163268 11061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f91469e0fe244b69d27c7245a8f064f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.163525 11070 tablet_service.cc:1467] Processing CreateTablet for tablet 5eb4a838865b4ef68984481d70518380 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.163592 11292 tablet_bootstrap.cc:654] T b1947fc743d14c4fae1497a2bd3c792c P a10d08940e88404aa65d42eff8c0fce8: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.163740 11070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eb4a838865b4ef68984481d70518380. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.164391 11292 log.cc:824] T b1947fc743d14c4fae1497a2bd3c792c P a10d08940e88404aa65d42eff8c0fce8: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:02.164382 11067 tablet_service.cc:1467] Processing CreateTablet for tablet c1c75d212ed94340a46b3fc6d509ff03 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.164623 11067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1c75d212ed94340a46b3fc6d509ff03. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.165596 11074 tablet_service.cc:1467] Processing CreateTablet for tablet 695664285e004216ad89b4a786b6387d (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.166453 11205 tablet_service.cc:1467] Processing CreateTablet for tablet b5448e58213f494bbd967d92a8f986b9 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.166582 11199 tablet_service.cc:1467] Processing CreateTablet for tablet b1947fc743d14c4fae1497a2bd3c792c (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.166718 11205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5448e58213f494bbd967d92a8f986b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.166965 11200 tablet_service.cc:1467] Processing CreateTablet for tablet 8635b3048c3d406d9f5a79b9a827930d (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.167158 11200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8635b3048c3d406d9f5a79b9a827930d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.167446 11291 tablet_bootstrap.cc:492] T 8333a34264964548a99bd736c94dadd2 P 1acde06f8a9b403695365a61c41ab905: No bootstrap required, opened a new log
I20240502 01:58:02.167459 10937 tablet_service.cc:1467] Processing CreateTablet for tablet b5448e58213f494bbd967d92a8f986b9 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.167598 11291 ts_tablet_manager.cc:1367] T 8333a34264964548a99bd736c94dadd2 P 1acde06f8a9b403695365a61c41ab905: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.002s
I20240502 01:58:02.167698 10937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5448e58213f494bbd967d92a8f986b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.168632 10936 tablet_service.cc:1467] Processing CreateTablet for tablet 8635b3048c3d406d9f5a79b9a827930d (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.168810 11199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1947fc743d14c4fae1497a2bd3c792c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.168843 10936 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8635b3048c3d406d9f5a79b9a827930d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.170334 10938 tablet_service.cc:1467] Processing CreateTablet for tablet b1947fc743d14c4fae1497a2bd3c792c (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION -2147483648 <= VALUES < 0
I20240502 01:58:02.170581 10938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1947fc743d14c4fae1497a2bd3c792c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.172250 11291 raft_consensus.cc:348] T 8333a34264964548a99bd736c94dadd2 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.172488 11291 raft_consensus.cc:374] T 8333a34264964548a99bd736c94dadd2 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.172566 11291 raft_consensus.cc:729] T 8333a34264964548a99bd736c94dadd2 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.172995 11074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 695664285e004216ad89b4a786b6387d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.173110 11290 tablet_bootstrap.cc:492] T 291a8288505146f2bbefae74ba06b06a P 951c7a4ceb3945818592a3e66350b8d0: No bootstrap required, opened a new log
I20240502 01:58:02.173187 11292 tablet_bootstrap.cc:492] T b1947fc743d14c4fae1497a2bd3c792c P a10d08940e88404aa65d42eff8c0fce8: No bootstrap required, opened a new log
I20240502 01:58:02.173255 11290 ts_tablet_manager.cc:1367] T 291a8288505146f2bbefae74ba06b06a P 951c7a4ceb3945818592a3e66350b8d0: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20240502 01:58:02.173308 11292 ts_tablet_manager.cc:1367] T b1947fc743d14c4fae1497a2bd3c792c P a10d08940e88404aa65d42eff8c0fce8: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20240502 01:58:02.174858 11065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7354329657c446ca93a760b45286859. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.176101 11073 tablet_service.cc:1467] Processing CreateTablet for tablet bd693e8dde084bd5a2010d1d77e41c3c (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.154217 11064 tablet_service.cc:1467] Processing CreateTablet for tablet 8333a34264964548a99bd736c94dadd2 (DEFAULT_TABLE table=rebalance_test_table_0 [id=e05063549da845e6b31368af912c8914]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION 0 <= VALUES < 2147483647
I20240502 01:58:02.176391 11060 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b5448e58213f494bbd967d92a8f986b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.176302 11292 raft_consensus.cc:348] T b1947fc743d14c4fae1497a2bd3c792c P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.176501 11292 raft_consensus.cc:374] T b1947fc743d14c4fae1497a2bd3c792c P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.176545 11292 raft_consensus.cc:729] T b1947fc743d14c4fae1497a2bd3c792c P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10d08940e88404aa65d42eff8c0fce8, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.176535 11290 raft_consensus.cc:348] T 291a8288505146f2bbefae74ba06b06a P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.176713 11290 raft_consensus.cc:374] T 291a8288505146f2bbefae74ba06b06a P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.176761 11290 raft_consensus.cc:729] T 291a8288505146f2bbefae74ba06b06a P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951c7a4ceb3945818592a3e66350b8d0, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.176926 11292 consensus_queue.cc:260] T b1947fc743d14c4fae1497a2bd3c792c P a10d08940e88404aa65d42eff8c0fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.177116 11290 consensus_queue.cc:260] T 291a8288505146f2bbefae74ba06b06a P 951c7a4ceb3945818592a3e66350b8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.177927 11292 ts_tablet_manager.cc:1398] T b1947fc743d14c4fae1497a2bd3c792c P a10d08940e88404aa65d42eff8c0fce8: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:58:02.177932 11290 ts_tablet_manager.cc:1398] T 291a8288505146f2bbefae74ba06b06a P 951c7a4ceb3945818592a3e66350b8d0: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20240502 01:58:02.178278 11290 tablet_bootstrap.cc:492] T f62417ff2a8f4bb580eeebf11627487a P 951c7a4ceb3945818592a3e66350b8d0: Bootstrap starting.
I20240502 01:58:02.178352 11064 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8333a34264964548a99bd736c94dadd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.179142 11290 tablet_bootstrap.cc:654] T f62417ff2a8f4bb580eeebf11627487a P 951c7a4ceb3945818592a3e66350b8d0: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.179641 11291 consensus_queue.cc:260] T 8333a34264964548a99bd736c94dadd2 P 1acde06f8a9b403695365a61c41ab905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.180137 11073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd693e8dde084bd5a2010d1d77e41c3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:02.180400 11291 ts_tablet_manager.cc:1398] T 8333a34264964548a99bd736c94dadd2 P 1acde06f8a9b403695365a61c41ab905: Time spent starting tablet: real 0.013s user 0.004s sys 0.001s
I20240502 01:58:02.180716 11291 tablet_bootstrap.cc:492] T bd693e8dde084bd5a2010d1d77e41c3c P 1acde06f8a9b403695365a61c41ab905: Bootstrap starting.
I20240502 01:58:02.181563 11291 tablet_bootstrap.cc:654] T bd693e8dde084bd5a2010d1d77e41c3c P 1acde06f8a9b403695365a61c41ab905: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.182685 11292 tablet_bootstrap.cc:492] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8: Bootstrap starting.
I20240502 01:58:02.183528 11292 tablet_bootstrap.cc:654] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.184012 11291 tablet_bootstrap.cc:492] T bd693e8dde084bd5a2010d1d77e41c3c P 1acde06f8a9b403695365a61c41ab905: No bootstrap required, opened a new log
I20240502 01:58:02.184113 11291 ts_tablet_manager.cc:1367] T bd693e8dde084bd5a2010d1d77e41c3c P 1acde06f8a9b403695365a61c41ab905: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240502 01:58:02.184669 11291 raft_consensus.cc:348] T bd693e8dde084bd5a2010d1d77e41c3c P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.184778 11291 raft_consensus.cc:374] T bd693e8dde084bd5a2010d1d77e41c3c P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.184810 11291 raft_consensus.cc:729] T bd693e8dde084bd5a2010d1d77e41c3c P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.184924 11291 consensus_queue.cc:260] T bd693e8dde084bd5a2010d1d77e41c3c P 1acde06f8a9b403695365a61c41ab905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.184981 11292 tablet_bootstrap.cc:492] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8: No bootstrap required, opened a new log
I20240502 01:58:02.185047 11292 ts_tablet_manager.cc:1367] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:02.185194 11291 ts_tablet_manager.cc:1398] T bd693e8dde084bd5a2010d1d77e41c3c P 1acde06f8a9b403695365a61c41ab905: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:02.185344 11291 tablet_bootstrap.cc:492] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905: Bootstrap starting.
I20240502 01:58:02.185582 11292 raft_consensus.cc:348] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.185670 11292 raft_consensus.cc:374] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.185704 11292 raft_consensus.cc:729] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10d08940e88404aa65d42eff8c0fce8, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.185709 11290 tablet_bootstrap.cc:492] T f62417ff2a8f4bb580eeebf11627487a P 951c7a4ceb3945818592a3e66350b8d0: No bootstrap required, opened a new log
I20240502 01:58:02.185793 11290 ts_tablet_manager.cc:1367] T f62417ff2a8f4bb580eeebf11627487a P 951c7a4ceb3945818592a3e66350b8d0: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20240502 01:58:02.185827 11292 consensus_queue.cc:260] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.186059 11292 ts_tablet_manager.cc:1398] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:02.186199 11291 tablet_bootstrap.cc:654] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.186213 11292 tablet_bootstrap.cc:492] T 291a8288505146f2bbefae74ba06b06a P a10d08940e88404aa65d42eff8c0fce8: Bootstrap starting.
I20240502 01:58:02.186342 11290 raft_consensus.cc:348] T f62417ff2a8f4bb580eeebf11627487a P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.186439 11290 raft_consensus.cc:374] T f62417ff2a8f4bb580eeebf11627487a P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.186475 11290 raft_consensus.cc:729] T f62417ff2a8f4bb580eeebf11627487a P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951c7a4ceb3945818592a3e66350b8d0, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.186578 11290 consensus_queue.cc:260] T f62417ff2a8f4bb580eeebf11627487a P 951c7a4ceb3945818592a3e66350b8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.186846 11290 ts_tablet_manager.cc:1398] T f62417ff2a8f4bb580eeebf11627487a P 951c7a4ceb3945818592a3e66350b8d0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:02.186996 11290 tablet_bootstrap.cc:492] T c1c75d212ed94340a46b3fc6d509ff03 P 951c7a4ceb3945818592a3e66350b8d0: Bootstrap starting.
I20240502 01:58:02.187083 11292 tablet_bootstrap.cc:654] T 291a8288505146f2bbefae74ba06b06a P a10d08940e88404aa65d42eff8c0fce8: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.187889 11290 tablet_bootstrap.cc:654] T c1c75d212ed94340a46b3fc6d509ff03 P 951c7a4ceb3945818592a3e66350b8d0: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.188218 11292 tablet_bootstrap.cc:492] T 291a8288505146f2bbefae74ba06b06a P a10d08940e88404aa65d42eff8c0fce8: No bootstrap required, opened a new log
I20240502 01:58:02.188293 11292 ts_tablet_manager.cc:1367] T 291a8288505146f2bbefae74ba06b06a P a10d08940e88404aa65d42eff8c0fce8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:02.188732 11292 raft_consensus.cc:348] T 291a8288505146f2bbefae74ba06b06a P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.188951 11292 raft_consensus.cc:374] T 291a8288505146f2bbefae74ba06b06a P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.189031 11292 raft_consensus.cc:729] T 291a8288505146f2bbefae74ba06b06a P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10d08940e88404aa65d42eff8c0fce8, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.189081 11290 tablet_bootstrap.cc:492] T c1c75d212ed94340a46b3fc6d509ff03 P 951c7a4ceb3945818592a3e66350b8d0: No bootstrap required, opened a new log
I20240502 01:58:02.189162 11290 ts_tablet_manager.cc:1367] T c1c75d212ed94340a46b3fc6d509ff03 P 951c7a4ceb3945818592a3e66350b8d0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:02.189270 11292 consensus_queue.cc:260] T 291a8288505146f2bbefae74ba06b06a P a10d08940e88404aa65d42eff8c0fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.189674 11292 ts_tablet_manager.cc:1398] T 291a8288505146f2bbefae74ba06b06a P a10d08940e88404aa65d42eff8c0fce8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:02.189769 11291 tablet_bootstrap.cc:492] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905: No bootstrap required, opened a new log
I20240502 01:58:02.189771 11290 raft_consensus.cc:348] T c1c75d212ed94340a46b3fc6d509ff03 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.189855 11291 ts_tablet_manager.cc:1367] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20240502 01:58:02.189872 11290 raft_consensus.cc:374] T c1c75d212ed94340a46b3fc6d509ff03 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.189955 11290 raft_consensus.cc:729] T c1c75d212ed94340a46b3fc6d509ff03 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951c7a4ceb3945818592a3e66350b8d0, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.190135 11292 tablet_bootstrap.cc:492] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8: Bootstrap starting.
I20240502 01:58:02.190120 11290 consensus_queue.cc:260] T c1c75d212ed94340a46b3fc6d509ff03 P 951c7a4ceb3945818592a3e66350b8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.190327 11291 raft_consensus.cc:348] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.190429 11291 raft_consensus.cc:374] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.190471 11291 raft_consensus.cc:729] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.190465 11290 ts_tablet_manager.cc:1398] T c1c75d212ed94340a46b3fc6d509ff03 P 951c7a4ceb3945818592a3e66350b8d0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:02.190582 11291 consensus_queue.cc:260] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.190634 11290 tablet_bootstrap.cc:492] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0: Bootstrap starting.
I20240502 01:58:02.190862 11291 ts_tablet_manager.cc:1398] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:02.191020 11291 tablet_bootstrap.cc:492] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905: Bootstrap starting.
I20240502 01:58:02.191542 11292 tablet_bootstrap.cc:654] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.191545 11290 tablet_bootstrap.cc:654] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.192123 11291 tablet_bootstrap.cc:654] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.193224 11291 tablet_bootstrap.cc:492] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905: No bootstrap required, opened a new log
I20240502 01:58:02.193303 11291 ts_tablet_manager.cc:1367] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:58:02.193666 11291 raft_consensus.cc:348] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.193773 11291 raft_consensus.cc:374] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.193806 11291 raft_consensus.cc:729] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.193923 11290 tablet_bootstrap.cc:492] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0: No bootstrap required, opened a new log
I20240502 01:58:02.193912 11291 consensus_queue.cc:260] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.194007 11290 ts_tablet_manager.cc:1367] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:02.194200 11291 ts_tablet_manager.cc:1398] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:02.194337 11291 tablet_bootstrap.cc:492] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905: Bootstrap starting.
I20240502 01:58:02.194451 11290 raft_consensus.cc:348] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.194542 11292 tablet_bootstrap.cc:492] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8: No bootstrap required, opened a new log
I20240502 01:58:02.194548 11290 raft_consensus.cc:374] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.194582 11290 raft_consensus.cc:729] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951c7a4ceb3945818592a3e66350b8d0, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.194615 11292 ts_tablet_manager.cc:1367] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:58:02.194885 11290 consensus_queue.cc:260] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.195232 11291 tablet_bootstrap.cc:654] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.195358 11290 ts_tablet_manager.cc:1398] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:02.195051 11292 raft_consensus.cc:348] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.195613 11292 raft_consensus.cc:374] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.195636 11290 tablet_bootstrap.cc:492] T bd693e8dde084bd5a2010d1d77e41c3c P 951c7a4ceb3945818592a3e66350b8d0: Bootstrap starting.
I20240502 01:58:02.195699 11292 raft_consensus.cc:729] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10d08940e88404aa65d42eff8c0fce8, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.195875 11292 consensus_queue.cc:260] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.196163 11292 ts_tablet_manager.cc:1398] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:02.196326 11292 tablet_bootstrap.cc:492] T 8635b3048c3d406d9f5a79b9a827930d P a10d08940e88404aa65d42eff8c0fce8: Bootstrap starting.
I20240502 01:58:02.196667 11290 tablet_bootstrap.cc:654] T bd693e8dde084bd5a2010d1d77e41c3c P 951c7a4ceb3945818592a3e66350b8d0: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.197201 11292 tablet_bootstrap.cc:654] T 8635b3048c3d406d9f5a79b9a827930d P a10d08940e88404aa65d42eff8c0fce8: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.197607 11291 tablet_bootstrap.cc:492] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905: No bootstrap required, opened a new log
I20240502 01:58:02.197683 11291 ts_tablet_manager.cc:1367] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:02.198216 11291 raft_consensus.cc:348] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.198302 11291 raft_consensus.cc:374] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.198333 11291 raft_consensus.cc:729] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.198356 11292 tablet_bootstrap.cc:492] T 8635b3048c3d406d9f5a79b9a827930d P a10d08940e88404aa65d42eff8c0fce8: No bootstrap required, opened a new log
I20240502 01:58:02.198419 11292 ts_tablet_manager.cc:1367] T 8635b3048c3d406d9f5a79b9a827930d P a10d08940e88404aa65d42eff8c0fce8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:02.198419 11290 tablet_bootstrap.cc:492] T bd693e8dde084bd5a2010d1d77e41c3c P 951c7a4ceb3945818592a3e66350b8d0: No bootstrap required, opened a new log
I20240502 01:58:02.198433 11291 consensus_queue.cc:260] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.198503 11290 ts_tablet_manager.cc:1367] T bd693e8dde084bd5a2010d1d77e41c3c P 951c7a4ceb3945818592a3e66350b8d0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:02.198710 11291 ts_tablet_manager.cc:1398] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:02.198858 11291 tablet_bootstrap.cc:492] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905: Bootstrap starting.
I20240502 01:58:02.198935 11290 raft_consensus.cc:348] T bd693e8dde084bd5a2010d1d77e41c3c P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.199010 11290 raft_consensus.cc:374] T bd693e8dde084bd5a2010d1d77e41c3c P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.199036 11290 raft_consensus.cc:729] T bd693e8dde084bd5a2010d1d77e41c3c P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951c7a4ceb3945818592a3e66350b8d0, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.199147 11290 consensus_queue.cc:260] T bd693e8dde084bd5a2010d1d77e41c3c P 951c7a4ceb3945818592a3e66350b8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.199144 11292 raft_consensus.cc:348] T 8635b3048c3d406d9f5a79b9a827930d P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.199229 11292 raft_consensus.cc:374] T 8635b3048c3d406d9f5a79b9a827930d P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.199258 11292 raft_consensus.cc:729] T 8635b3048c3d406d9f5a79b9a827930d P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10d08940e88404aa65d42eff8c0fce8, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.199384 11290 ts_tablet_manager.cc:1398] T bd693e8dde084bd5a2010d1d77e41c3c P 951c7a4ceb3945818592a3e66350b8d0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:02.199357 11292 consensus_queue.cc:260] T 8635b3048c3d406d9f5a79b9a827930d P a10d08940e88404aa65d42eff8c0fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.199523 11290 tablet_bootstrap.cc:492] T b7354329657c446ca93a760b45286859 P 951c7a4ceb3945818592a3e66350b8d0: Bootstrap starting.
I20240502 01:58:02.199622 11292 ts_tablet_manager.cc:1398] T 8635b3048c3d406d9f5a79b9a827930d P a10d08940e88404aa65d42eff8c0fce8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:02.199703 11291 tablet_bootstrap.cc:654] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.199779 11292 tablet_bootstrap.cc:492] T f62417ff2a8f4bb580eeebf11627487a P a10d08940e88404aa65d42eff8c0fce8: Bootstrap starting.
I20240502 01:58:02.200438 11290 tablet_bootstrap.cc:654] T b7354329657c446ca93a760b45286859 P 951c7a4ceb3945818592a3e66350b8d0: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.200593 11292 tablet_bootstrap.cc:654] T f62417ff2a8f4bb580eeebf11627487a P a10d08940e88404aa65d42eff8c0fce8: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.201545 11290 tablet_bootstrap.cc:492] T b7354329657c446ca93a760b45286859 P 951c7a4ceb3945818592a3e66350b8d0: No bootstrap required, opened a new log
I20240502 01:58:02.201681 11290 ts_tablet_manager.cc:1367] T b7354329657c446ca93a760b45286859 P 951c7a4ceb3945818592a3e66350b8d0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:02.202206 11292 tablet_bootstrap.cc:492] T f62417ff2a8f4bb580eeebf11627487a P a10d08940e88404aa65d42eff8c0fce8: No bootstrap required, opened a new log
I20240502 01:58:02.202303 11292 ts_tablet_manager.cc:1367] T f62417ff2a8f4bb580eeebf11627487a P a10d08940e88404aa65d42eff8c0fce8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:02.202226 11290 raft_consensus.cc:348] T b7354329657c446ca93a760b45286859 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.202483 11290 raft_consensus.cc:374] T b7354329657c446ca93a760b45286859 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.202543 11290 raft_consensus.cc:729] T b7354329657c446ca93a760b45286859 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951c7a4ceb3945818592a3e66350b8d0, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.202672 11290 consensus_queue.cc:260] T b7354329657c446ca93a760b45286859 P 951c7a4ceb3945818592a3e66350b8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.202705 11292 raft_consensus.cc:348] T f62417ff2a8f4bb580eeebf11627487a P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.202819 11292 raft_consensus.cc:374] T f62417ff2a8f4bb580eeebf11627487a P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.202857 11292 raft_consensus.cc:729] T f62417ff2a8f4bb580eeebf11627487a P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10d08940e88404aa65d42eff8c0fce8, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.202982 11290 ts_tablet_manager.cc:1398] T b7354329657c446ca93a760b45286859 P 951c7a4ceb3945818592a3e66350b8d0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:02.202962 11292 consensus_queue.cc:260] T f62417ff2a8f4bb580eeebf11627487a P a10d08940e88404aa65d42eff8c0fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.203135 11290 tablet_bootstrap.cc:492] T 695664285e004216ad89b4a786b6387d P 951c7a4ceb3945818592a3e66350b8d0: Bootstrap starting.
I20240502 01:58:02.203191 11292 ts_tablet_manager.cc:1398] T f62417ff2a8f4bb580eeebf11627487a P a10d08940e88404aa65d42eff8c0fce8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:02.203337 11292 tablet_bootstrap.cc:492] T 7f91469e0fe244b69d27c7245a8f064f P a10d08940e88404aa65d42eff8c0fce8: Bootstrap starting.
I20240502 01:58:02.203950 11290 tablet_bootstrap.cc:654] T 695664285e004216ad89b4a786b6387d P 951c7a4ceb3945818592a3e66350b8d0: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.204217 11292 tablet_bootstrap.cc:654] T 7f91469e0fe244b69d27c7245a8f064f P a10d08940e88404aa65d42eff8c0fce8: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.205045 11290 tablet_bootstrap.cc:492] T 695664285e004216ad89b4a786b6387d P 951c7a4ceb3945818592a3e66350b8d0: No bootstrap required, opened a new log
I20240502 01:58:02.205134 11290 ts_tablet_manager.cc:1367] T 695664285e004216ad89b4a786b6387d P 951c7a4ceb3945818592a3e66350b8d0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:02.205543 11292 tablet_bootstrap.cc:492] T 7f91469e0fe244b69d27c7245a8f064f P a10d08940e88404aa65d42eff8c0fce8: No bootstrap required, opened a new log
I20240502 01:58:02.205575 11290 raft_consensus.cc:348] T 695664285e004216ad89b4a786b6387d P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } }
I20240502 01:58:02.205664 11290 raft_consensus.cc:374] T 695664285e004216ad89b4a786b6387d P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.205696 11290 raft_consensus.cc:729] T 695664285e004216ad89b4a786b6387d P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951c7a4ceb3945818592a3e66350b8d0, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.205785 11292 ts_tablet_manager.cc:1367] T 7f91469e0fe244b69d27c7245a8f064f P a10d08940e88404aa65d42eff8c0fce8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:02.205814 11290 consensus_queue.cc:260] T 695664285e004216ad89b4a786b6387d P 951c7a4ceb3945818592a3e66350b8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } }
I20240502 01:58:02.206090 11290 ts_tablet_manager.cc:1398] T 695664285e004216ad89b4a786b6387d P 951c7a4ceb3945818592a3e66350b8d0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:02.206241 11290 tablet_bootstrap.cc:492] T f43d8bb63caa47d68e7193c54c8263d4 P 951c7a4ceb3945818592a3e66350b8d0: Bootstrap starting.
I20240502 01:58:02.206329 11292 raft_consensus.cc:348] T 7f91469e0fe244b69d27c7245a8f064f P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.206418 11292 raft_consensus.cc:374] T 7f91469e0fe244b69d27c7245a8f064f P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.206452 11292 raft_consensus.cc:729] T 7f91469e0fe244b69d27c7245a8f064f P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10d08940e88404aa65d42eff8c0fce8, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.206549 11292 consensus_queue.cc:260] T 7f91469e0fe244b69d27c7245a8f064f P a10d08940e88404aa65d42eff8c0fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.206863 11292 ts_tablet_manager.cc:1398] T 7f91469e0fe244b69d27c7245a8f064f P a10d08940e88404aa65d42eff8c0fce8: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:02.207041 11292 tablet_bootstrap.cc:492] T 5eb4a838865b4ef68984481d70518380 P a10d08940e88404aa65d42eff8c0fce8: Bootstrap starting.
I20240502 01:58:02.207104 11290 tablet_bootstrap.cc:654] T f43d8bb63caa47d68e7193c54c8263d4 P 951c7a4ceb3945818592a3e66350b8d0: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.208030 11292 tablet_bootstrap.cc:654] T 5eb4a838865b4ef68984481d70518380 P a10d08940e88404aa65d42eff8c0fce8: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.208038 11291 tablet_bootstrap.cc:492] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905: No bootstrap required, opened a new log
I20240502 01:58:02.208107 11291 ts_tablet_manager.cc:1367] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20240502 01:58:02.208226 11290 tablet_bootstrap.cc:492] T f43d8bb63caa47d68e7193c54c8263d4 P 951c7a4ceb3945818592a3e66350b8d0: No bootstrap required, opened a new log
I20240502 01:58:02.208329 11290 ts_tablet_manager.cc:1367] T f43d8bb63caa47d68e7193c54c8263d4 P 951c7a4ceb3945818592a3e66350b8d0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:02.208542 11291 raft_consensus.cc:348] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.208642 11291 raft_consensus.cc:374] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.208679 11291 raft_consensus.cc:729] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.208796 11291 consensus_queue.cc:260] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.208824 11290 raft_consensus.cc:348] T f43d8bb63caa47d68e7193c54c8263d4 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.208956 11290 raft_consensus.cc:374] T f43d8bb63caa47d68e7193c54c8263d4 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.209007 11290 raft_consensus.cc:729] T f43d8bb63caa47d68e7193c54c8263d4 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951c7a4ceb3945818592a3e66350b8d0, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.209029 11291 ts_tablet_manager.cc:1398] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:02.209184 11291 tablet_bootstrap.cc:492] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905: Bootstrap starting.
I20240502 01:58:02.209162 11290 consensus_queue.cc:260] T f43d8bb63caa47d68e7193c54c8263d4 P 951c7a4ceb3945818592a3e66350b8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.209467 11290 ts_tablet_manager.cc:1398] T f43d8bb63caa47d68e7193c54c8263d4 P 951c7a4ceb3945818592a3e66350b8d0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:02.209620 11290 tablet_bootstrap.cc:492] T 619a326e88e14afab664fdd75e049ddd P 951c7a4ceb3945818592a3e66350b8d0: Bootstrap starting.
I20240502 01:58:02.210122 11291 tablet_bootstrap.cc:654] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.210515 11290 tablet_bootstrap.cc:654] T 619a326e88e14afab664fdd75e049ddd P 951c7a4ceb3945818592a3e66350b8d0: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.211092 11291 tablet_bootstrap.cc:492] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905: No bootstrap required, opened a new log
I20240502 01:58:02.211182 11291 ts_tablet_manager.cc:1367] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240502 01:58:02.211680 11291 raft_consensus.cc:348] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.211794 11291 raft_consensus.cc:374] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.211843 11291 raft_consensus.cc:729] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.211962 11291 consensus_queue.cc:260] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.212056 11292 tablet_bootstrap.cc:492] T 5eb4a838865b4ef68984481d70518380 P a10d08940e88404aa65d42eff8c0fce8: No bootstrap required, opened a new log
I20240502 01:58:02.212133 11292 ts_tablet_manager.cc:1367] T 5eb4a838865b4ef68984481d70518380 P a10d08940e88404aa65d42eff8c0fce8: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20240502 01:58:02.212216 11291 ts_tablet_manager.cc:1398] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:02.212430 11291 tablet_bootstrap.cc:492] T 278a862211994821b286e97ab507b24e P 1acde06f8a9b403695365a61c41ab905: Bootstrap starting.
I20240502 01:58:02.212596 11292 raft_consensus.cc:348] T 5eb4a838865b4ef68984481d70518380 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.212685 11292 raft_consensus.cc:374] T 5eb4a838865b4ef68984481d70518380 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.212720 11292 raft_consensus.cc:729] T 5eb4a838865b4ef68984481d70518380 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10d08940e88404aa65d42eff8c0fce8, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.212831 11290 tablet_bootstrap.cc:492] T 619a326e88e14afab664fdd75e049ddd P 951c7a4ceb3945818592a3e66350b8d0: No bootstrap required, opened a new log
I20240502 01:58:02.212869 11292 consensus_queue.cc:260] T 5eb4a838865b4ef68984481d70518380 P a10d08940e88404aa65d42eff8c0fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.212922 11290 ts_tablet_manager.cc:1367] T 619a326e88e14afab664fdd75e049ddd P 951c7a4ceb3945818592a3e66350b8d0: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20240502 01:58:02.213116 11292 ts_tablet_manager.cc:1398] T 5eb4a838865b4ef68984481d70518380 P a10d08940e88404aa65d42eff8c0fce8: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:02.213285 11292 tablet_bootstrap.cc:492] T 71368a3e53d84be6a5c35a872b502d21 P a10d08940e88404aa65d42eff8c0fce8: Bootstrap starting.
I20240502 01:58:02.213326 11291 tablet_bootstrap.cc:654] T 278a862211994821b286e97ab507b24e P 1acde06f8a9b403695365a61c41ab905: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.213336 11290 raft_consensus.cc:348] T 619a326e88e14afab664fdd75e049ddd P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.213418 11290 raft_consensus.cc:374] T 619a326e88e14afab664fdd75e049ddd P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.213454 11290 raft_consensus.cc:729] T 619a326e88e14afab664fdd75e049ddd P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951c7a4ceb3945818592a3e66350b8d0, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.213610 11290 consensus_queue.cc:260] T 619a326e88e14afab664fdd75e049ddd P 951c7a4ceb3945818592a3e66350b8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.213955 11290 ts_tablet_manager.cc:1398] T 619a326e88e14afab664fdd75e049ddd P 951c7a4ceb3945818592a3e66350b8d0: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:02.214154 11290 tablet_bootstrap.cc:492] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0: Bootstrap starting.
I20240502 01:58:02.214547 11292 tablet_bootstrap.cc:654] T 71368a3e53d84be6a5c35a872b502d21 P a10d08940e88404aa65d42eff8c0fce8: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.215023 11291 tablet_bootstrap.cc:492] T 278a862211994821b286e97ab507b24e P 1acde06f8a9b403695365a61c41ab905: No bootstrap required, opened a new log
I20240502 01:58:02.215093 11291 ts_tablet_manager.cc:1367] T 278a862211994821b286e97ab507b24e P 1acde06f8a9b403695365a61c41ab905: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240502 01:58:02.215250 11290 tablet_bootstrap.cc:654] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.215550 11291 raft_consensus.cc:348] T 278a862211994821b286e97ab507b24e P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.215679 11291 raft_consensus.cc:374] T 278a862211994821b286e97ab507b24e P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.215725 11291 raft_consensus.cc:729] T 278a862211994821b286e97ab507b24e P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.215858 11291 consensus_queue.cc:260] T 278a862211994821b286e97ab507b24e P 1acde06f8a9b403695365a61c41ab905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.216250 11291 ts_tablet_manager.cc:1398] T 278a862211994821b286e97ab507b24e P 1acde06f8a9b403695365a61c41ab905: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:02.216351 11290 tablet_bootstrap.cc:492] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0: No bootstrap required, opened a new log
I20240502 01:58:02.216394 11291 tablet_bootstrap.cc:492] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905: Bootstrap starting.
I20240502 01:58:02.216372 11324 raft_consensus.cc:482] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:02.216421 11290 ts_tablet_manager.cc:1367] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:58:02.216524 11324 raft_consensus.cc:504] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.216576 11292 tablet_bootstrap.cc:492] T 71368a3e53d84be6a5c35a872b502d21 P a10d08940e88404aa65d42eff8c0fce8: No bootstrap required, opened a new log
I20240502 01:58:02.216637 11292 ts_tablet_manager.cc:1367] T 71368a3e53d84be6a5c35a872b502d21 P a10d08940e88404aa65d42eff8c0fce8: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20240502 01:58:02.216876 11290 raft_consensus.cc:348] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.216957 11290 raft_consensus.cc:374] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.216986 11290 raft_consensus.cc:729] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951c7a4ceb3945818592a3e66350b8d0, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.217093 11290 consensus_queue.cc:260] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.217180 11291 tablet_bootstrap.cc:654] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.217803 11299 raft_consensus.cc:482] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:02.217880 11299 raft_consensus.cc:504] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.218185 11290 ts_tablet_manager.cc:1398] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:02.218266 11299 leader_election.cc:288] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753)
I20240502 01:58:02.218338 11290 tablet_bootstrap.cc:492] T 5eb4a838865b4ef68984481d70518380 P 951c7a4ceb3945818592a3e66350b8d0: Bootstrap starting.
I20240502 01:58:02.218326 11292 raft_consensus.cc:348] T 71368a3e53d84be6a5c35a872b502d21 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.218422 11292 raft_consensus.cc:374] T 71368a3e53d84be6a5c35a872b502d21 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.218451 11292 raft_consensus.cc:729] T 71368a3e53d84be6a5c35a872b502d21 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10d08940e88404aa65d42eff8c0fce8, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.218566 11292 consensus_queue.cc:260] T 71368a3e53d84be6a5c35a872b502d21 P a10d08940e88404aa65d42eff8c0fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.219188 11292 ts_tablet_manager.cc:1398] T 71368a3e53d84be6a5c35a872b502d21 P a10d08940e88404aa65d42eff8c0fce8: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:58:02.219377 11292 tablet_bootstrap.cc:492] T b7354329657c446ca93a760b45286859 P a10d08940e88404aa65d42eff8c0fce8: Bootstrap starting.
I20240502 01:58:02.219394 11324 leader_election.cc:288] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753)
I20240502 01:58:02.220338 11292 tablet_bootstrap.cc:654] T b7354329657c446ca93a760b45286859 P a10d08940e88404aa65d42eff8c0fce8: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.221122 11290 tablet_bootstrap.cc:654] T 5eb4a838865b4ef68984481d70518380 P 951c7a4ceb3945818592a3e66350b8d0: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.222129 11290 tablet_bootstrap.cc:492] T 5eb4a838865b4ef68984481d70518380 P 951c7a4ceb3945818592a3e66350b8d0: No bootstrap required, opened a new log
I20240502 01:58:02.222208 11290 ts_tablet_manager.cc:1367] T 5eb4a838865b4ef68984481d70518380 P 951c7a4ceb3945818592a3e66350b8d0: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240502 01:58:02.222520 11290 raft_consensus.cc:348] T 5eb4a838865b4ef68984481d70518380 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.222594 11290 raft_consensus.cc:374] T 5eb4a838865b4ef68984481d70518380 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.222615 11290 raft_consensus.cc:729] T 5eb4a838865b4ef68984481d70518380 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951c7a4ceb3945818592a3e66350b8d0, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.222712 11290 consensus_queue.cc:260] T 5eb4a838865b4ef68984481d70518380 P 951c7a4ceb3945818592a3e66350b8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.222929 11290 ts_tablet_manager.cc:1398] T 5eb4a838865b4ef68984481d70518380 P 951c7a4ceb3945818592a3e66350b8d0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:02.223069 11290 tablet_bootstrap.cc:492] T 278a862211994821b286e97ab507b24e P 951c7a4ceb3945818592a3e66350b8d0: Bootstrap starting.
I20240502 01:58:02.223233 11291 tablet_bootstrap.cc:492] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905: No bootstrap required, opened a new log
I20240502 01:58:02.223299 11291 ts_tablet_manager.cc:1367] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20240502 01:58:02.223663 11291 raft_consensus.cc:348] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.223769 11291 raft_consensus.cc:374] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.223803 11291 raft_consensus.cc:729] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.223902 11290 tablet_bootstrap.cc:654] T 278a862211994821b286e97ab507b24e P 951c7a4ceb3945818592a3e66350b8d0: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.224227 11291 consensus_queue.cc:260] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.224530 11291 ts_tablet_manager.cc:1398] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:02.224774 11291 tablet_bootstrap.cc:492] T 619a326e88e14afab664fdd75e049ddd P 1acde06f8a9b403695365a61c41ab905: Bootstrap starting.
I20240502 01:58:02.225634 11291 tablet_bootstrap.cc:654] T 619a326e88e14afab664fdd75e049ddd P 1acde06f8a9b403695365a61c41ab905: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.226819 11292 tablet_bootstrap.cc:492] T b7354329657c446ca93a760b45286859 P a10d08940e88404aa65d42eff8c0fce8: No bootstrap required, opened a new log
I20240502 01:58:02.226960 11292 ts_tablet_manager.cc:1367] T b7354329657c446ca93a760b45286859 P a10d08940e88404aa65d42eff8c0fce8: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20240502 01:58:02.227205 10962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7354329657c446ca93a760b45286859" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0" is_pre_election: true
I20240502 01:58:02.227234 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eb4a838865b4ef68984481d70518380" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0" is_pre_election: true
I20240502 01:58:02.227459 11292 raft_consensus.cc:348] T b7354329657c446ca93a760b45286859 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.227548 11292 raft_consensus.cc:374] T b7354329657c446ca93a760b45286859 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.227507 10962 raft_consensus.cc:2454] T b7354329657c446ca93a760b45286859 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 0.
I20240502 01:58:02.227509 10961 raft_consensus.cc:2454] T 5eb4a838865b4ef68984481d70518380 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 0.
I20240502 01:58:02.227583 11292 raft_consensus.cc:729] T b7354329657c446ca93a760b45286859 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10d08940e88404aa65d42eff8c0fce8, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.227684 11292 consensus_queue.cc:260] T b7354329657c446ca93a760b45286859 P a10d08940e88404aa65d42eff8c0fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.227936 11292 ts_tablet_manager.cc:1398] T b7354329657c446ca93a760b45286859 P a10d08940e88404aa65d42eff8c0fce8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:02.228015 11160 leader_election.cc:302] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, 951c7a4ceb3945818592a3e66350b8d0; no voters:
I20240502 01:58:02.228375 11292 tablet_bootstrap.cc:492] T b5448e58213f494bbd967d92a8f986b9 P a10d08940e88404aa65d42eff8c0fce8: Bootstrap starting.
I20240502 01:58:02.228482 11291 tablet_bootstrap.cc:492] T 619a326e88e14afab664fdd75e049ddd P 1acde06f8a9b403695365a61c41ab905: No bootstrap required, opened a new log
I20240502 01:58:02.228576 11291 ts_tablet_manager.cc:1367] T 619a326e88e14afab664fdd75e049ddd P 1acde06f8a9b403695365a61c41ab905: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20240502 01:58:02.228726 11094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eb4a838865b4ef68984481d70518380" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8" is_pre_election: true
I20240502 01:58:02.228971 11094 raft_consensus.cc:2454] T 5eb4a838865b4ef68984481d70518380 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 0.
I20240502 01:58:02.228982 11291 raft_consensus.cc:348] T 619a326e88e14afab664fdd75e049ddd P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.229074 11291 raft_consensus.cc:374] T 619a326e88e14afab664fdd75e049ddd P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.229103 11291 raft_consensus.cc:729] T 619a326e88e14afab664fdd75e049ddd P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.229190 11292 tablet_bootstrap.cc:654] T b5448e58213f494bbd967d92a8f986b9 P a10d08940e88404aa65d42eff8c0fce8: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.229197 11291 consensus_queue.cc:260] T 619a326e88e14afab664fdd75e049ddd P 1acde06f8a9b403695365a61c41ab905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.229266 11093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7354329657c446ca93a760b45286859" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8" is_pre_election: true
I20240502 01:58:02.229350 11299 raft_consensus.cc:2781] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:02.229378 11093 raft_consensus.cc:2454] T b7354329657c446ca93a760b45286859 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 0.
I20240502 01:58:02.229410 11299 raft_consensus.cc:482] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:02.229439 11291 ts_tablet_manager.cc:1398] T 619a326e88e14afab664fdd75e049ddd P 1acde06f8a9b403695365a61c41ab905: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:02.229449 11299 raft_consensus.cc:3037] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.229598 11291 tablet_bootstrap.cc:492] T 71368a3e53d84be6a5c35a872b502d21 P 1acde06f8a9b403695365a61c41ab905: Bootstrap starting.
I20240502 01:58:02.229998 11326 raft_consensus.cc:482] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:02.230079 11326 raft_consensus.cc:504] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.230348 11326 leader_election.cc:288] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753), 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093)
I20240502 01:58:02.230396 11291 tablet_bootstrap.cc:654] T 71368a3e53d84be6a5c35a872b502d21 P 1acde06f8a9b403695365a61c41ab905: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.230590 11299 raft_consensus.cc:504] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.230923 11299 leader_election.cc:288] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 election: Requested vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753)
I20240502 01:58:02.231056 11296 raft_consensus.cc:482] T b1947fc743d14c4fae1497a2bd3c792c P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:02.231104 11160 leader_election.cc:302] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, a10d08940e88404aa65d42eff8c0fce8; no voters:
I20240502 01:58:02.231138 11296 raft_consensus.cc:504] T b1947fc743d14c4fae1497a2bd3c792c P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.231570 11290 tablet_bootstrap.cc:492] T 278a862211994821b286e97ab507b24e P 951c7a4ceb3945818592a3e66350b8d0: No bootstrap required, opened a new log
I20240502 01:58:02.231647 11290 ts_tablet_manager.cc:1367] T 278a862211994821b286e97ab507b24e P 951c7a4ceb3945818592a3e66350b8d0: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20240502 01:58:02.231720 11291 tablet_bootstrap.cc:492] T 71368a3e53d84be6a5c35a872b502d21 P 1acde06f8a9b403695365a61c41ab905: No bootstrap required, opened a new log
I20240502 01:58:02.231789 11291 ts_tablet_manager.cc:1367] T 71368a3e53d84be6a5c35a872b502d21 P 1acde06f8a9b403695365a61c41ab905: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240502 01:58:02.231760 11093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43d8bb63caa47d68e7193c54c8263d4" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8" is_pre_election: true
I20240502 01:58:02.232059 11290 raft_consensus.cc:348] T 278a862211994821b286e97ab507b24e P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.232153 11290 raft_consensus.cc:374] T 278a862211994821b286e97ab507b24e P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.232185 11290 raft_consensus.cc:729] T 278a862211994821b286e97ab507b24e P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951c7a4ceb3945818592a3e66350b8d0, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.232151 11291 raft_consensus.cc:348] T 71368a3e53d84be6a5c35a872b502d21 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.232236 11291 raft_consensus.cc:374] T 71368a3e53d84be6a5c35a872b502d21 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.232271 11291 raft_consensus.cc:729] T 71368a3e53d84be6a5c35a872b502d21 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.232343 11296 leader_election.cc:288] T b1947fc743d14c4fae1497a2bd3c792c P a10d08940e88404aa65d42eff8c0fce8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), 1acde06f8a9b403695365a61c41ab905 (127.10.133.195:44473)
I20240502 01:58:02.232306 11290 consensus_queue.cc:260] T 278a862211994821b286e97ab507b24e P 951c7a4ceb3945818592a3e66350b8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.232374 11291 consensus_queue.cc:260] T 71368a3e53d84be6a5c35a872b502d21 P 1acde06f8a9b403695365a61c41ab905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.232434 11297 raft_consensus.cc:482] T 695664285e004216ad89b4a786b6387d P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:02.232533 11297 raft_consensus.cc:504] T 695664285e004216ad89b4a786b6387d P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } }
I20240502 01:58:02.232653 11291 ts_tablet_manager.cc:1398] T 71368a3e53d84be6a5c35a872b502d21 P 1acde06f8a9b403695365a61c41ab905: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:02.232683 11290 ts_tablet_manager.cc:1398] T 278a862211994821b286e97ab507b24e P 951c7a4ceb3945818592a3e66350b8d0: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:02.232790 11291 tablet_bootstrap.cc:492] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905: Bootstrap starting.
I20240502 01:58:02.232828 11290 tablet_bootstrap.cc:492] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0: Bootstrap starting.
I20240502 01:58:02.233520 11297 leader_election.cc:288] T 695664285e004216ad89b4a786b6387d P 951c7a4ceb3945818592a3e66350b8d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1acde06f8a9b403695365a61c41ab905 (127.10.133.195:44473), a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753)
I20240502 01:58:02.233644 11290 tablet_bootstrap.cc:654] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.233709 11291 tablet_bootstrap.cc:654] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.233482 11324 raft_consensus.cc:2781] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:02.233831 11324 raft_consensus.cc:482] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:02.233884 11324 raft_consensus.cc:3037] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.234911 11291 tablet_bootstrap.cc:492] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905: No bootstrap required, opened a new log
I20240502 01:58:02.235002 11291 ts_tablet_manager.cc:1367] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240502 01:58:02.235401 11291 raft_consensus.cc:348] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.235498 11291 raft_consensus.cc:374] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.235535 11291 raft_consensus.cc:729] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.235630 11291 consensus_queue.cc:260] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.235811 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eb4a838865b4ef68984481d70518380" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0"
I20240502 01:58:02.235877 11291 ts_tablet_manager.cc:1398] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:02.235914 10961 raft_consensus.cc:3037] T 5eb4a838865b4ef68984481d70518380 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.236024 11291 tablet_bootstrap.cc:492] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905: Bootstrap starting.
I20240502 01:58:02.236721 11292 tablet_bootstrap.cc:492] T b5448e58213f494bbd967d92a8f986b9 P a10d08940e88404aa65d42eff8c0fce8: No bootstrap required, opened a new log
I20240502 01:58:02.236800 11292 ts_tablet_manager.cc:1367] T b5448e58213f494bbd967d92a8f986b9 P a10d08940e88404aa65d42eff8c0fce8: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20240502 01:58:02.236904 11291 tablet_bootstrap.cc:654] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.236891 10961 raft_consensus.cc:2454] T 5eb4a838865b4ef68984481d70518380 P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 1.
I20240502 01:58:02.237282 10962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43d8bb63caa47d68e7193c54c8263d4" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0" is_pre_election: true
I20240502 01:58:02.237210 11292 raft_consensus.cc:348] T b5448e58213f494bbd967d92a8f986b9 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.237354 11292 raft_consensus.cc:374] T b5448e58213f494bbd967d92a8f986b9 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.237407 10962 raft_consensus.cc:2454] T f43d8bb63caa47d68e7193c54c8263d4 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 0.
I20240502 01:58:02.237411 11292 raft_consensus.cc:729] T b5448e58213f494bbd967d92a8f986b9 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10d08940e88404aa65d42eff8c0fce8, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.234912 11324 raft_consensus.cc:504] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.237560 11292 consensus_queue.cc:260] T b5448e58213f494bbd967d92a8f986b9 P a10d08940e88404aa65d42eff8c0fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.237193 11093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eb4a838865b4ef68984481d70518380" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8"
I20240502 01:58:02.237738 11324 leader_election.cc:288] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 election: Requested vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753)
I20240502 01:58:02.237726 11093 raft_consensus.cc:3037] T 5eb4a838865b4ef68984481d70518380 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.237895 11292 ts_tablet_manager.cc:1398] T b5448e58213f494bbd967d92a8f986b9 P a10d08940e88404aa65d42eff8c0fce8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:02.238061 11292 tablet_bootstrap.cc:492] T 695664285e004216ad89b4a786b6387d P a10d08940e88404aa65d42eff8c0fce8: Bootstrap starting.
I20240502 01:58:02.238792 11093 raft_consensus.cc:2454] T 5eb4a838865b4ef68984481d70518380 P a10d08940e88404aa65d42eff8c0fce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 1.
I20240502 01:58:02.239153 11292 tablet_bootstrap.cc:654] T 695664285e004216ad89b4a786b6387d P a10d08940e88404aa65d42eff8c0fce8: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.239599 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "695664285e004216ad89b4a786b6387d" candidate_uuid: "951c7a4ceb3945818592a3e66350b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1acde06f8a9b403695365a61c41ab905" is_pre_election: true
W20240502 01:58:02.240233 10896 leader_election.cc:341] T 695664285e004216ad89b4a786b6387d P 951c7a4ceb3945818592a3e66350b8d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1acde06f8a9b403695365a61c41ab905 (127.10.133.195:44473): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:58:02.241803 10962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1947fc743d14c4fae1497a2bd3c792c" candidate_uuid: "a10d08940e88404aa65d42eff8c0fce8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0" is_pre_election: true
W20240502 01:58:02.242326 11028 leader_election.cc:341] T b1947fc743d14c4fae1497a2bd3c792c P a10d08940e88404aa65d42eff8c0fce8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:58:02.242502 11093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "695664285e004216ad89b4a786b6387d" candidate_uuid: "951c7a4ceb3945818592a3e66350b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8" is_pre_election: true
I20240502 01:58:02.242652 11160 leader_election.cc:302] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, 951c7a4ceb3945818592a3e66350b8d0; no voters:
I20240502 01:58:02.242830 11299 raft_consensus.cc:2781] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:02.242830 11160 leader_election.cc:302] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, 951c7a4ceb3945818592a3e66350b8d0; no voters:
I20240502 01:58:02.242990 11299 raft_consensus.cc:686] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905 [term 1 LEADER]: Becoming Leader. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Running, Role: LEADER
I20240502 01:58:02.243032 11094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7354329657c446ca93a760b45286859" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8"
I20240502 01:58:02.243113 11094 raft_consensus.cc:3037] T b7354329657c446ca93a760b45286859 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Advancing to term 1
W20240502 01:58:02.243114 11160 leader_election.cc:341] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:58:02.243296 11299 consensus_queue.cc:237] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.243476 11324 raft_consensus.cc:2781] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:02.243525 11324 raft_consensus.cc:482] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:02.243548 11324 raft_consensus.cc:3037] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.244009 11094 raft_consensus.cc:2454] T b7354329657c446ca93a760b45286859 P a10d08940e88404aa65d42eff8c0fce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 1.
W20240502 01:58:02.244252 10895 leader_election.cc:341] T 695664285e004216ad89b4a786b6387d P 951c7a4ceb3945818592a3e66350b8d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:58:02.244282 11324 raft_consensus.cc:504] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.244320 10895 leader_election.cc:302] T 695664285e004216ad89b4a786b6387d P 951c7a4ceb3945818592a3e66350b8d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 951c7a4ceb3945818592a3e66350b8d0; no voters: 1acde06f8a9b403695365a61c41ab905, a10d08940e88404aa65d42eff8c0fce8
I20240502 01:58:02.244342 11160 leader_election.cc:302] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, a10d08940e88404aa65d42eff8c0fce8; no voters:
I20240502 01:58:02.244508 11297 raft_consensus.cc:2726] T 695664285e004216ad89b4a786b6387d P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:58:02.244613 11324 leader_election.cc:288] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 election: Requested vote from peers a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753), 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093)
I20240502 01:58:02.244706 11324 raft_consensus.cc:2781] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:02.244767 11324 raft_consensus.cc:686] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905 [term 1 LEADER]: Becoming Leader. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Running, Role: LEADER
I20240502 01:58:02.244871 11324 consensus_queue.cc:237] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.245005 10962 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7354329657c446ca93a760b45286859" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0"
I20240502 01:58:02.245107 10962 raft_consensus.cc:3037] T b7354329657c446ca93a760b45286859 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.245710 11094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43d8bb63caa47d68e7193c54c8263d4" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8"
W20240502 01:58:02.246030 11160 leader_election.cc:341] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:58:02.246095 10962 raft_consensus.cc:2454] T b7354329657c446ca93a760b45286859 P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 1.
I20240502 01:58:02.246562 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43d8bb63caa47d68e7193c54c8263d4" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0"
I20240502 01:58:02.246659 10961 raft_consensus.cc:3037] T f43d8bb63caa47d68e7193c54c8263d4 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.247092 10817 catalog_manager.cc:5484] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1acde06f8a9b403695365a61c41ab905 (127.10.133.195). New cstate: current_term: 1 leader_uuid: "1acde06f8a9b403695365a61c41ab905" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } health_report { overall_health: HEALTHY } } }
I20240502 01:58:02.247421 10961 raft_consensus.cc:2454] T f43d8bb63caa47d68e7193c54c8263d4 P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 1.
I20240502 01:58:02.247681 11291 tablet_bootstrap.cc:492] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905: No bootstrap required, opened a new log
I20240502 01:58:02.247696 11160 leader_election.cc:302] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, 951c7a4ceb3945818592a3e66350b8d0; no voters: a10d08940e88404aa65d42eff8c0fce8
I20240502 01:58:02.247781 11291 ts_tablet_manager.cc:1367] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.001s
I20240502 01:58:02.247926 11324 raft_consensus.cc:2781] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:02.248009 11324 raft_consensus.cc:686] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [term 1 LEADER]: Becoming Leader. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Running, Role: LEADER
I20240502 01:58:02.248102 11324 consensus_queue.cc:237] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.248184 11291 raft_consensus.cc:348] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } }
I20240502 01:58:02.248265 11291 raft_consensus.cc:374] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.248291 11291 raft_consensus.cc:729] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.248399 11291 consensus_queue.cc:260] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } }
I20240502 01:58:02.248651 11291 ts_tablet_manager.cc:1398] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:02.248795 11291 tablet_bootstrap.cc:492] T b5448e58213f494bbd967d92a8f986b9 P 1acde06f8a9b403695365a61c41ab905: Bootstrap starting.
I20240502 01:58:02.249634 11291 tablet_bootstrap.cc:654] T b5448e58213f494bbd967d92a8f986b9 P 1acde06f8a9b403695365a61c41ab905: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.250540 11292 tablet_bootstrap.cc:492] T 695664285e004216ad89b4a786b6387d P a10d08940e88404aa65d42eff8c0fce8: No bootstrap required, opened a new log
I20240502 01:58:02.250625 11292 ts_tablet_manager.cc:1367] T 695664285e004216ad89b4a786b6387d P a10d08940e88404aa65d42eff8c0fce8: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20240502 01:58:02.250993 11292 raft_consensus.cc:348] T 695664285e004216ad89b4a786b6387d P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } }
I20240502 01:58:02.251073 11292 raft_consensus.cc:374] T 695664285e004216ad89b4a786b6387d P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.251106 11292 raft_consensus.cc:729] T 695664285e004216ad89b4a786b6387d P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10d08940e88404aa65d42eff8c0fce8, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.251225 11292 consensus_queue.cc:260] T 695664285e004216ad89b4a786b6387d P a10d08940e88404aa65d42eff8c0fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } }
W20240502 01:58:02.251295 11009 tablet.cc:2369] T 278a862211994821b286e97ab507b24e P 951c7a4ceb3945818592a3e66350b8d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 01:58:02.251516 11292 ts_tablet_manager.cc:1398] T 695664285e004216ad89b4a786b6387d P a10d08940e88404aa65d42eff8c0fce8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:02.251659 11292 tablet_bootstrap.cc:492] T f43d8bb63caa47d68e7193c54c8263d4 P a10d08940e88404aa65d42eff8c0fce8: Bootstrap starting.
I20240502 01:58:02.252388 11292 tablet_bootstrap.cc:654] T f43d8bb63caa47d68e7193c54c8263d4 P a10d08940e88404aa65d42eff8c0fce8: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.252576 11291 tablet_bootstrap.cc:492] T b5448e58213f494bbd967d92a8f986b9 P 1acde06f8a9b403695365a61c41ab905: No bootstrap required, opened a new log
I20240502 01:58:02.252665 11291 ts_tablet_manager.cc:1367] T b5448e58213f494bbd967d92a8f986b9 P 1acde06f8a9b403695365a61c41ab905: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20240502 01:58:02.252992 11290 tablet_bootstrap.cc:492] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0: No bootstrap required, opened a new log
I20240502 01:58:02.253086 11290 ts_tablet_manager.cc:1367] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.001s
I20240502 01:58:02.253067 11291 raft_consensus.cc:348] T b5448e58213f494bbd967d92a8f986b9 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.253190 11291 raft_consensus.cc:374] T b5448e58213f494bbd967d92a8f986b9 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.253232 11291 raft_consensus.cc:729] T b5448e58213f494bbd967d92a8f986b9 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.253099 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1947fc743d14c4fae1497a2bd3c792c" candidate_uuid: "a10d08940e88404aa65d42eff8c0fce8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1acde06f8a9b403695365a61c41ab905" is_pre_election: true
I20240502 01:58:02.253363 11291 consensus_queue.cc:260] T b5448e58213f494bbd967d92a8f986b9 P 1acde06f8a9b403695365a61c41ab905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.253572 11290 raft_consensus.cc:348] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.253649 11291 ts_tablet_manager.cc:1398] T b5448e58213f494bbd967d92a8f986b9 P 1acde06f8a9b403695365a61c41ab905: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
W20240502 01:58:02.253669 11029 leader_election.cc:341] T b1947fc743d14c4fae1497a2bd3c792c P a10d08940e88404aa65d42eff8c0fce8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1acde06f8a9b403695365a61c41ab905 (127.10.133.195:44473): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:58:02.253688 11290 raft_consensus.cc:374] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.253721 11290 raft_consensus.cc:729] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951c7a4ceb3945818592a3e66350b8d0, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.253728 11029 leader_election.cc:302] T b1947fc743d14c4fae1497a2bd3c792c P a10d08940e88404aa65d42eff8c0fce8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a10d08940e88404aa65d42eff8c0fce8; no voters: 1acde06f8a9b403695365a61c41ab905, 951c7a4ceb3945818592a3e66350b8d0
I20240502 01:58:02.253816 11291 tablet_bootstrap.cc:492] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905: Bootstrap starting.
I20240502 01:58:02.253844 11290 consensus_queue.cc:260] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.253911 11296 raft_consensus.cc:2726] T b1947fc743d14c4fae1497a2bd3c792c P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:58:02.254130 11290 ts_tablet_manager.cc:1398] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:02.254261 11299 raft_consensus.cc:482] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:02.254307 11290 tablet_bootstrap.cc:492] T 7f91469e0fe244b69d27c7245a8f064f P 951c7a4ceb3945818592a3e66350b8d0: Bootstrap starting.
I20240502 01:58:02.254330 11299 raft_consensus.cc:504] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.254703 11299 leader_election.cc:288] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753), 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093)
I20240502 01:58:02.254709 11291 tablet_bootstrap.cc:654] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.254997 11297 raft_consensus.cc:482] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:02.255065 11297 raft_consensus.cc:504] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.255347 11290 tablet_bootstrap.cc:654] T 7f91469e0fe244b69d27c7245a8f064f P 951c7a4ceb3945818592a3e66350b8d0: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.255424 11297 leader_election.cc:288] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753), 1acde06f8a9b403695365a61c41ab905 (127.10.133.195:44473)
I20240502 01:58:02.255936 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5448e58213f494bbd967d92a8f986b9" candidate_uuid: "951c7a4ceb3945818592a3e66350b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1acde06f8a9b403695365a61c41ab905" is_pre_election: true
I20240502 01:58:02.253556 11335 raft_consensus.cc:482] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:02.256064 11225 raft_consensus.cc:2454] T b5448e58213f494bbd967d92a8f986b9 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 951c7a4ceb3945818592a3e66350b8d0 in term 0.
I20240502 01:58:02.256104 11335 raft_consensus.cc:504] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.254873 10817 catalog_manager.cc:5484] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1acde06f8a9b403695365a61c41ab905 (127.10.133.195). New cstate: current_term: 1 leader_uuid: "1acde06f8a9b403695365a61c41ab905" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } health_report { overall_health: HEALTHY } } }
I20240502 01:58:02.256335 10817 catalog_manager.cc:5484] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1acde06f8a9b403695365a61c41ab905 (127.10.133.195). New cstate: current_term: 1 leader_uuid: "1acde06f8a9b403695365a61c41ab905" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } health_report { overall_health: HEALTHY } } }
I20240502 01:58:02.256435 11335 leader_election.cc:288] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753), 1acde06f8a9b403695365a61c41ab905 (127.10.133.195:44473)
I20240502 01:58:02.256467 10896 leader_election.cc:302] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, 951c7a4ceb3945818592a3e66350b8d0; no voters:
I20240502 01:58:02.256772 11093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71368a3e53d84be6a5c35a872b502d21" candidate_uuid: "951c7a4ceb3945818592a3e66350b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8" is_pre_election: true
I20240502 01:58:02.256870 11093 raft_consensus.cc:2454] T 71368a3e53d84be6a5c35a872b502d21 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 951c7a4ceb3945818592a3e66350b8d0 in term 0.
I20240502 01:58:02.256896 11292 tablet_bootstrap.cc:492] T f43d8bb63caa47d68e7193c54c8263d4 P a10d08940e88404aa65d42eff8c0fce8: No bootstrap required, opened a new log
I20240502 01:58:02.256954 11292 ts_tablet_manager.cc:1367] T f43d8bb63caa47d68e7193c54c8263d4 P a10d08940e88404aa65d42eff8c0fce8: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20240502 01:58:02.257130 10895 leader_election.cc:302] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 951c7a4ceb3945818592a3e66350b8d0, a10d08940e88404aa65d42eff8c0fce8; no voters:
I20240502 01:58:02.257300 11297 raft_consensus.cc:2781] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:02.257351 11297 raft_consensus.cc:482] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:02.257385 11297 raft_consensus.cc:3037] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.257364 11292 raft_consensus.cc:348] T f43d8bb63caa47d68e7193c54c8263d4 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.257407 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71368a3e53d84be6a5c35a872b502d21" candidate_uuid: "951c7a4ceb3945818592a3e66350b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1acde06f8a9b403695365a61c41ab905" is_pre_election: true
I20240502 01:58:02.257454 11292 raft_consensus.cc:374] T f43d8bb63caa47d68e7193c54c8263d4 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.257483 11292 raft_consensus.cc:729] T f43d8bb63caa47d68e7193c54c8263d4 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10d08940e88404aa65d42eff8c0fce8, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.257494 11225 raft_consensus.cc:2454] T 71368a3e53d84be6a5c35a872b502d21 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 951c7a4ceb3945818592a3e66350b8d0 in term 0.
I20240502 01:58:02.257593 11292 consensus_queue.cc:260] T f43d8bb63caa47d68e7193c54c8263d4 P a10d08940e88404aa65d42eff8c0fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.257788 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "291a8288505146f2bbefae74ba06b06a" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0" is_pre_election: true
I20240502 01:58:02.257870 11292 ts_tablet_manager.cc:1398] T f43d8bb63caa47d68e7193c54c8263d4 P a10d08940e88404aa65d42eff8c0fce8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:02.257885 10961 raft_consensus.cc:2454] T 291a8288505146f2bbefae74ba06b06a P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 0.
I20240502 01:58:02.258051 11292 tablet_bootstrap.cc:492] T c1c75d212ed94340a46b3fc6d509ff03 P a10d08940e88404aa65d42eff8c0fce8: Bootstrap starting.
I20240502 01:58:02.258272 11160 leader_election.cc:302] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, 951c7a4ceb3945818592a3e66350b8d0; no voters:
I20240502 01:58:02.258381 11297 raft_consensus.cc:504] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.258437 11299 raft_consensus.cc:2781] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:02.258476 11299 raft_consensus.cc:482] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:02.258551 11299 raft_consensus.cc:3037] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.258630 11093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "291a8288505146f2bbefae74ba06b06a" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8" is_pre_election: true
I20240502 01:58:02.258888 11093 raft_consensus.cc:2454] T 291a8288505146f2bbefae74ba06b06a P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 0.
I20240502 01:58:02.258963 11297 leader_election.cc:288] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0 [CANDIDATE]: Term 1 election: Requested vote from peers a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753), 1acde06f8a9b403695365a61c41ab905 (127.10.133.195:44473)
I20240502 01:58:02.259089 11297 raft_consensus.cc:2781] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:02.259160 11297 raft_consensus.cc:482] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:02.259232 11297 raft_consensus.cc:3037] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.259356 11292 tablet_bootstrap.cc:654] T c1c75d212ed94340a46b3fc6d509ff03 P a10d08940e88404aa65d42eff8c0fce8: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.259842 11299 raft_consensus.cc:504] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.260078 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5448e58213f494bbd967d92a8f986b9" candidate_uuid: "951c7a4ceb3945818592a3e66350b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1acde06f8a9b403695365a61c41ab905"
I20240502 01:58:02.260080 11297 raft_consensus.cc:504] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.260169 11299 leader_election.cc:288] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 election: Requested vote from peers a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753), 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093)
I20240502 01:58:02.260179 11225 raft_consensus.cc:3037] T b5448e58213f494bbd967d92a8f986b9 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.260398 11297 leader_election.cc:288] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0 [CANDIDATE]: Term 1 election: Requested vote from peers a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753), 1acde06f8a9b403695365a61c41ab905 (127.10.133.195:44473)
I20240502 01:58:02.260692 11094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5448e58213f494bbd967d92a8f986b9" candidate_uuid: "951c7a4ceb3945818592a3e66350b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8" is_pre_election: true
I20240502 01:58:02.260811 11094 raft_consensus.cc:2454] T b5448e58213f494bbd967d92a8f986b9 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 951c7a4ceb3945818592a3e66350b8d0 in term 0.
I20240502 01:58:02.260824 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "291a8288505146f2bbefae74ba06b06a" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0"
I20240502 01:58:02.260906 10961 raft_consensus.cc:3037] T 291a8288505146f2bbefae74ba06b06a P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.261212 11225 raft_consensus.cc:2454] T b5448e58213f494bbd967d92a8f986b9 P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 951c7a4ceb3945818592a3e66350b8d0 in term 1.
I20240502 01:58:02.261538 10961 raft_consensus.cc:2454] T 291a8288505146f2bbefae74ba06b06a P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 1.
I20240502 01:58:02.261586 10896 leader_election.cc:302] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, 951c7a4ceb3945818592a3e66350b8d0; no voters:
I20240502 01:58:02.261756 11297 raft_consensus.cc:2781] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:02.261741 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71368a3e53d84be6a5c35a872b502d21" candidate_uuid: "951c7a4ceb3945818592a3e66350b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1acde06f8a9b403695365a61c41ab905"
I20240502 01:58:02.261831 11225 raft_consensus.cc:3037] T 71368a3e53d84be6a5c35a872b502d21 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.261871 11297 raft_consensus.cc:686] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0 [term 1 LEADER]: Becoming Leader. State: Replica: 951c7a4ceb3945818592a3e66350b8d0, State: Running, Role: LEADER
I20240502 01:58:02.261912 11160 leader_election.cc:302] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, 951c7a4ceb3945818592a3e66350b8d0; no voters:
I20240502 01:58:02.262079 11299 raft_consensus.cc:2781] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:02.262147 11299 raft_consensus.cc:686] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905 [term 1 LEADER]: Becoming Leader. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Running, Role: LEADER
I20240502 01:58:02.262224 11092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "291a8288505146f2bbefae74ba06b06a" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8"
I20240502 01:58:02.262221 11297 consensus_queue.cc:237] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.262248 11299 consensus_queue.cc:237] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.262322 11092 raft_consensus.cc:3037] T 291a8288505146f2bbefae74ba06b06a P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.262656 11225 raft_consensus.cc:2454] T 71368a3e53d84be6a5c35a872b502d21 P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 951c7a4ceb3945818592a3e66350b8d0 in term 1.
I20240502 01:58:02.263260 11092 raft_consensus.cc:2454] T 291a8288505146f2bbefae74ba06b06a P a10d08940e88404aa65d42eff8c0fce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 1.
I20240502 01:58:02.263613 11291 tablet_bootstrap.cc:492] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905: No bootstrap required, opened a new log
I20240502 01:58:02.263693 11291 ts_tablet_manager.cc:1367] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20240502 01:58:02.263790 11093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "71368a3e53d84be6a5c35a872b502d21" candidate_uuid: "951c7a4ceb3945818592a3e66350b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8"
I20240502 01:58:02.263901 11093 raft_consensus.cc:3037] T 71368a3e53d84be6a5c35a872b502d21 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.264101 11291 raft_consensus.cc:348] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.264206 11291 raft_consensus.cc:374] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.264240 11291 raft_consensus.cc:729] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.264348 11291 consensus_queue.cc:260] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.264605 11093 raft_consensus.cc:2454] T 71368a3e53d84be6a5c35a872b502d21 P a10d08940e88404aa65d42eff8c0fce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 951c7a4ceb3945818592a3e66350b8d0 in term 1.
I20240502 01:58:02.264658 11291 ts_tablet_manager.cc:1398] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:02.264811 11291 tablet_bootstrap.cc:492] T b1947fc743d14c4fae1497a2bd3c792c P 1acde06f8a9b403695365a61c41ab905: Bootstrap starting.
I20240502 01:58:02.265379 10896 leader_election.cc:302] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, 951c7a4ceb3945818592a3e66350b8d0; no voters:
I20240502 01:58:02.265581 11291 tablet_bootstrap.cc:654] T b1947fc743d14c4fae1497a2bd3c792c P 1acde06f8a9b403695365a61c41ab905: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.265726 11335 raft_consensus.cc:2781] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:02.265861 11335 raft_consensus.cc:686] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0 [term 1 LEADER]: Becoming Leader. State: Replica: 951c7a4ceb3945818592a3e66350b8d0, State: Running, Role: LEADER
I20240502 01:58:02.266134 11094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5448e58213f494bbd967d92a8f986b9" candidate_uuid: "951c7a4ceb3945818592a3e66350b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8"
I20240502 01:58:02.266100 11335 consensus_queue.cc:237] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.266220 11094 raft_consensus.cc:3037] T b5448e58213f494bbd967d92a8f986b9 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.266420 10818 catalog_manager.cc:5484] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193). New cstate: current_term: 1 leader_uuid: "951c7a4ceb3945818592a3e66350b8d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:02.267038 11094 raft_consensus.cc:2454] T b5448e58213f494bbd967d92a8f986b9 P a10d08940e88404aa65d42eff8c0fce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 951c7a4ceb3945818592a3e66350b8d0 in term 1.
I20240502 01:58:02.267287 11290 tablet_bootstrap.cc:492] T 7f91469e0fe244b69d27c7245a8f064f P 951c7a4ceb3945818592a3e66350b8d0: No bootstrap required, opened a new log
I20240502 01:58:02.267365 11290 ts_tablet_manager.cc:1367] T 7f91469e0fe244b69d27c7245a8f064f P 951c7a4ceb3945818592a3e66350b8d0: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20240502 01:58:02.267818 11290 raft_consensus.cc:348] T 7f91469e0fe244b69d27c7245a8f064f P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.267932 11290 raft_consensus.cc:374] T 7f91469e0fe244b69d27c7245a8f064f P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.267968 11290 raft_consensus.cc:729] T 7f91469e0fe244b69d27c7245a8f064f P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951c7a4ceb3945818592a3e66350b8d0, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.268078 11290 consensus_queue.cc:260] T 7f91469e0fe244b69d27c7245a8f064f P 951c7a4ceb3945818592a3e66350b8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.268389 11290 ts_tablet_manager.cc:1398] T 7f91469e0fe244b69d27c7245a8f064f P 951c7a4ceb3945818592a3e66350b8d0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:02.268569 11290 tablet_bootstrap.cc:492] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0: Bootstrap starting.
I20240502 01:58:02.268923 11292 tablet_bootstrap.cc:492] T c1c75d212ed94340a46b3fc6d509ff03 P a10d08940e88404aa65d42eff8c0fce8: No bootstrap required, opened a new log
I20240502 01:58:02.269006 11292 ts_tablet_manager.cc:1367] T c1c75d212ed94340a46b3fc6d509ff03 P a10d08940e88404aa65d42eff8c0fce8: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20240502 01:58:02.269356 11292 raft_consensus.cc:348] T c1c75d212ed94340a46b3fc6d509ff03 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.269431 11292 raft_consensus.cc:374] T c1c75d212ed94340a46b3fc6d509ff03 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.269462 11292 raft_consensus.cc:729] T c1c75d212ed94340a46b3fc6d509ff03 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10d08940e88404aa65d42eff8c0fce8, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.269593 11292 consensus_queue.cc:260] T c1c75d212ed94340a46b3fc6d509ff03 P a10d08940e88404aa65d42eff8c0fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.269631 11290 tablet_bootstrap.cc:654] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.269906 11292 ts_tablet_manager.cc:1398] T c1c75d212ed94340a46b3fc6d509ff03 P a10d08940e88404aa65d42eff8c0fce8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:02.270081 11292 tablet_bootstrap.cc:492] T 8333a34264964548a99bd736c94dadd2 P a10d08940e88404aa65d42eff8c0fce8: Bootstrap starting.
I20240502 01:58:02.271026 11292 tablet_bootstrap.cc:654] T 8333a34264964548a99bd736c94dadd2 P a10d08940e88404aa65d42eff8c0fce8: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.271787 10817 catalog_manager.cc:5484] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1acde06f8a9b403695365a61c41ab905 (127.10.133.195). New cstate: current_term: 1 leader_uuid: "1acde06f8a9b403695365a61c41ab905" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } health_report { overall_health: HEALTHY } } }
I20240502 01:58:02.270810 11290 tablet_bootstrap.cc:492] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0: No bootstrap required, opened a new log
I20240502 01:58:02.272400 11290 ts_tablet_manager.cc:1367] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20240502 01:58:02.273097 11291 tablet_bootstrap.cc:492] T b1947fc743d14c4fae1497a2bd3c792c P 1acde06f8a9b403695365a61c41ab905: No bootstrap required, opened a new log
I20240502 01:58:02.273272 11292 tablet_bootstrap.cc:492] T 8333a34264964548a99bd736c94dadd2 P a10d08940e88404aa65d42eff8c0fce8: No bootstrap required, opened a new log
I20240502 01:58:02.273250 11291 ts_tablet_manager.cc:1367] T b1947fc743d14c4fae1497a2bd3c792c P 1acde06f8a9b403695365a61c41ab905: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20240502 01:58:02.273401 11292 ts_tablet_manager.cc:1367] T 8333a34264964548a99bd736c94dadd2 P a10d08940e88404aa65d42eff8c0fce8: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:02.273934 11292 raft_consensus.cc:348] T 8333a34264964548a99bd736c94dadd2 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.274155 11292 raft_consensus.cc:374] T 8333a34264964548a99bd736c94dadd2 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.274251 11292 raft_consensus.cc:729] T 8333a34264964548a99bd736c94dadd2 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10d08940e88404aa65d42eff8c0fce8, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.274412 11292 consensus_queue.cc:260] T 8333a34264964548a99bd736c94dadd2 P a10d08940e88404aa65d42eff8c0fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.272817 11290 raft_consensus.cc:348] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.274652 11290 raft_consensus.cc:374] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.274703 11290 raft_consensus.cc:729] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951c7a4ceb3945818592a3e66350b8d0, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.274825 11290 consensus_queue.cc:260] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.274468 11291 raft_consensus.cc:348] T b1947fc743d14c4fae1497a2bd3c792c P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.275106 11292 ts_tablet_manager.cc:1398] T 8333a34264964548a99bd736c94dadd2 P a10d08940e88404aa65d42eff8c0fce8: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:02.275138 11290 ts_tablet_manager.cc:1398] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20240502 01:58:02.275053 11291 raft_consensus.cc:374] T b1947fc743d14c4fae1497a2bd3c792c P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.275295 11290 tablet_bootstrap.cc:492] T 8635b3048c3d406d9f5a79b9a827930d P 951c7a4ceb3945818592a3e66350b8d0: Bootstrap starting.
I20240502 01:58:02.274986 10816 catalog_manager.cc:5484] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193). New cstate: current_term: 1 leader_uuid: "951c7a4ceb3945818592a3e66350b8d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:02.275398 11292 tablet_bootstrap.cc:492] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8: Bootstrap starting.
I20240502 01:58:02.275231 11291 raft_consensus.cc:729] T b1947fc743d14c4fae1497a2bd3c792c P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.276055 11291 consensus_queue.cc:260] T b1947fc743d14c4fae1497a2bd3c792c P 1acde06f8a9b403695365a61c41ab905 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.276268 11290 tablet_bootstrap.cc:654] T 8635b3048c3d406d9f5a79b9a827930d P 951c7a4ceb3945818592a3e66350b8d0: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.276268 11292 tablet_bootstrap.cc:654] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:02.276594 11291 ts_tablet_manager.cc:1398] T b1947fc743d14c4fae1497a2bd3c792c P 1acde06f8a9b403695365a61c41ab905: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:58:02.278381 11290 tablet_bootstrap.cc:492] T 8635b3048c3d406d9f5a79b9a827930d P 951c7a4ceb3945818592a3e66350b8d0: No bootstrap required, opened a new log
I20240502 01:58:02.278465 11290 ts_tablet_manager.cc:1367] T 8635b3048c3d406d9f5a79b9a827930d P 951c7a4ceb3945818592a3e66350b8d0: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240502 01:58:02.278867 11290 raft_consensus.cc:348] T 8635b3048c3d406d9f5a79b9a827930d P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.278982 11290 raft_consensus.cc:374] T 8635b3048c3d406d9f5a79b9a827930d P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.279018 11290 raft_consensus.cc:729] T 8635b3048c3d406d9f5a79b9a827930d P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951c7a4ceb3945818592a3e66350b8d0, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.279127 11290 consensus_queue.cc:260] T 8635b3048c3d406d9f5a79b9a827930d P 951c7a4ceb3945818592a3e66350b8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.279407 11290 ts_tablet_manager.cc:1398] T 8635b3048c3d406d9f5a79b9a827930d P 951c7a4ceb3945818592a3e66350b8d0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:02.280000 11292 tablet_bootstrap.cc:492] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8: No bootstrap required, opened a new log
I20240502 01:58:02.280089 11292 ts_tablet_manager.cc:1367] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20240502 01:58:02.280505 11292 raft_consensus.cc:348] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.280584 11292 raft_consensus.cc:374] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:02.280617 11292 raft_consensus.cc:729] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a10d08940e88404aa65d42eff8c0fce8, State: Initialized, Role: FOLLOWER
I20240502 01:58:02.280730 11292 consensus_queue.cc:260] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.280990 11292 ts_tablet_manager.cc:1398] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:02.293181 11324 raft_consensus.cc:482] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:02.293262 11324 raft_consensus.cc:504] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.293536 11324 leader_election.cc:288] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753)
I20240502 01:58:02.293854 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1c75d212ed94340a46b3fc6d509ff03" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0" is_pre_election: true
I20240502 01:58:02.293901 11094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1c75d212ed94340a46b3fc6d509ff03" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8" is_pre_election: true
I20240502 01:58:02.293952 10961 raft_consensus.cc:2454] T c1c75d212ed94340a46b3fc6d509ff03 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 0.
I20240502 01:58:02.294056 11094 raft_consensus.cc:2454] T c1c75d212ed94340a46b3fc6d509ff03 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 0.
I20240502 01:58:02.294252 11160 leader_election.cc:302] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, 951c7a4ceb3945818592a3e66350b8d0; no voters:
I20240502 01:58:02.294394 11324 raft_consensus.cc:2781] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:02.294443 11324 raft_consensus.cc:482] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:02.294473 11324 raft_consensus.cc:3037] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.295200 11324 raft_consensus.cc:504] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.295500 11324 leader_election.cc:288] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 election: Requested vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753)
I20240502 01:58:02.295825 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1c75d212ed94340a46b3fc6d509ff03" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0"
I20240502 01:58:02.295867 11094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1c75d212ed94340a46b3fc6d509ff03" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8"
I20240502 01:58:02.295951 11094 raft_consensus.cc:3037] T c1c75d212ed94340a46b3fc6d509ff03 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.295953 10961 raft_consensus.cc:3037] T c1c75d212ed94340a46b3fc6d509ff03 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.296448 11335 raft_consensus.cc:482] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:02.296550 11335 raft_consensus.cc:504] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.296669 11094 raft_consensus.cc:2454] T c1c75d212ed94340a46b3fc6d509ff03 P a10d08940e88404aa65d42eff8c0fce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 1.
I20240502 01:58:02.296792 10961 raft_consensus.cc:2454] T c1c75d212ed94340a46b3fc6d509ff03 P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 1.
I20240502 01:58:02.296924 11335 leader_election.cc:288] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753), 1acde06f8a9b403695365a61c41ab905 (127.10.133.195:44473)
I20240502 01:58:02.297060 11160 leader_election.cc:302] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, 951c7a4ceb3945818592a3e66350b8d0; no voters:
I20240502 01:58:02.297220 11324 raft_consensus.cc:2781] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:02.297231 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8333a34264964548a99bd736c94dadd2" candidate_uuid: "951c7a4ceb3945818592a3e66350b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1acde06f8a9b403695365a61c41ab905" is_pre_election: true
I20240502 01:58:02.297329 11324 raft_consensus.cc:686] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905 [term 1 LEADER]: Becoming Leader. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Running, Role: LEADER
I20240502 01:58:02.297367 11225 raft_consensus.cc:2454] T 8333a34264964548a99bd736c94dadd2 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 951c7a4ceb3945818592a3e66350b8d0 in term 0.
I20240502 01:58:02.297444 11324 consensus_queue.cc:237] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.297569 11094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8333a34264964548a99bd736c94dadd2" candidate_uuid: "951c7a4ceb3945818592a3e66350b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8" is_pre_election: true
I20240502 01:58:02.297691 11094 raft_consensus.cc:2454] T 8333a34264964548a99bd736c94dadd2 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 951c7a4ceb3945818592a3e66350b8d0 in term 0.
I20240502 01:58:02.297751 10896 leader_election.cc:302] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, 951c7a4ceb3945818592a3e66350b8d0; no voters:
I20240502 01:58:02.298066 11335 raft_consensus.cc:2781] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:02.298126 11335 raft_consensus.cc:482] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:02.298182 11335 raft_consensus.cc:3037] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.299111 10817 catalog_manager.cc:5484] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1acde06f8a9b403695365a61c41ab905 (127.10.133.195). New cstate: current_term: 1 leader_uuid: "1acde06f8a9b403695365a61c41ab905" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } health_report { overall_health: HEALTHY } } }
I20240502 01:58:02.299278 11335 raft_consensus.cc:504] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.299594 11335 leader_election.cc:288] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0 [CANDIDATE]: Term 1 election: Requested vote from peers a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753), 1acde06f8a9b403695365a61c41ab905 (127.10.133.195:44473)
I20240502 01:58:02.299924 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8333a34264964548a99bd736c94dadd2" candidate_uuid: "951c7a4ceb3945818592a3e66350b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1acde06f8a9b403695365a61c41ab905"
I20240502 01:58:02.300014 11225 raft_consensus.cc:3037] T 8333a34264964548a99bd736c94dadd2 P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.300365 11094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8333a34264964548a99bd736c94dadd2" candidate_uuid: "951c7a4ceb3945818592a3e66350b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8"
I20240502 01:58:02.300474 11094 raft_consensus.cc:3037] T 8333a34264964548a99bd736c94dadd2 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.300778 11225 raft_consensus.cc:2454] T 8333a34264964548a99bd736c94dadd2 P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 951c7a4ceb3945818592a3e66350b8d0 in term 1.
I20240502 01:58:02.301117 10896 leader_election.cc:302] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, 951c7a4ceb3945818592a3e66350b8d0; no voters:
I20240502 01:58:02.301170 11094 raft_consensus.cc:2454] T 8333a34264964548a99bd736c94dadd2 P a10d08940e88404aa65d42eff8c0fce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 951c7a4ceb3945818592a3e66350b8d0 in term 1.
I20240502 01:58:02.301278 11335 raft_consensus.cc:2781] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:02.301359 11335 raft_consensus.cc:686] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0 [term 1 LEADER]: Becoming Leader. State: Replica: 951c7a4ceb3945818592a3e66350b8d0, State: Running, Role: LEADER
I20240502 01:58:02.301477 11335 consensus_queue.cc:237] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.302085 11296 raft_consensus.cc:482] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:02.302155 11296 raft_consensus.cc:504] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.302435 11296 leader_election.cc:288] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), 1acde06f8a9b403695365a61c41ab905 (127.10.133.195:44473)
I20240502 01:58:02.302732 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd693e8dde084bd5a2010d1d77e41c3c" candidate_uuid: "a10d08940e88404aa65d42eff8c0fce8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0" is_pre_election: true
I20240502 01:58:02.302836 10961 raft_consensus.cc:2454] T bd693e8dde084bd5a2010d1d77e41c3c P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a10d08940e88404aa65d42eff8c0fce8 in term 0.
I20240502 01:58:02.302835 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd693e8dde084bd5a2010d1d77e41c3c" candidate_uuid: "a10d08940e88404aa65d42eff8c0fce8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1acde06f8a9b403695365a61c41ab905" is_pre_election: true
I20240502 01:58:02.302949 11225 raft_consensus.cc:2454] T bd693e8dde084bd5a2010d1d77e41c3c P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a10d08940e88404aa65d42eff8c0fce8 in term 0.
I20240502 01:58:02.302937 10817 catalog_manager.cc:5484] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193). New cstate: current_term: 1 leader_uuid: "951c7a4ceb3945818592a3e66350b8d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:02.303133 11028 leader_election.cc:302] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 951c7a4ceb3945818592a3e66350b8d0, a10d08940e88404aa65d42eff8c0fce8; no voters:
I20240502 01:58:02.303310 11296 raft_consensus.cc:2781] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:02.303350 11296 raft_consensus.cc:482] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:02.303375 11296 raft_consensus.cc:3037] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.304159 11296 raft_consensus.cc:504] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.304453 11296 leader_election.cc:288] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8 [CANDIDATE]: Term 1 election: Requested vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), 1acde06f8a9b403695365a61c41ab905 (127.10.133.195:44473)
I20240502 01:58:02.304780 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd693e8dde084bd5a2010d1d77e41c3c" candidate_uuid: "a10d08940e88404aa65d42eff8c0fce8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1acde06f8a9b403695365a61c41ab905"
I20240502 01:58:02.304867 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd693e8dde084bd5a2010d1d77e41c3c" candidate_uuid: "a10d08940e88404aa65d42eff8c0fce8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0"
I20240502 01:58:02.304893 11225 raft_consensus.cc:3037] T bd693e8dde084bd5a2010d1d77e41c3c P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.304977 10961 raft_consensus.cc:3037] T bd693e8dde084bd5a2010d1d77e41c3c P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.305567 11225 raft_consensus.cc:2454] T bd693e8dde084bd5a2010d1d77e41c3c P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10d08940e88404aa65d42eff8c0fce8 in term 1.
I20240502 01:58:02.305634 10961 raft_consensus.cc:2454] T bd693e8dde084bd5a2010d1d77e41c3c P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10d08940e88404aa65d42eff8c0fce8 in term 1.
I20240502 01:58:02.305833 11029 leader_election.cc:302] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, a10d08940e88404aa65d42eff8c0fce8; no voters:
I20240502 01:58:02.306011 11296 raft_consensus.cc:2781] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:02.306236 11296 raft_consensus.cc:686] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8 [term 1 LEADER]: Becoming Leader. State: Replica: a10d08940e88404aa65d42eff8c0fce8, State: Running, Role: LEADER
I20240502 01:58:02.306545 11296 consensus_queue.cc:237] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.309096 10817 catalog_manager.cc:5484] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194). New cstate: current_term: 1 leader_uuid: "a10d08940e88404aa65d42eff8c0fce8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:02.313969 11296 raft_consensus.cc:482] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:02.314079 11296 raft_consensus.cc:504] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.314389 11296 leader_election.cc:288] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), 1acde06f8a9b403695365a61c41ab905 (127.10.133.195:44473)
I20240502 01:58:02.314677 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "278a862211994821b286e97ab507b24e" candidate_uuid: "a10d08940e88404aa65d42eff8c0fce8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0" is_pre_election: true
I20240502 01:58:02.314713 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "278a862211994821b286e97ab507b24e" candidate_uuid: "a10d08940e88404aa65d42eff8c0fce8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1acde06f8a9b403695365a61c41ab905" is_pre_election: true
I20240502 01:58:02.314788 10961 raft_consensus.cc:2454] T 278a862211994821b286e97ab507b24e P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a10d08940e88404aa65d42eff8c0fce8 in term 0.
I20240502 01:58:02.314803 11225 raft_consensus.cc:2454] T 278a862211994821b286e97ab507b24e P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a10d08940e88404aa65d42eff8c0fce8 in term 0.
I20240502 01:58:02.315047 11028 leader_election.cc:302] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 951c7a4ceb3945818592a3e66350b8d0, a10d08940e88404aa65d42eff8c0fce8; no voters:
I20240502 01:58:02.315243 11296 raft_consensus.cc:2781] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:02.315286 11296 raft_consensus.cc:482] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:02.315337 11296 raft_consensus.cc:3037] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.316002 11296 raft_consensus.cc:504] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.316278 11296 leader_election.cc:288] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8 [CANDIDATE]: Term 1 election: Requested vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), 1acde06f8a9b403695365a61c41ab905 (127.10.133.195:44473)
I20240502 01:58:02.316560 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "278a862211994821b286e97ab507b24e" candidate_uuid: "a10d08940e88404aa65d42eff8c0fce8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0"
I20240502 01:58:02.316610 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "278a862211994821b286e97ab507b24e" candidate_uuid: "a10d08940e88404aa65d42eff8c0fce8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1acde06f8a9b403695365a61c41ab905"
I20240502 01:58:02.316671 10961 raft_consensus.cc:3037] T 278a862211994821b286e97ab507b24e P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.316694 11225 raft_consensus.cc:3037] T 278a862211994821b286e97ab507b24e P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.317453 11225 raft_consensus.cc:2454] T 278a862211994821b286e97ab507b24e P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10d08940e88404aa65d42eff8c0fce8 in term 1.
I20240502 01:58:02.317453 10961 raft_consensus.cc:2454] T 278a862211994821b286e97ab507b24e P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10d08940e88404aa65d42eff8c0fce8 in term 1.
I20240502 01:58:02.317710 11029 leader_election.cc:302] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, 951c7a4ceb3945818592a3e66350b8d0, a10d08940e88404aa65d42eff8c0fce8; no voters:
I20240502 01:58:02.317855 11296 raft_consensus.cc:2781] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:02.317936 11296 raft_consensus.cc:686] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8 [term 1 LEADER]: Becoming Leader. State: Replica: a10d08940e88404aa65d42eff8c0fce8, State: Running, Role: LEADER
I20240502 01:58:02.318099 11296 consensus_queue.cc:237] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.319532 11324 raft_consensus.cc:482] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:02.319480 10817 catalog_manager.cc:5484] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194). New cstate: current_term: 1 leader_uuid: "a10d08940e88404aa65d42eff8c0fce8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:02.319602 11324 raft_consensus.cc:504] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.319892 11324 leader_election.cc:288] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753)
I20240502 01:58:02.320183 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f91469e0fe244b69d27c7245a8f064f" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0" is_pre_election: true
I20240502 01:58:02.320209 11094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f91469e0fe244b69d27c7245a8f064f" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8" is_pre_election: true
I20240502 01:58:02.320313 10961 raft_consensus.cc:2454] T 7f91469e0fe244b69d27c7245a8f064f P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 0.
I20240502 01:58:02.320313 11094 raft_consensus.cc:2454] T 7f91469e0fe244b69d27c7245a8f064f P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 0.
I20240502 01:58:02.320583 11160 leader_election.cc:302] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, a10d08940e88404aa65d42eff8c0fce8; no voters:
I20240502 01:58:02.320838 11324 raft_consensus.cc:2781] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:02.320904 11324 raft_consensus.cc:482] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:02.320953 11324 raft_consensus.cc:3037] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.321956 11324 raft_consensus.cc:504] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.322281 11324 leader_election.cc:288] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 election: Requested vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753)
I20240502 01:58:02.322569 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f91469e0fe244b69d27c7245a8f064f" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0"
I20240502 01:58:02.322634 11094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f91469e0fe244b69d27c7245a8f064f" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8"
I20240502 01:58:02.322670 10961 raft_consensus.cc:3037] T 7f91469e0fe244b69d27c7245a8f064f P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.322733 11094 raft_consensus.cc:3037] T 7f91469e0fe244b69d27c7245a8f064f P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.323343 11094 raft_consensus.cc:2454] T 7f91469e0fe244b69d27c7245a8f064f P a10d08940e88404aa65d42eff8c0fce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 1.
I20240502 01:58:02.323388 10961 raft_consensus.cc:2454] T 7f91469e0fe244b69d27c7245a8f064f P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 1.
I20240502 01:58:02.323590 11160 leader_election.cc:302] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, a10d08940e88404aa65d42eff8c0fce8; no voters:
I20240502 01:58:02.323761 11324 raft_consensus.cc:2781] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:02.323841 11324 raft_consensus.cc:686] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905 [term 1 LEADER]: Becoming Leader. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Running, Role: LEADER
I20240502 01:58:02.323956 11324 consensus_queue.cc:237] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.325381 10817 catalog_manager.cc:5484] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1acde06f8a9b403695365a61c41ab905 (127.10.133.195). New cstate: current_term: 1 leader_uuid: "1acde06f8a9b403695365a61c41ab905" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } health_report { overall_health: HEALTHY } } }
W20240502 01:58:02.331055 11272 tablet.cc:2369] T 278a862211994821b286e97ab507b24e P 1acde06f8a9b403695365a61c41ab905: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 01:58:02.352994 11296 raft_consensus.cc:482] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:02.353107 11296 raft_consensus.cc:504] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.353499 11296 leader_election.cc:288] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), 1acde06f8a9b403695365a61c41ab905 (127.10.133.195:44473)
I20240502 01:58:02.353858 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "619a326e88e14afab664fdd75e049ddd" candidate_uuid: "a10d08940e88404aa65d42eff8c0fce8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0" is_pre_election: true
I20240502 01:58:02.353977 10961 raft_consensus.cc:2454] T 619a326e88e14afab664fdd75e049ddd P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a10d08940e88404aa65d42eff8c0fce8 in term 0.
I20240502 01:58:02.354090 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "619a326e88e14afab664fdd75e049ddd" candidate_uuid: "a10d08940e88404aa65d42eff8c0fce8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1acde06f8a9b403695365a61c41ab905" is_pre_election: true
I20240502 01:58:02.354254 11225 raft_consensus.cc:2454] T 619a326e88e14afab664fdd75e049ddd P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a10d08940e88404aa65d42eff8c0fce8 in term 0.
I20240502 01:58:02.354322 11028 leader_election.cc:302] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 951c7a4ceb3945818592a3e66350b8d0, a10d08940e88404aa65d42eff8c0fce8; no voters:
I20240502 01:58:02.354475 11296 raft_consensus.cc:2781] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:02.354528 11296 raft_consensus.cc:482] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:02.354569 11296 raft_consensus.cc:3037] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.355271 11296 raft_consensus.cc:504] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.355588 11296 leader_election.cc:288] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8 [CANDIDATE]: Term 1 election: Requested vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), 1acde06f8a9b403695365a61c41ab905 (127.10.133.195:44473)
I20240502 01:58:02.355877 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "619a326e88e14afab664fdd75e049ddd" candidate_uuid: "a10d08940e88404aa65d42eff8c0fce8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0"
I20240502 01:58:02.355896 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "619a326e88e14afab664fdd75e049ddd" candidate_uuid: "a10d08940e88404aa65d42eff8c0fce8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1acde06f8a9b403695365a61c41ab905"
I20240502 01:58:02.355959 10961 raft_consensus.cc:3037] T 619a326e88e14afab664fdd75e049ddd P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.356006 11225 raft_consensus.cc:3037] T 619a326e88e14afab664fdd75e049ddd P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.356563 10961 raft_consensus.cc:2454] T 619a326e88e14afab664fdd75e049ddd P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10d08940e88404aa65d42eff8c0fce8 in term 1.
I20240502 01:58:02.356688 11225 raft_consensus.cc:2454] T 619a326e88e14afab664fdd75e049ddd P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a10d08940e88404aa65d42eff8c0fce8 in term 1.
I20240502 01:58:02.356848 11028 leader_election.cc:302] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 951c7a4ceb3945818592a3e66350b8d0, a10d08940e88404aa65d42eff8c0fce8; no voters:
I20240502 01:58:02.357033 11299 raft_consensus.cc:482] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:02.357118 11299 raft_consensus.cc:504] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.357425 11299 leader_election.cc:288] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753)
I20240502 01:58:02.357545 11296 raft_consensus.cc:2781] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:02.357591 11335 raft_consensus.cc:482] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:02.357674 11335 raft_consensus.cc:504] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.357745 11296 raft_consensus.cc:686] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8 [term 1 LEADER]: Becoming Leader. State: Replica: a10d08940e88404aa65d42eff8c0fce8, State: Running, Role: LEADER
I20240502 01:58:02.357838 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8635b3048c3d406d9f5a79b9a827930d" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0" is_pre_election: true
I20240502 01:58:02.357939 10961 raft_consensus.cc:2454] T 8635b3048c3d406d9f5a79b9a827930d P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 0.
I20240502 01:58:02.357921 11296 consensus_queue.cc:237] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.358067 11335 leader_election.cc:288] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753), 1acde06f8a9b403695365a61c41ab905 (127.10.133.195:44473)
I20240502 01:58:02.357769 11094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8635b3048c3d406d9f5a79b9a827930d" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8" is_pre_election: true
I20240502 01:58:02.358355 11093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1947fc743d14c4fae1497a2bd3c792c" candidate_uuid: "951c7a4ceb3945818592a3e66350b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8" is_pre_election: true
I20240502 01:58:02.358362 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1947fc743d14c4fae1497a2bd3c792c" candidate_uuid: "951c7a4ceb3945818592a3e66350b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1acde06f8a9b403695365a61c41ab905" is_pre_election: true
I20240502 01:58:02.358388 11094 raft_consensus.cc:2454] T 8635b3048c3d406d9f5a79b9a827930d P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 0.
I20240502 01:58:02.358422 11093 raft_consensus.cc:2454] T b1947fc743d14c4fae1497a2bd3c792c P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 951c7a4ceb3945818592a3e66350b8d0 in term 0.
I20240502 01:58:02.358448 11225 raft_consensus.cc:2454] T b1947fc743d14c4fae1497a2bd3c792c P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 951c7a4ceb3945818592a3e66350b8d0 in term 0.
I20240502 01:58:02.358551 11160 leader_election.cc:302] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, 951c7a4ceb3945818592a3e66350b8d0; no voters:
I20240502 01:58:02.358665 10895 leader_election.cc:302] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 951c7a4ceb3945818592a3e66350b8d0, a10d08940e88404aa65d42eff8c0fce8; no voters:
I20240502 01:58:02.358898 11299 raft_consensus.cc:2781] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:02.358949 11299 raft_consensus.cc:482] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:02.358963 11335 raft_consensus.cc:2781] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:02.358984 11299 raft_consensus.cc:3037] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.359011 11335 raft_consensus.cc:482] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:02.359050 11335 raft_consensus.cc:3037] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.359624 11299 raft_consensus.cc:504] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.359694 10817 catalog_manager.cc:5484] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194). New cstate: current_term: 1 leader_uuid: "a10d08940e88404aa65d42eff8c0fce8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:02.359879 11299 leader_election.cc:288] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 election: Requested vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753)
I20240502 01:58:02.359853 11335 raft_consensus.cc:504] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.360133 11335 leader_election.cc:288] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0 [CANDIDATE]: Term 1 election: Requested vote from peers a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753), 1acde06f8a9b403695365a61c41ab905 (127.10.133.195:44473)
I20240502 01:58:02.360229 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8635b3048c3d406d9f5a79b9a827930d" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0"
I20240502 01:58:02.360334 10961 raft_consensus.cc:3037] T 8635b3048c3d406d9f5a79b9a827930d P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.360447 11093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8635b3048c3d406d9f5a79b9a827930d" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8"
I20240502 01:58:02.360492 11094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1947fc743d14c4fae1497a2bd3c792c" candidate_uuid: "951c7a4ceb3945818592a3e66350b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8"
I20240502 01:58:02.360553 11094 raft_consensus.cc:3037] T b1947fc743d14c4fae1497a2bd3c792c P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.360553 11093 raft_consensus.cc:3037] T 8635b3048c3d406d9f5a79b9a827930d P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.361076 10961 raft_consensus.cc:2454] T 8635b3048c3d406d9f5a79b9a827930d P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 1.
I20240502 01:58:02.361407 11160 leader_election.cc:302] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, 951c7a4ceb3945818592a3e66350b8d0; no voters:
I20240502 01:58:02.361562 11093 raft_consensus.cc:2454] T 8635b3048c3d406d9f5a79b9a827930d P a10d08940e88404aa65d42eff8c0fce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 1.
I20240502 01:58:02.361688 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1947fc743d14c4fae1497a2bd3c792c" candidate_uuid: "951c7a4ceb3945818592a3e66350b8d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1acde06f8a9b403695365a61c41ab905"
I20240502 01:58:02.361754 11299 raft_consensus.cc:2781] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:02.361799 11225 raft_consensus.cc:3037] T b1947fc743d14c4fae1497a2bd3c792c P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.361845 11299 raft_consensus.cc:686] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905 [term 1 LEADER]: Becoming Leader. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Running, Role: LEADER
I20240502 01:58:02.361888 11094 raft_consensus.cc:2454] T b1947fc743d14c4fae1497a2bd3c792c P a10d08940e88404aa65d42eff8c0fce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 951c7a4ceb3945818592a3e66350b8d0 in term 1.
I20240502 01:58:02.361960 11299 consensus_queue.cc:237] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.362584 11225 raft_consensus.cc:2454] T b1947fc743d14c4fae1497a2bd3c792c P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 951c7a4ceb3945818592a3e66350b8d0 in term 1.
I20240502 01:58:02.362880 10895 leader_election.cc:302] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 951c7a4ceb3945818592a3e66350b8d0, a10d08940e88404aa65d42eff8c0fce8; no voters:
I20240502 01:58:02.363052 11335 raft_consensus.cc:2781] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:02.363143 11335 raft_consensus.cc:686] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0 [term 1 LEADER]: Becoming Leader. State: Replica: 951c7a4ceb3945818592a3e66350b8d0, State: Running, Role: LEADER
I20240502 01:58:02.363256 11335 consensus_queue.cc:237] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.363584 10818 catalog_manager.cc:5484] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1acde06f8a9b403695365a61c41ab905 (127.10.133.195). New cstate: current_term: 1 leader_uuid: "1acde06f8a9b403695365a61c41ab905" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } health_report { overall_health: HEALTHY } } }
I20240502 01:58:02.364728 10817 catalog_manager.cc:5484] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193). New cstate: current_term: 1 leader_uuid: "951c7a4ceb3945818592a3e66350b8d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:02.385748 11299 raft_consensus.cc:482] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:02.385843 11299 raft_consensus.cc:504] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } }
I20240502 01:58:02.386212 11299 leader_election.cc:288] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753)
I20240502 01:58:02.386597 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "695664285e004216ad89b4a786b6387d" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0" is_pre_election: true
I20240502 01:58:02.386648 11094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "695664285e004216ad89b4a786b6387d" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8" is_pre_election: true
I20240502 01:58:02.386747 10961 raft_consensus.cc:2454] T 695664285e004216ad89b4a786b6387d P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 0.
I20240502 01:58:02.386773 11094 raft_consensus.cc:2454] T 695664285e004216ad89b4a786b6387d P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 0.
I20240502 01:58:02.386988 11160 leader_election.cc:302] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, a10d08940e88404aa65d42eff8c0fce8; no voters:
I20240502 01:58:02.387138 11299 raft_consensus.cc:2781] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:02.387182 11299 raft_consensus.cc:482] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:02.387230 11299 raft_consensus.cc:3037] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.388098 11299 raft_consensus.cc:504] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } }
I20240502 01:58:02.388392 11299 leader_election.cc:288] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 election: Requested vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753)
I20240502 01:58:02.388736 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "695664285e004216ad89b4a786b6387d" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0"
I20240502 01:58:02.388736 11094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "695664285e004216ad89b4a786b6387d" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8"
I20240502 01:58:02.388841 11094 raft_consensus.cc:3037] T 695664285e004216ad89b4a786b6387d P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.388841 10961 raft_consensus.cc:3037] T 695664285e004216ad89b4a786b6387d P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.389657 11094 raft_consensus.cc:2454] T 695664285e004216ad89b4a786b6387d P a10d08940e88404aa65d42eff8c0fce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 1.
I20240502 01:58:02.389657 10961 raft_consensus.cc:2454] T 695664285e004216ad89b4a786b6387d P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 1.
I20240502 01:58:02.389914 11160 leader_election.cc:302] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, a10d08940e88404aa65d42eff8c0fce8; no voters:
I20240502 01:58:02.390065 11299 raft_consensus.cc:2781] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:02.390168 11299 raft_consensus.cc:686] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905 [term 1 LEADER]: Becoming Leader. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Running, Role: LEADER
I20240502 01:58:02.390304 11299 consensus_queue.cc:237] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } }
I20240502 01:58:02.391813 10817 catalog_manager.cc:5484] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1acde06f8a9b403695365a61c41ab905 (127.10.133.195). New cstate: current_term: 1 leader_uuid: "1acde06f8a9b403695365a61c41ab905" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } health_report { overall_health: UNKNOWN } } }
W20240502 01:58:02.427353 11141 tablet.cc:2369] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 01:58:02.478355 11296 raft_consensus.cc:482] T f43d8bb63caa47d68e7193c54c8263d4 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:02.478505 11296 raft_consensus.cc:504] T f43d8bb63caa47d68e7193c54c8263d4 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.478972 11296 leader_election.cc:288] T f43d8bb63caa47d68e7193c54c8263d4 P a10d08940e88404aa65d42eff8c0fce8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), 1acde06f8a9b403695365a61c41ab905 (127.10.133.195:44473)
I20240502 01:58:02.479362 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43d8bb63caa47d68e7193c54c8263d4" candidate_uuid: "a10d08940e88404aa65d42eff8c0fce8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1acde06f8a9b403695365a61c41ab905" is_pre_election: true
I20240502 01:58:02.479365 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43d8bb63caa47d68e7193c54c8263d4" candidate_uuid: "a10d08940e88404aa65d42eff8c0fce8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0" is_pre_election: true
I20240502 01:58:02.479598 10961 raft_consensus.cc:2379] T f43d8bb63caa47d68e7193c54c8263d4 P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a10d08940e88404aa65d42eff8c0fce8 in current term 1: Already voted for candidate 1acde06f8a9b403695365a61c41ab905 in this term.
I20240502 01:58:02.479949 11028 leader_election.cc:302] T f43d8bb63caa47d68e7193c54c8263d4 P a10d08940e88404aa65d42eff8c0fce8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a10d08940e88404aa65d42eff8c0fce8; no voters: 1acde06f8a9b403695365a61c41ab905, 951c7a4ceb3945818592a3e66350b8d0
I20240502 01:58:02.480122 11296 raft_consensus.cc:3037] T f43d8bb63caa47d68e7193c54c8263d4 P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.480877 11296 raft_consensus.cc:2726] T f43d8bb63caa47d68e7193c54c8263d4 P a10d08940e88404aa65d42eff8c0fce8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:58:02.491904 11299 raft_consensus.cc:482] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:02.492023 11299 raft_consensus.cc:504] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.492422 11299 leader_election.cc:288] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753)
I20240502 01:58:02.492825 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f62417ff2a8f4bb580eeebf11627487a" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0" is_pre_election: true
I20240502 01:58:02.492877 11094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f62417ff2a8f4bb580eeebf11627487a" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8" is_pre_election: true
I20240502 01:58:02.492947 10961 raft_consensus.cc:2454] T f62417ff2a8f4bb580eeebf11627487a P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 0.
I20240502 01:58:02.493012 11094 raft_consensus.cc:2454] T f62417ff2a8f4bb580eeebf11627487a P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 0.
I20240502 01:58:02.493252 11160 leader_election.cc:302] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, 951c7a4ceb3945818592a3e66350b8d0; no voters:
I20240502 01:58:02.493432 11299 raft_consensus.cc:2781] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:02.493501 11299 raft_consensus.cc:482] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:02.493541 11299 raft_consensus.cc:3037] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.494323 11299 raft_consensus.cc:504] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.494624 11299 leader_election.cc:288] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 election: Requested vote from peers 951c7a4ceb3945818592a3e66350b8d0 (127.10.133.193:34093), a10d08940e88404aa65d42eff8c0fce8 (127.10.133.194:45753)
I20240502 01:58:02.494947 10961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f62417ff2a8f4bb580eeebf11627487a" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951c7a4ceb3945818592a3e66350b8d0"
I20240502 01:58:02.495054 10961 raft_consensus.cc:3037] T f62417ff2a8f4bb580eeebf11627487a P 951c7a4ceb3945818592a3e66350b8d0 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.495028 11094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f62417ff2a8f4bb580eeebf11627487a" candidate_uuid: "1acde06f8a9b403695365a61c41ab905" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a10d08940e88404aa65d42eff8c0fce8"
I20240502 01:58:02.495132 11094 raft_consensus.cc:3037] T f62417ff2a8f4bb580eeebf11627487a P a10d08940e88404aa65d42eff8c0fce8 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:02.495774 10961 raft_consensus.cc:2454] T f62417ff2a8f4bb580eeebf11627487a P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 1.
I20240502 01:58:02.495904 11094 raft_consensus.cc:2454] T f62417ff2a8f4bb580eeebf11627487a P a10d08940e88404aa65d42eff8c0fce8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1acde06f8a9b403695365a61c41ab905 in term 1.
I20240502 01:58:02.496040 11160 leader_election.cc:302] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1acde06f8a9b403695365a61c41ab905, 951c7a4ceb3945818592a3e66350b8d0; no voters:
I20240502 01:58:02.496222 11299 raft_consensus.cc:2781] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:02.496321 11299 raft_consensus.cc:686] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905 [term 1 LEADER]: Becoming Leader. State: Replica: 1acde06f8a9b403695365a61c41ab905, State: Running, Role: LEADER
I20240502 01:58:02.496485 11299 consensus_queue.cc:237] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } }
I20240502 01:58:02.498102 10817 catalog_manager.cc:5484] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1acde06f8a9b403695365a61c41ab905 (127.10.133.195). New cstate: current_term: 1 leader_uuid: "1acde06f8a9b403695365a61c41ab905" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 } health_report { overall_health: HEALTHY } } }
I20240502 01:58:02.663043 11299 consensus_queue.cc:1035] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.667987 11375 consensus_queue.cc:1035] T f43d8bb63caa47d68e7193c54c8263d4 P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.680681 11375 consensus_queue.cc:1035] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.684408 11299 consensus_queue.cc:1035] T c1c75d212ed94340a46b3fc6d509ff03 P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.696432 11296 consensus_queue.cc:1035] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240502 01:58:02.696830 11372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:02.697072 11372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20240502 01:58:02.699693 11296 consensus_queue.cc:1035] T 278a862211994821b286e97ab507b24e P a10d08940e88404aa65d42eff8c0fce8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240502 01:58:02.701217 11372 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20240502 01:58:02.719444 11375 consensus_queue.cc:1035] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Using table 'rebalance_test_table_0'
I20240502 01:58:02.723068 11326 consensus_queue.cc:1035] T 5eb4a838865b4ef68984481d70518380 P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.726362 11335 consensus_queue.cc:1035] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.730052 11402 consensus_queue.cc:1035] T 71368a3e53d84be6a5c35a872b502d21 P 951c7a4ceb3945818592a3e66350b8d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.743806 11326 consensus_queue.cc:1035] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.745880 11402 consensus_queue.cc:1035] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.750023 11299 consensus_queue.cc:1035] T 8635b3048c3d406d9f5a79b9a827930d P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.750262 11402 consensus_queue.cc:1035] T b5448e58213f494bbd967d92a8f986b9 P 951c7a4ceb3945818592a3e66350b8d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.762135 11326 consensus_queue.cc:1035] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.769626 11297 consensus_queue.cc:1035] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.780016 11299 consensus_queue.cc:1035] T 7f91469e0fe244b69d27c7245a8f064f P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.787995 11297 consensus_queue.cc:1035] T 8333a34264964548a99bd736c94dadd2 P 951c7a4ceb3945818592a3e66350b8d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.791365 11326 consensus_queue.cc:1035] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.791967 11326 consensus_queue.cc:1035] T 291a8288505146f2bbefae74ba06b06a P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.799635 11297 consensus_queue.cc:1035] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.803158 11363 consensus_queue.cc:1035] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.804152 11335 consensus_queue.cc:1035] T b1947fc743d14c4fae1497a2bd3c792c P 951c7a4ceb3945818592a3e66350b8d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.808291 11296 consensus_queue.cc:1035] T 619a326e88e14afab664fdd75e049ddd P a10d08940e88404aa65d42eff8c0fce8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.811416 11299 consensus_queue.cc:1035] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.822564 11225 raft_consensus.cc:1261] T bd693e8dde084bd5a2010d1d77e41c3c P 1acde06f8a9b403695365a61c41ab905 [term 1 FOLLOWER]: Refusing update from remote peer a10d08940e88404aa65d42eff8c0fce8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:02.825913 10962 raft_consensus.cc:1261] T bd693e8dde084bd5a2010d1d77e41c3c P 951c7a4ceb3945818592a3e66350b8d0 [term 1 FOLLOWER]: Refusing update from remote peer a10d08940e88404aa65d42eff8c0fce8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:02.825892 11363 consensus_queue.cc:1035] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1acde06f8a9b403695365a61c41ab905" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 44473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.829138 11363 consensus_queue.cc:1035] T bd693e8dde084bd5a2010d1d77e41c3c P a10d08940e88404aa65d42eff8c0fce8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.831466 11442 mvcc.cc:205] Tried to move back new op lower bound from 7023063379228311552 to 7023063377130139648. Current Snapshot: MvccSnapshot[applied={T|T < 7023063379228311552}]
I20240502 01:58:02.844141 11375 consensus_queue.cc:1035] T b7354329657c446ca93a760b45286859 P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.837909 11434 mvcc.cc:205] Tried to move back new op lower bound from 7023063379228311552 to 7023063377130139648. Current Snapshot: MvccSnapshot[applied={T|T < 7023063379228311552}]
I20240502 01:58:02.874269 11467 mvcc.cc:205] Tried to move back new op lower bound from 7023063379228311552 to 7023063377130139648. Current Snapshot: MvccSnapshot[applied={T|T < 7023063379228311552}]
I20240502 01:58:02.887706 11375 consensus_queue.cc:1035] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.889556 11375 consensus_queue.cc:1035] T f62417ff2a8f4bb580eeebf11627487a P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.894788 11448 consensus_queue.cc:1035] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "951c7a4ceb3945818592a3e66350b8d0" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 34093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:02.910426 11326 consensus_queue.cc:1035] T 695664285e004216ad89b4a786b6387d P 1acde06f8a9b403695365a61c41ab905 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a10d08940e88404aa65d42eff8c0fce8" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 45753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 175.227 ms
time per row: 0.0876136 ms
I20240502 01:58:03.115664 11199 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:03.116174 11073 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:58:03.116680 10936 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:58:03.215322 11199 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:03.216177 10936 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:58:03.216811 11073 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:58:03.324072 11199 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:03.324070 10936 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:58:03.324597 11073 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:58:03.548345 11073 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:58:03.548345 11199 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:03.548646 10936 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:58:03.637498 11199 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:03.637603 10936 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:58:03.637903 11073 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:58:03.669607 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 10878
I20240502 01:58:03.676889 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 11011
I20240502 01:58:03.683581 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 11143
I20240502 01:58:03.689826 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 10787
2024-05-02T01:58:03Z chronyd exiting
[ OK ] TableRangeRebalancingTest.Basic (6135 ms)
[----------] 1 test from TableRangeRebalancingTest (6135 ms total)
[----------] 1 test from RebalanceStartSafetyTest
[ RUN ] RebalanceStartSafetyTest.TooManyIgnoredTservers/1
I20240502 01:58:03.719416 10775 test_util.cc:268] Using random seed: -285353229
I20240502 01:58:03.720178 10775 ts_itest-base.cc:112] Starting cluster with:
I20240502 01:58:03.720217 10775 ts_itest-base.cc:113] --------------
I20240502 01:58:03.720238 10775 ts_itest-base.cc:114] 5 tablet servers
I20240502 01:58:03.720254 10775 ts_itest-base.cc:115] 3 replicas per TS
I20240502 01:58:03.720279 10775 ts_itest-base.cc:116] --------------
2024-05-02T01:58:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T01:58:03Z Disabled control of system clock
I20240502 01:58:03.727726 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.133.254:41945
--webserver_interface=127.10.133.254
--webserver_port=0
--builtin_ntp_servers=127.10.133.212:36913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.133.254:41945
--raft_prepare_replacement_before_eviction=true
--enable_range_replica_placement=false with env {}
W20240502 01:58:03.831926 11630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:03.832150 11630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:03.832218 11630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:03.835192 11630 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:03.835268 11630 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 01:58:03.835306 11630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:03.835347 11630 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 01:58:03.835382 11630 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 01:58:03.838943 11630 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:36913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
--enable_range_replica_placement=false
--ipki_ca_key_size=768
--master_addresses=127.10.133.254:41945
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.133.254:41945
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.133.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.11630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:03.839797 11630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:03.840855 11630 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:03.848448 11635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:03.848623 11636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:03.849292 11638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:03.849857 11630 server_base.cc:1034] running on GCE node
I20240502 01:58:03.850353 11630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:03.851244 11630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:03.852422 11630 hybrid_clock.cc:648] HybridClock initialized: now 1714615083852401 us; error 41 us; skew 500 ppm
I20240502 01:58:03.854254 11630 webserver.cc:460] Webserver started at http://127.10.133.254:41857/ using document root <none> and password file <none>
I20240502 01:58:03.854779 11630 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:03.854838 11630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:03.855005 11630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:03.856590 11630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "4948275a183f4c6488d18f031d5a8b9c"
format_stamp: "Formatted at 2024-05-02 01:58:03 on dist-test-slave-dr9f"
I20240502 01:58:03.857015 11630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "4948275a183f4c6488d18f031d5a8b9c"
format_stamp: "Formatted at 2024-05-02 01:58:03 on dist-test-slave-dr9f"
I20240502 01:58:03.860177 11630 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 01:58:03.862190 11644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:03.863103 11630 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:03.863209 11630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
uuid: "4948275a183f4c6488d18f031d5a8b9c"
format_stamp: "Formatted at 2024-05-02 01:58:03 on dist-test-slave-dr9f"
I20240502 01:58:03.863284 11630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:03.883803 11630 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:03.884431 11630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:03.884594 11630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:03.890677 11630 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.254:41945
I20240502 01:58:03.890687 11696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.254:41945 every 8 connection(s)
I20240502 01:58:03.891654 11630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20240502 01:58:03.892180 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 11630
I20240502 01:58:03.892274 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal/instance
I20240502 01:58:03.894387 11697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:03.898825 11697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c: Bootstrap starting.
I20240502 01:58:03.901041 11697 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:03.901785 11697 log.cc:824] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:03.903296 11697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c: No bootstrap required, opened a new log
I20240502 01:58:03.905642 11697 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4948275a183f4c6488d18f031d5a8b9c" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 41945 } }
I20240502 01:58:03.905817 11697 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:03.905892 11697 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4948275a183f4c6488d18f031d5a8b9c, State: Initialized, Role: FOLLOWER
I20240502 01:58:03.906317 11697 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4948275a183f4c6488d18f031d5a8b9c" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 41945 } }
I20240502 01:58:03.906441 11697 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:58:03.906502 11697 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:58:03.906616 11697 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:03.907387 11697 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4948275a183f4c6488d18f031d5a8b9c" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 41945 } }
I20240502 01:58:03.907706 11697 leader_election.cc:302] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4948275a183f4c6488d18f031d5a8b9c; no voters:
I20240502 01:58:03.907955 11697 leader_election.cc:288] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:58:03.908043 11702 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:03.908236 11702 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c [term 1 LEADER]: Becoming Leader. State: Replica: 4948275a183f4c6488d18f031d5a8b9c, State: Running, Role: LEADER
I20240502 01:58:03.908512 11702 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4948275a183f4c6488d18f031d5a8b9c" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 41945 } }
I20240502 01:58:03.908983 11697 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c [sys.catalog]: configured and running, proceeding with master startup.
I20240502 01:58:03.910072 11703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4948275a183f4c6488d18f031d5a8b9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4948275a183f4c6488d18f031d5a8b9c" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 41945 } } }
I20240502 01:58:03.910109 11704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4948275a183f4c6488d18f031d5a8b9c. Latest consensus state: current_term: 1 leader_uuid: "4948275a183f4c6488d18f031d5a8b9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4948275a183f4c6488d18f031d5a8b9c" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 41945 } } }
I20240502 01:58:03.910174 11703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c [sys.catalog]: This master's current role is: LEADER
I20240502 01:58:03.910758 11704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c [sys.catalog]: This master's current role is: LEADER
I20240502 01:58:03.911222 11706 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 01:58:03.913923 11706 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 01:58:03.918534 11706 catalog_manager.cc:1347] Generated new cluster ID: 0b0f4c183fd54c0d9113bfd46549e3ba
I20240502 01:58:03.918597 11706 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 01:58:03.949190 11706 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 01:58:03.950500 11706 catalog_manager.cc:1504] Loading token signing keys...
I20240502 01:58:03.957803 11706 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 4948275a183f4c6488d18f031d5a8b9c: Generated new TSK 0
I20240502 01:58:03.958595 11706 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 01:58:03.964982 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.193:0
--local_ip_for_outbound_sockets=127.10.133.193
--webserver_interface=127.10.133.193
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41945
--builtin_ntp_servers=127.10.133.212:36913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 01:58:04.071126 11721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:04.071372 11721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:04.071422 11721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:04.074362 11721 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:04.074419 11721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:04.074489 11721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.193
I20240502 01:58:04.079015 11721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:36913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.133.193
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41945
--never_fsync=true
--heap_profile_path=/tmp/kudu.11721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.193
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:04.079882 11721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:04.080920 11721 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:04.088661 11726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:04.089147 11729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:04.089777 11727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:04.090404 11721 server_base.cc:1034] running on GCE node
I20240502 01:58:04.090724 11721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:04.091296 11721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:04.092456 11721 hybrid_clock.cc:648] HybridClock initialized: now 1714615084092436 us; error 32 us; skew 500 ppm
I20240502 01:58:04.094347 11721 webserver.cc:460] Webserver started at http://127.10.133.193:45269/ using document root <none> and password file <none>
I20240502 01:58:04.094887 11721 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:04.094944 11721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:04.095124 11721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:04.096729 11721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "76f68b09b4db4e068c0bd1abce5d6964"
format_stamp: "Formatted at 2024-05-02 01:58:04 on dist-test-slave-dr9f"
I20240502 01:58:04.097179 11721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "76f68b09b4db4e068c0bd1abce5d6964"
format_stamp: "Formatted at 2024-05-02 01:58:04 on dist-test-slave-dr9f"
I20240502 01:58:04.100385 11721 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20240502 01:58:04.102504 11735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:04.103435 11721 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:04.103538 11721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "76f68b09b4db4e068c0bd1abce5d6964"
format_stamp: "Formatted at 2024-05-02 01:58:04 on dist-test-slave-dr9f"
I20240502 01:58:04.103621 11721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:04.125553 11721 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:04.126242 11721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:04.126407 11721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:04.126950 11721 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:04.127835 11721 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:04.127883 11721 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:04.127941 11721 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:04.127972 11721 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:04.136448 11721 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.193:42697
I20240502 01:58:04.136490 11849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.193:42697 every 8 connection(s)
I20240502 01:58:04.137369 11721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20240502 01:58:04.140581 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 11721
I20240502 01:58:04.140699 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20240502 01:58:04.142921 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.194:0
--local_ip_for_outbound_sockets=127.10.133.194
--webserver_interface=127.10.133.194
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41945
--builtin_ntp_servers=127.10.133.212:36913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:58:04.146766 11850 heartbeater.cc:347] Connected to a master server at 127.10.133.254:41945
I20240502 01:58:04.146965 11850 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:04.147435 11850 heartbeater.cc:511] Master 127.10.133.254:41945 requested a full tablet report, sending...
I20240502 01:58:04.149004 11661 ts_manager.cc:194] Registered new tserver with Master: 76f68b09b4db4e068c0bd1abce5d6964 (127.10.133.193:42697)
I20240502 01:58:04.150777 11661 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.193:54897
W20240502 01:58:04.249313 11853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:04.249541 11853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:04.249588 11853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:04.252554 11853 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:04.252614 11853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:04.252679 11853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.194
I20240502 01:58:04.256228 11853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:36913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.133.194
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41945
--never_fsync=true
--heap_profile_path=/tmp/kudu.11853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.194
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:04.257079 11853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:04.258200 11853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:04.267248 11859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:04.268007 11858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:04.268666 11861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:04.269182 11853 server_base.cc:1034] running on GCE node
I20240502 01:58:04.269683 11853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:04.270380 11853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:04.273656 11853 hybrid_clock.cc:648] HybridClock initialized: now 1714615084273595 us; error 74 us; skew 500 ppm
I20240502 01:58:04.275818 11853 webserver.cc:460] Webserver started at http://127.10.133.194:45445/ using document root <none> and password file <none>
I20240502 01:58:04.276345 11853 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:04.276396 11853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:04.276552 11853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:04.278285 11853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "4faec0de5498412e82651186407fd5f9"
format_stamp: "Formatted at 2024-05-02 01:58:04 on dist-test-slave-dr9f"
I20240502 01:58:04.278746 11853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "4faec0de5498412e82651186407fd5f9"
format_stamp: "Formatted at 2024-05-02 01:58:04 on dist-test-slave-dr9f"
I20240502 01:58:04.281958 11853 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20240502 01:58:04.284101 11867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:04.285056 11853 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:04.285166 11853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "4faec0de5498412e82651186407fd5f9"
format_stamp: "Formatted at 2024-05-02 01:58:04 on dist-test-slave-dr9f"
I20240502 01:58:04.285246 11853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:04.315532 11853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:04.316147 11853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:04.316310 11853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:04.316865 11853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:04.317766 11853 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:04.317816 11853 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:04.317870 11853 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:04.317901 11853 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:04.325954 11853 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.194:35189
I20240502 01:58:04.326012 11982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.194:35189 every 8 connection(s)
I20240502 01:58:04.326917 11853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20240502 01:58:04.328953 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 11853
I20240502 01:58:04.329046 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20240502 01:58:04.331174 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.195:0
--local_ip_for_outbound_sockets=127.10.133.195
--webserver_interface=127.10.133.195
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41945
--builtin_ntp_servers=127.10.133.212:36913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:58:04.336030 11983 heartbeater.cc:347] Connected to a master server at 127.10.133.254:41945
I20240502 01:58:04.336247 11983 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:04.336773 11983 heartbeater.cc:511] Master 127.10.133.254:41945 requested a full tablet report, sending...
I20240502 01:58:04.337740 11661 ts_manager.cc:194] Registered new tserver with Master: 4faec0de5498412e82651186407fd5f9 (127.10.133.194:35189)
I20240502 01:58:04.338332 11661 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.194:38759
W20240502 01:58:04.437419 11986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:04.437650 11986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:04.437718 11986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:04.440729 11986 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:04.440800 11986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:04.440891 11986 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.195
I20240502 01:58:04.444438 11986 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:36913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.133.195
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41945
--never_fsync=true
--heap_profile_path=/tmp/kudu.11986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.195
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:04.445315 11986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:04.446487 11986 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:04.454341 11994 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:04.454782 11991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:04.455397 11992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:04.456106 11986 server_base.cc:1034] running on GCE node
I20240502 01:58:04.456451 11986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:04.456965 11986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:04.458110 11986 hybrid_clock.cc:648] HybridClock initialized: now 1714615084458090 us; error 32 us; skew 500 ppm
I20240502 01:58:04.459995 11986 webserver.cc:460] Webserver started at http://127.10.133.195:37329/ using document root <none> and password file <none>
I20240502 01:58:04.460500 11986 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:04.460556 11986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:04.460704 11986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:04.462316 11986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "1e769afe267e4a2e9a458b8518359416"
format_stamp: "Formatted at 2024-05-02 01:58:04 on dist-test-slave-dr9f"
I20240502 01:58:04.462743 11986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "1e769afe267e4a2e9a458b8518359416"
format_stamp: "Formatted at 2024-05-02 01:58:04 on dist-test-slave-dr9f"
I20240502 01:58:04.465898 11986 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20240502 01:58:04.468086 12000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:04.469075 11986 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:04.469167 11986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "1e769afe267e4a2e9a458b8518359416"
format_stamp: "Formatted at 2024-05-02 01:58:04 on dist-test-slave-dr9f"
I20240502 01:58:04.469239 11986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:04.480185 11986 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:04.480708 11986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:04.480846 11986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:04.481295 11986 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:04.482143 11986 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:04.482198 11986 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:04.482244 11986 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:04.482264 11986 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:04.490345 11986 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.195:45737
I20240502 01:58:04.490378 12116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.195:45737 every 8 connection(s)
I20240502 01:58:04.491222 11986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20240502 01:58:04.496515 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 11986
I20240502 01:58:04.496608 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20240502 01:58:04.498579 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.196:0
--local_ip_for_outbound_sockets=127.10.133.196
--webserver_interface=127.10.133.196
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41945
--builtin_ntp_servers=127.10.133.212:36913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:58:04.499372 12117 heartbeater.cc:347] Connected to a master server at 127.10.133.254:41945
I20240502 01:58:04.499601 12117 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:04.500145 12117 heartbeater.cc:511] Master 127.10.133.254:41945 requested a full tablet report, sending...
I20240502 01:58:04.501073 11661 ts_manager.cc:194] Registered new tserver with Master: 1e769afe267e4a2e9a458b8518359416 (127.10.133.195:45737)
I20240502 01:58:04.501633 11661 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.195:33665
W20240502 01:58:04.604266 12120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:04.604576 12120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:04.604682 12120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:04.607789 12120 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:04.607846 12120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:04.607910 12120 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.196
I20240502 01:58:04.611560 12120 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:36913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.196:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.10.133.196
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41945
--never_fsync=true
--heap_profile_path=/tmp/kudu.12120
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.196
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:04.612437 12120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:04.613521 12120 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:04.621928 12127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:04.622061 12126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:04.622615 12129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:04.623275 12120 server_base.cc:1034] running on GCE node
I20240502 01:58:04.623673 12120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:04.624238 12120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:04.625396 12120 hybrid_clock.cc:648] HybridClock initialized: now 1714615084625382 us; error 32 us; skew 500 ppm
I20240502 01:58:04.627346 12120 webserver.cc:460] Webserver started at http://127.10.133.196:41905/ using document root <none> and password file <none>
I20240502 01:58:04.627905 12120 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:04.627967 12120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:04.628144 12120 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:04.629791 12120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "c9140532f22b423ca931f20ed5222c5b"
format_stamp: "Formatted at 2024-05-02 01:58:04 on dist-test-slave-dr9f"
I20240502 01:58:04.630277 12120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "c9140532f22b423ca931f20ed5222c5b"
format_stamp: "Formatted at 2024-05-02 01:58:04 on dist-test-slave-dr9f"
I20240502 01:58:04.633517 12120 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20240502 01:58:04.635648 12135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:04.636595 12120 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:04.636699 12120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "c9140532f22b423ca931f20ed5222c5b"
format_stamp: "Formatted at 2024-05-02 01:58:04 on dist-test-slave-dr9f"
I20240502 01:58:04.636785 12120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:04.664251 12120 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:04.664894 12120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:04.665055 12120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:04.665591 12120 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:04.666576 12120 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:04.666656 12120 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:04.666726 12120 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:04.666764 12120 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:04.674844 12120 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.196:38609
I20240502 01:58:04.674866 12250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.196:38609 every 8 connection(s)
I20240502 01:58:04.675740 12120 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20240502 01:58:04.684121 12251 heartbeater.cc:347] Connected to a master server at 127.10.133.254:41945
I20240502 01:58:04.684250 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 12120
I20240502 01:58:04.684353 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20240502 01:58:04.684382 12251 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:04.685000 12251 heartbeater.cc:511] Master 127.10.133.254:41945 requested a full tablet report, sending...
I20240502 01:58:04.685956 11661 ts_manager.cc:194] Registered new tserver with Master: c9140532f22b423ca931f20ed5222c5b (127.10.133.196:38609)
I20240502 01:58:04.686582 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.197:0
--local_ip_for_outbound_sockets=127.10.133.197
--webserver_interface=127.10.133.197
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41945
--builtin_ntp_servers=127.10.133.212:36913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:58:04.686569 11661 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.196:54309
W20240502 01:58:04.793694 12254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:04.793937 12254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:04.794029 12254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:04.797029 12254 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:04.797102 12254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:04.797195 12254 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.197
I20240502 01:58:04.800807 12254 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:36913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.197:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.10.133.197
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41945
--never_fsync=true
--heap_profile_path=/tmp/kudu.12254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.197
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:04.801724 12254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:04.802858 12254 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:04.810988 12259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:04.811291 12262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:04.811702 12260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:04.812374 12254 server_base.cc:1034] running on GCE node
I20240502 01:58:04.812733 12254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:04.813282 12254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:04.814456 12254 hybrid_clock.cc:648] HybridClock initialized: now 1714615084814438 us; error 28 us; skew 500 ppm
I20240502 01:58:04.816304 12254 webserver.cc:460] Webserver started at http://127.10.133.197:33591/ using document root <none> and password file <none>
I20240502 01:58:04.816848 12254 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:04.816908 12254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:04.817078 12254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:04.818853 12254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "75c71b0d609d4ef895a3a31700a3ceda"
format_stamp: "Formatted at 2024-05-02 01:58:04 on dist-test-slave-dr9f"
I20240502 01:58:04.819343 12254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "75c71b0d609d4ef895a3a31700a3ceda"
format_stamp: "Formatted at 2024-05-02 01:58:04 on dist-test-slave-dr9f"
I20240502 01:58:04.822644 12254 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 01:58:04.824749 12268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:04.825698 12254 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:04.825814 12254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "75c71b0d609d4ef895a3a31700a3ceda"
format_stamp: "Formatted at 2024-05-02 01:58:04 on dist-test-slave-dr9f"
I20240502 01:58:04.825898 12254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:04.862391 12254 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:04.863050 12254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:04.863214 12254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:04.863729 12254 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:04.864603 12254 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:04.864653 12254 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:04.864711 12254 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:04.864742 12254 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:04.873286 12254 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.197:45929
I20240502 01:58:04.873311 12384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.197:45929 every 8 connection(s)
I20240502 01:58:04.874287 12254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20240502 01:58:04.882413 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 12254
I20240502 01:58:04.882458 12385 heartbeater.cc:347] Connected to a master server at 127.10.133.254:41945
I20240502 01:58:04.882527 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceStartSafetyTest.TooManyIgnoredTservers_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20240502 01:58:04.882683 12385 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:04.883226 12385 heartbeater.cc:511] Master 127.10.133.254:41945 requested a full tablet report, sending...
I20240502 01:58:04.884207 11660 ts_manager.cc:194] Registered new tserver with Master: 75c71b0d609d4ef895a3a31700a3ceda (127.10.133.197:45929)
I20240502 01:58:04.884873 11660 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.197:46695
I20240502 01:58:04.896512 10775 external_mini_cluster.cc:930] 5 TS(s) registered with all masters
I20240502 01:58:04.906106 11660 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54986:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20240502 01:58:04.924083 11916 tablet_service.cc:1467] Processing CreateTablet for tablet eae35f426727445fbe1fec19ecbb404e (DEFAULT_TABLE table=TestTable [id=ddc76cecf641461ba3fe870fb2fc31ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:04.924167 12183 tablet_service.cc:1467] Processing CreateTablet for tablet eae35f426727445fbe1fec19ecbb404e (DEFAULT_TABLE table=TestTable [id=ddc76cecf641461ba3fe870fb2fc31ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:04.924167 12318 tablet_service.cc:1467] Processing CreateTablet for tablet eae35f426727445fbe1fec19ecbb404e (DEFAULT_TABLE table=TestTable [id=ddc76cecf641461ba3fe870fb2fc31ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:04.925019 11916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eae35f426727445fbe1fec19ecbb404e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:04.925053 12183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eae35f426727445fbe1fec19ecbb404e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:04.925053 12318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eae35f426727445fbe1fec19ecbb404e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:04.931381 12405 tablet_bootstrap.cc:492] T eae35f426727445fbe1fec19ecbb404e P 75c71b0d609d4ef895a3a31700a3ceda: Bootstrap starting.
I20240502 01:58:04.931816 12404 tablet_bootstrap.cc:492] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b: Bootstrap starting.
I20240502 01:58:04.933302 12405 tablet_bootstrap.cc:654] T eae35f426727445fbe1fec19ecbb404e P 75c71b0d609d4ef895a3a31700a3ceda: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:04.933393 12404 tablet_bootstrap.cc:654] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:04.934041 12404 log.cc:824] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:04.934047 12405 log.cc:824] T eae35f426727445fbe1fec19ecbb404e P 75c71b0d609d4ef895a3a31700a3ceda: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:04.934348 12403 tablet_bootstrap.cc:492] T eae35f426727445fbe1fec19ecbb404e P 4faec0de5498412e82651186407fd5f9: Bootstrap starting.
I20240502 01:58:04.935760 12404 tablet_bootstrap.cc:492] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b: No bootstrap required, opened a new log
I20240502 01:58:04.935766 12405 tablet_bootstrap.cc:492] T eae35f426727445fbe1fec19ecbb404e P 75c71b0d609d4ef895a3a31700a3ceda: No bootstrap required, opened a new log
I20240502 01:58:04.935926 12404 ts_tablet_manager.cc:1367] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 01:58:04.935927 12405 ts_tablet_manager.cc:1367] T eae35f426727445fbe1fec19ecbb404e P 75c71b0d609d4ef895a3a31700a3ceda: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240502 01:58:04.936630 12403 tablet_bootstrap.cc:654] T eae35f426727445fbe1fec19ecbb404e P 4faec0de5498412e82651186407fd5f9: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:04.937407 12403 log.cc:824] T eae35f426727445fbe1fec19ecbb404e P 4faec0de5498412e82651186407fd5f9: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:04.939010 12404 raft_consensus.cc:348] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4faec0de5498412e82651186407fd5f9" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 35189 } } peers { permanent_uuid: "c9140532f22b423ca931f20ed5222c5b" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38609 } } peers { permanent_uuid: "75c71b0d609d4ef895a3a31700a3ceda" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45929 } }
I20240502 01:58:04.939193 12404 raft_consensus.cc:374] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:04.939226 12403 tablet_bootstrap.cc:492] T eae35f426727445fbe1fec19ecbb404e P 4faec0de5498412e82651186407fd5f9: No bootstrap required, opened a new log
I20240502 01:58:04.939251 12404 raft_consensus.cc:729] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9140532f22b423ca931f20ed5222c5b, State: Initialized, Role: FOLLOWER
I20240502 01:58:04.939390 12403 ts_tablet_manager.cc:1367] T eae35f426727445fbe1fec19ecbb404e P 4faec0de5498412e82651186407fd5f9: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:58:04.939667 12404 consensus_queue.cc:260] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4faec0de5498412e82651186407fd5f9" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 35189 } } peers { permanent_uuid: "c9140532f22b423ca931f20ed5222c5b" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38609 } } peers { permanent_uuid: "75c71b0d609d4ef895a3a31700a3ceda" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45929 } }
I20240502 01:58:04.939605 12405 raft_consensus.cc:348] T eae35f426727445fbe1fec19ecbb404e P 75c71b0d609d4ef895a3a31700a3ceda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4faec0de5498412e82651186407fd5f9" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 35189 } } peers { permanent_uuid: "c9140532f22b423ca931f20ed5222c5b" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38609 } } peers { permanent_uuid: "75c71b0d609d4ef895a3a31700a3ceda" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45929 } }
I20240502 01:58:04.939785 12405 raft_consensus.cc:374] T eae35f426727445fbe1fec19ecbb404e P 75c71b0d609d4ef895a3a31700a3ceda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:04.939841 12405 raft_consensus.cc:729] T eae35f426727445fbe1fec19ecbb404e P 75c71b0d609d4ef895a3a31700a3ceda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75c71b0d609d4ef895a3a31700a3ceda, State: Initialized, Role: FOLLOWER
I20240502 01:58:04.940255 12405 consensus_queue.cc:260] T eae35f426727445fbe1fec19ecbb404e P 75c71b0d609d4ef895a3a31700a3ceda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4faec0de5498412e82651186407fd5f9" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 35189 } } peers { permanent_uuid: "c9140532f22b423ca931f20ed5222c5b" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38609 } } peers { permanent_uuid: "75c71b0d609d4ef895a3a31700a3ceda" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45929 } }
I20240502 01:58:04.940492 12404 ts_tablet_manager.cc:1398] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20240502 01:58:04.940851 12251 heartbeater.cc:503] Master 127.10.133.254:41945 was elected leader, sending a full tablet report...
I20240502 01:58:04.941131 12405 ts_tablet_manager.cc:1398] T eae35f426727445fbe1fec19ecbb404e P 75c71b0d609d4ef895a3a31700a3ceda: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20240502 01:58:04.941463 12385 heartbeater.cc:503] Master 127.10.133.254:41945 was elected leader, sending a full tablet report...
I20240502 01:58:04.943048 12403 raft_consensus.cc:348] T eae35f426727445fbe1fec19ecbb404e P 4faec0de5498412e82651186407fd5f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4faec0de5498412e82651186407fd5f9" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 35189 } } peers { permanent_uuid: "c9140532f22b423ca931f20ed5222c5b" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38609 } } peers { permanent_uuid: "75c71b0d609d4ef895a3a31700a3ceda" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45929 } }
I20240502 01:58:04.943259 12403 raft_consensus.cc:374] T eae35f426727445fbe1fec19ecbb404e P 4faec0de5498412e82651186407fd5f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:04.943306 12403 raft_consensus.cc:729] T eae35f426727445fbe1fec19ecbb404e P 4faec0de5498412e82651186407fd5f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4faec0de5498412e82651186407fd5f9, State: Initialized, Role: FOLLOWER
I20240502 01:58:04.943734 12403 consensus_queue.cc:260] T eae35f426727445fbe1fec19ecbb404e P 4faec0de5498412e82651186407fd5f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4faec0de5498412e82651186407fd5f9" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 35189 } } peers { permanent_uuid: "c9140532f22b423ca931f20ed5222c5b" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38609 } } peers { permanent_uuid: "75c71b0d609d4ef895a3a31700a3ceda" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45929 } }
I20240502 01:58:04.944526 11983 heartbeater.cc:503] Master 127.10.133.254:41945 was elected leader, sending a full tablet report...
I20240502 01:58:04.944604 12403 ts_tablet_manager.cc:1398] T eae35f426727445fbe1fec19ecbb404e P 4faec0de5498412e82651186407fd5f9: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20240502 01:58:04.996515 12409 raft_consensus.cc:482] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:04.996716 12409 raft_consensus.cc:504] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4faec0de5498412e82651186407fd5f9" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 35189 } } peers { permanent_uuid: "c9140532f22b423ca931f20ed5222c5b" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38609 } } peers { permanent_uuid: "75c71b0d609d4ef895a3a31700a3ceda" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45929 } }
I20240502 01:58:04.997794 12409 leader_election.cc:288] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4faec0de5498412e82651186407fd5f9 (127.10.133.194:35189), 75c71b0d609d4ef895a3a31700a3ceda (127.10.133.197:45929)
I20240502 01:58:05.001545 11936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eae35f426727445fbe1fec19ecbb404e" candidate_uuid: "c9140532f22b423ca931f20ed5222c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4faec0de5498412e82651186407fd5f9" is_pre_election: true
I20240502 01:58:05.001545 12338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eae35f426727445fbe1fec19ecbb404e" candidate_uuid: "c9140532f22b423ca931f20ed5222c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75c71b0d609d4ef895a3a31700a3ceda" is_pre_election: true
I20240502 01:58:05.001864 12338 raft_consensus.cc:2454] T eae35f426727445fbe1fec19ecbb404e P 75c71b0d609d4ef895a3a31700a3ceda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9140532f22b423ca931f20ed5222c5b in term 0.
I20240502 01:58:05.001864 11936 raft_consensus.cc:2454] T eae35f426727445fbe1fec19ecbb404e P 4faec0de5498412e82651186407fd5f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9140532f22b423ca931f20ed5222c5b in term 0.
I20240502 01:58:05.002384 12138 leader_election.cc:302] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4faec0de5498412e82651186407fd5f9, c9140532f22b423ca931f20ed5222c5b; no voters:
I20240502 01:58:05.002693 12409 raft_consensus.cc:2781] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:05.002784 12409 raft_consensus.cc:482] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:05.002853 12409 raft_consensus.cc:3037] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:05.003768 12409 raft_consensus.cc:504] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4faec0de5498412e82651186407fd5f9" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 35189 } } peers { permanent_uuid: "c9140532f22b423ca931f20ed5222c5b" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38609 } } peers { permanent_uuid: "75c71b0d609d4ef895a3a31700a3ceda" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45929 } }
I20240502 01:58:05.004122 12409 leader_election.cc:288] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b [CANDIDATE]: Term 1 election: Requested vote from peers 4faec0de5498412e82651186407fd5f9 (127.10.133.194:35189), 75c71b0d609d4ef895a3a31700a3ceda (127.10.133.197:45929)
I20240502 01:58:05.004493 11936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eae35f426727445fbe1fec19ecbb404e" candidate_uuid: "c9140532f22b423ca931f20ed5222c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4faec0de5498412e82651186407fd5f9"
I20240502 01:58:05.004560 12338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eae35f426727445fbe1fec19ecbb404e" candidate_uuid: "c9140532f22b423ca931f20ed5222c5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75c71b0d609d4ef895a3a31700a3ceda"
I20240502 01:58:05.004618 11936 raft_consensus.cc:3037] T eae35f426727445fbe1fec19ecbb404e P 4faec0de5498412e82651186407fd5f9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:05.004710 12338 raft_consensus.cc:3037] T eae35f426727445fbe1fec19ecbb404e P 75c71b0d609d4ef895a3a31700a3ceda [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:05.005563 11936 raft_consensus.cc:2454] T eae35f426727445fbe1fec19ecbb404e P 4faec0de5498412e82651186407fd5f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9140532f22b423ca931f20ed5222c5b in term 1.
I20240502 01:58:05.005692 12338 raft_consensus.cc:2454] T eae35f426727445fbe1fec19ecbb404e P 75c71b0d609d4ef895a3a31700a3ceda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9140532f22b423ca931f20ed5222c5b in term 1.
I20240502 01:58:05.005925 12138 leader_election.cc:302] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4faec0de5498412e82651186407fd5f9, c9140532f22b423ca931f20ed5222c5b; no voters:
I20240502 01:58:05.006108 12409 raft_consensus.cc:2781] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:05.006337 12409 raft_consensus.cc:686] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b [term 1 LEADER]: Becoming Leader. State: Replica: c9140532f22b423ca931f20ed5222c5b, State: Running, Role: LEADER
I20240502 01:58:05.006660 12409 consensus_queue.cc:237] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4faec0de5498412e82651186407fd5f9" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 35189 } } peers { permanent_uuid: "c9140532f22b423ca931f20ed5222c5b" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38609 } } peers { permanent_uuid: "75c71b0d609d4ef895a3a31700a3ceda" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45929 } }
I20240502 01:58:05.009673 11660 catalog_manager.cc:5484] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b reported cstate change: term changed from 0 to 1, leader changed from <none> to c9140532f22b423ca931f20ed5222c5b (127.10.133.196). New cstate: current_term: 1 leader_uuid: "c9140532f22b423ca931f20ed5222c5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4faec0de5498412e82651186407fd5f9" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9140532f22b423ca931f20ed5222c5b" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75c71b0d609d4ef895a3a31700a3ceda" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45929 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:05.018913 10775 external_mini_cluster.cc:930] 5 TS(s) registered with all masters
I20240502 01:58:05.020643 10775 ts_itest-base.cc:233] Waiting for 0 tablets on tserver 76f68b09b4db4e068c0bd1abce5d6964 to finish bootstrapping
I20240502 01:58:05.026408 10775 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 4faec0de5498412e82651186407fd5f9 to finish bootstrapping
I20240502 01:58:05.031309 10775 ts_itest-base.cc:233] Waiting for 0 tablets on tserver 1e769afe267e4a2e9a458b8518359416 to finish bootstrapping
I20240502 01:58:05.036712 10775 ts_itest-base.cc:233] Waiting for 1 tablets on tserver c9140532f22b423ca931f20ed5222c5b to finish bootstrapping
I20240502 01:58:05.041136 10775 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 75c71b0d609d4ef895a3a31700a3ceda to finish bootstrapping
W20240502 01:58:05.078171 11984 tablet.cc:2369] T eae35f426727445fbe1fec19ecbb404e P 4faec0de5498412e82651186407fd5f9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 01:58:05.125150 12386 tablet.cc:2369] T eae35f426727445fbe1fec19ecbb404e P 75c71b0d609d4ef895a3a31700a3ceda: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 01:58:05.153009 11850 heartbeater.cc:503] Master 127.10.133.254:41945 was elected leader, sending a full tablet report...
W20240502 01:58:05.176733 12252 tablet.cc:2369] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 01:58:05.233443 11784 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.233492 12318 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.233616 12049 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.234248 11916 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.257311 12183 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:58:05.331437 11784 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.332406 11916 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.332406 12318 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.335506 12049 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.353816 12183 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:58:05.446926 12318 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.447371 12049 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.449313 11916 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.450883 12183 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:58:05.458498 11784 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.472600 12409 consensus_queue.cc:1035] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4faec0de5498412e82651186407fd5f9" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:05.479648 12519 consensus_queue.cc:1035] T eae35f426727445fbe1fec19ecbb404e P c9140532f22b423ca931f20ed5222c5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "75c71b0d609d4ef895a3a31700a3ceda" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:05.503922 12117 heartbeater.cc:503] Master 127.10.133.254:41945 was elected leader, sending a full tablet report...
I20240502 01:58:05.665915 12049 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.666285 12318 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.666760 12183 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:58:05.667860 11916 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.672202 11784 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.759495 12318 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.761104 12049 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.761452 12183 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:58:05.761471 11916 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.771939 11784 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.871707 12049 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.872377 11784 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.872803 11916 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.884459 12183 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:58:05.894091 12318 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:05.921751 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 11721
I20240502 01:58:05.928483 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 11853
I20240502 01:58:05.934845 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 11986
I20240502 01:58:05.940418 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 12120
I20240502 01:58:05.946300 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 12254
I20240502 01:58:05.952315 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 11630
2024-05-02T01:58:05Z chronyd exiting
[ OK ] RebalanceStartSafetyTest.TooManyIgnoredTservers/1 (2256 ms)
[----------] 1 test from RebalanceStartSafetyTest (2256 ms total)
[----------] 1 test from RebalanceParamTest
[ RUN ] RebalanceParamTest.Rebalance/7
I20240502 01:58:05.975559 10775 test_util.cc:268] Using random seed: -283097086
I20240502 01:58:05.976303 10775 ts_itest-base.cc:112] Starting cluster with:
I20240502 01:58:05.976347 10775 ts_itest-base.cc:113] --------------
I20240502 01:58:05.976359 10775 ts_itest-base.cc:114] 7 tablet servers
I20240502 01:58:05.976369 10775 ts_itest-base.cc:115] 5 replicas per TS
I20240502 01:58:05.976387 10775 ts_itest-base.cc:116] --------------
2024-05-02T01:58:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T01:58:05Z Disabled control of system clock
I20240502 01:58:05.984541 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.133.254:41317
--webserver_interface=127.10.133.254
--webserver_port=0
--builtin_ntp_servers=127.10.133.212:37675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.133.254:41317
--allow_unsafe_replication_factor
--enable_range_replica_placement=false
--raft_prepare_replacement_before_eviction=true
--tserver_unresponsive_timeout_ms=3000 with env {}
W20240502 01:58:06.089385 12631 flags.cc:425] Enabled unsafe flag: --allow_unsafe_replication_factor=true
W20240502 01:58:06.089632 12631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:06.089701 12631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:06.089771 12631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:06.092757 12631 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:06.092840 12631 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 01:58:06.092885 12631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:06.092921 12631 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 01:58:06.092962 12631 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 01:58:06.096614 12631 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:37675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
--allow_unsafe_replication_factor=true
--enable_range_replica_placement=false
--ipki_ca_key_size=768
--master_addresses=127.10.133.254:41317
--tserver_unresponsive_timeout_ms=3000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.133.254:41317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.133.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.12631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:06.097573 12631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:06.098757 12631 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:06.105500 12637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:06.105939 12636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:06.106424 12639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:06.107194 12631 server_base.cc:1034] running on GCE node
I20240502 01:58:06.107683 12631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:06.108568 12631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:06.109716 12631 hybrid_clock.cc:648] HybridClock initialized: now 1714615086109704 us; error 27 us; skew 500 ppm
I20240502 01:58:06.111439 12631 webserver.cc:460] Webserver started at http://127.10.133.254:38531/ using document root <none> and password file <none>
I20240502 01:58:06.111971 12631 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:06.112039 12631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:06.112226 12631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:06.113788 12631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "cbd2873c124c4aadb8dc3e7d69935b04"
format_stamp: "Formatted at 2024-05-02 01:58:06 on dist-test-slave-dr9f"
I20240502 01:58:06.114256 12631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "cbd2873c124c4aadb8dc3e7d69935b04"
format_stamp: "Formatted at 2024-05-02 01:58:06 on dist-test-slave-dr9f"
I20240502 01:58:06.117432 12631 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:06.119552 12645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:06.120494 12631 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20240502 01:58:06.120613 12631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
uuid: "cbd2873c124c4aadb8dc3e7d69935b04"
format_stamp: "Formatted at 2024-05-02 01:58:06 on dist-test-slave-dr9f"
I20240502 01:58:06.120689 12631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:06.134508 12631 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:06.135076 12631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:06.135226 12631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:06.141762 12631 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.254:41317
I20240502 01:58:06.141769 12698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.254:41317 every 8 connection(s)
I20240502 01:58:06.142706 12631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20240502 01:58:06.145130 12699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:06.149650 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 12631
I20240502 01:58:06.149765 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal/instance
I20240502 01:58:06.149924 12699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04: Bootstrap starting.
I20240502 01:58:06.152104 12699 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:06.152776 12699 log.cc:824] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:06.154203 12699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04: No bootstrap required, opened a new log
I20240502 01:58:06.156723 12699 raft_consensus.cc:348] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd2873c124c4aadb8dc3e7d69935b04" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 41317 } }
I20240502 01:58:06.156888 12699 raft_consensus.cc:374] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:06.156949 12699 raft_consensus.cc:729] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd2873c124c4aadb8dc3e7d69935b04, State: Initialized, Role: FOLLOWER
I20240502 01:58:06.157336 12699 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd2873c124c4aadb8dc3e7d69935b04" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 41317 } }
I20240502 01:58:06.157454 12699 raft_consensus.cc:388] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:58:06.157519 12699 raft_consensus.cc:482] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:58:06.157629 12699 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:06.158375 12699 raft_consensus.cc:504] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd2873c124c4aadb8dc3e7d69935b04" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 41317 } }
I20240502 01:58:06.158684 12699 leader_election.cc:302] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cbd2873c124c4aadb8dc3e7d69935b04; no voters:
I20240502 01:58:06.158911 12699 leader_election.cc:288] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:58:06.159258 12704 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:06.159442 12704 raft_consensus.cc:686] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04 [term 1 LEADER]: Becoming Leader. State: Replica: cbd2873c124c4aadb8dc3e7d69935b04, State: Running, Role: LEADER
I20240502 01:58:06.159703 12704 consensus_queue.cc:237] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd2873c124c4aadb8dc3e7d69935b04" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 41317 } }
I20240502 01:58:06.159838 12699 sys_catalog.cc:564] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 01:58:06.161000 12705 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cbd2873c124c4aadb8dc3e7d69935b04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd2873c124c4aadb8dc3e7d69935b04" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 41317 } } }
I20240502 01:58:06.161113 12705 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04 [sys.catalog]: This master's current role is: LEADER
I20240502 01:58:06.161067 12706 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbd2873c124c4aadb8dc3e7d69935b04. Latest consensus state: current_term: 1 leader_uuid: "cbd2873c124c4aadb8dc3e7d69935b04" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbd2873c124c4aadb8dc3e7d69935b04" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 41317 } } }
I20240502 01:58:06.161175 12706 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04 [sys.catalog]: This master's current role is: LEADER
I20240502 01:58:06.161453 12713 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 01:58:06.164044 12713 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 01:58:06.168399 12713 catalog_manager.cc:1347] Generated new cluster ID: 772364c7505a4dbab933808be33bc549
I20240502 01:58:06.168464 12713 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 01:58:06.185091 12713 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 01:58:06.186086 12713 catalog_manager.cc:1504] Loading token signing keys...
I20240502 01:58:06.194021 12713 catalog_manager.cc:5857] T 00000000000000000000000000000000 P cbd2873c124c4aadb8dc3e7d69935b04: Generated new TSK 0
I20240502 01:58:06.194646 12713 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 01:58:06.203254 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.193:0
--local_ip_for_outbound_sockets=127.10.133.193
--webserver_interface=127.10.133.193
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41317
--builtin_ntp_servers=127.10.133.212:37675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 01:58:06.313758 12723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:06.313952 12723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:06.314024 12723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:06.317004 12723 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:06.317059 12723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:06.317140 12723 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.193
I20240502 01:58:06.322074 12723 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:37675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.133.193
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41317
--never_fsync=true
--heap_profile_path=/tmp/kudu.12723
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.193
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:06.323184 12723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:06.324615 12723 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:06.333166 12731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:06.333627 12729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:06.334308 12728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:06.334975 12723 server_base.cc:1034] running on GCE node
I20240502 01:58:06.335336 12723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:06.335867 12723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:06.337011 12723 hybrid_clock.cc:648] HybridClock initialized: now 1714615086336987 us; error 35 us; skew 500 ppm
I20240502 01:58:06.338698 12723 webserver.cc:460] Webserver started at http://127.10.133.193:43027/ using document root <none> and password file <none>
I20240502 01:58:06.339231 12723 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:06.339288 12723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:06.339468 12723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:06.341054 12723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "27e2acacdad14caa8f66bc81fa8a2f88"
format_stamp: "Formatted at 2024-05-02 01:58:06 on dist-test-slave-dr9f"
I20240502 01:58:06.341511 12723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "27e2acacdad14caa8f66bc81fa8a2f88"
format_stamp: "Formatted at 2024-05-02 01:58:06 on dist-test-slave-dr9f"
I20240502 01:58:06.344565 12723 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 01:58:06.346573 12737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:06.347467 12723 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:06.347576 12723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "27e2acacdad14caa8f66bc81fa8a2f88"
format_stamp: "Formatted at 2024-05-02 01:58:06 on dist-test-slave-dr9f"
I20240502 01:58:06.347659 12723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:06.364714 12723 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:06.365252 12723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:06.365398 12723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:06.365881 12723 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:06.366708 12723 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:06.366757 12723 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:06.366822 12723 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:06.366851 12723 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:06.374703 12723 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.193:46263
I20240502 01:58:06.374758 12850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.193:46263 every 8 connection(s)
I20240502 01:58:06.375572 12723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20240502 01:58:06.378724 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 12723
I20240502 01:58:06.378834 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20240502 01:58:06.380816 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.194:0
--local_ip_for_outbound_sockets=127.10.133.194
--webserver_interface=127.10.133.194
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41317
--builtin_ntp_servers=127.10.133.212:37675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:58:06.383936 12851 heartbeater.cc:347] Connected to a master server at 127.10.133.254:41317
I20240502 01:58:06.384127 12851 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:06.384577 12851 heartbeater.cc:511] Master 127.10.133.254:41317 requested a full tablet report, sending...
I20240502 01:58:06.385886 12662 ts_manager.cc:194] Registered new tserver with Master: 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263)
I20240502 01:58:06.387146 12662 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.193:48489
W20240502 01:58:06.483621 12854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:06.483819 12854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:06.483860 12854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:06.486816 12854 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:06.486873 12854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:06.486963 12854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.194
I20240502 01:58:06.490407 12854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:37675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.133.194
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41317
--never_fsync=true
--heap_profile_path=/tmp/kudu.12854
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.194
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:06.491236 12854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:06.492347 12854 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:06.500010 12859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:06.500113 12860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:06.500716 12862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:06.501350 12854 server_base.cc:1034] running on GCE node
I20240502 01:58:06.501646 12854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:06.502151 12854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:06.503285 12854 hybrid_clock.cc:648] HybridClock initialized: now 1714615086503269 us; error 29 us; skew 500 ppm
I20240502 01:58:06.504858 12854 webserver.cc:460] Webserver started at http://127.10.133.194:45553/ using document root <none> and password file <none>
I20240502 01:58:06.505350 12854 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:06.505410 12854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:06.505576 12854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:06.507135 12854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "42bc78875b454c7ab7fce86d56a28c1e"
format_stamp: "Formatted at 2024-05-02 01:58:06 on dist-test-slave-dr9f"
I20240502 01:58:06.507589 12854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "42bc78875b454c7ab7fce86d56a28c1e"
format_stamp: "Formatted at 2024-05-02 01:58:06 on dist-test-slave-dr9f"
I20240502 01:58:06.510614 12854 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 01:58:06.512594 12868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:06.513489 12854 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:06.513590 12854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "42bc78875b454c7ab7fce86d56a28c1e"
format_stamp: "Formatted at 2024-05-02 01:58:06 on dist-test-slave-dr9f"
I20240502 01:58:06.513665 12854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:06.533000 12854 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:06.533528 12854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:06.533670 12854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:06.534166 12854 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:06.534971 12854 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:06.535019 12854 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:06.535072 12854 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:06.535104 12854 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:06.543000 12854 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.194:40143
I20240502 01:58:06.543026 12984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.194:40143 every 8 connection(s)
I20240502 01:58:06.543808 12854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20240502 01:58:06.545998 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 12854
I20240502 01:58:06.546116 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20240502 01:58:06.548365 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.195:0
--local_ip_for_outbound_sockets=127.10.133.195
--webserver_interface=127.10.133.195
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41317
--builtin_ntp_servers=127.10.133.212:37675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:58:06.552556 12985 heartbeater.cc:347] Connected to a master server at 127.10.133.254:41317
I20240502 01:58:06.552747 12985 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:06.553201 12985 heartbeater.cc:511] Master 127.10.133.254:41317 requested a full tablet report, sending...
I20240502 01:58:06.554150 12662 ts_manager.cc:194] Registered new tserver with Master: 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143)
I20240502 01:58:06.554682 12662 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.194:46331
W20240502 01:58:06.651438 12988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:06.651645 12988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:06.651715 12988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:06.654706 12988 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:06.654772 12988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:06.654865 12988 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.195
I20240502 01:58:06.658264 12988 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:37675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.133.195
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41317
--never_fsync=true
--heap_profile_path=/tmp/kudu.12988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.195
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:06.659060 12988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:06.660126 12988 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:06.667649 12993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:06.668200 12994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:06.668646 12996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:06.669160 12988 server_base.cc:1034] running on GCE node
I20240502 01:58:06.669443 12988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:06.669895 12988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:06.671051 12988 hybrid_clock.cc:648] HybridClock initialized: now 1714615086671041 us; error 23 us; skew 500 ppm
I20240502 01:58:06.672731 12988 webserver.cc:460] Webserver started at http://127.10.133.195:42421/ using document root <none> and password file <none>
I20240502 01:58:06.673225 12988 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:06.673277 12988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:06.673444 12988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:06.675042 12988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "71010353c29d4e988704295c8cd73ef7"
format_stamp: "Formatted at 2024-05-02 01:58:06 on dist-test-slave-dr9f"
I20240502 01:58:06.675494 12988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "71010353c29d4e988704295c8cd73ef7"
format_stamp: "Formatted at 2024-05-02 01:58:06 on dist-test-slave-dr9f"
I20240502 01:58:06.678627 12988 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20240502 01:58:06.680692 13002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:06.681623 12988 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240502 01:58:06.681726 12988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "71010353c29d4e988704295c8cd73ef7"
format_stamp: "Formatted at 2024-05-02 01:58:06 on dist-test-slave-dr9f"
I20240502 01:58:06.681807 12988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:06.705528 12988 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:06.706163 12988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:06.706311 12988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:06.706821 12988 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:06.707654 12988 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:06.707703 12988 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:06.707759 12988 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:06.707789 12988 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:06.715946 12988 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.195:33887
I20240502 01:58:06.715986 13119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.195:33887 every 8 connection(s)
I20240502 01:58:06.716850 12988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20240502 01:58:06.723928 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 12988
I20240502 01:58:06.724030 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20240502 01:58:06.724684 13120 heartbeater.cc:347] Connected to a master server at 127.10.133.254:41317
I20240502 01:58:06.724898 13120 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:06.725430 13120 heartbeater.cc:511] Master 127.10.133.254:41317 requested a full tablet report, sending...
I20240502 01:58:06.726061 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.196:0
--local_ip_for_outbound_sockets=127.10.133.196
--webserver_interface=127.10.133.196
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41317
--builtin_ntp_servers=127.10.133.212:37675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:58:06.726387 12662 ts_manager.cc:194] Registered new tserver with Master: 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887)
I20240502 01:58:06.727100 12662 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.195:52939
W20240502 01:58:06.829246 13123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:06.829435 13123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:06.829480 13123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:06.832511 13123 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:06.832577 13123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:06.832664 13123 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.196
I20240502 01:58:06.836203 13123 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:37675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.196:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.10.133.196
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41317
--never_fsync=true
--heap_profile_path=/tmp/kudu.13123
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.196
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:06.837030 13123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:06.838095 13123 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:06.845607 13128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:06.846105 13129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:06.846556 13131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:06.847254 13123 server_base.cc:1034] running on GCE node
I20240502 01:58:06.847596 13123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:06.848104 13123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:06.849262 13123 hybrid_clock.cc:648] HybridClock initialized: now 1714615086849237 us; error 46 us; skew 500 ppm
I20240502 01:58:06.851027 13123 webserver.cc:460] Webserver started at http://127.10.133.196:34343/ using document root <none> and password file <none>
I20240502 01:58:06.851640 13123 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:06.851707 13123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:06.851894 13123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:06.853509 13123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "3d7bf587aa5a49eb92c3a53d17717149"
format_stamp: "Formatted at 2024-05-02 01:58:06 on dist-test-slave-dr9f"
I20240502 01:58:06.853961 13123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "3d7bf587aa5a49eb92c3a53d17717149"
format_stamp: "Formatted at 2024-05-02 01:58:06 on dist-test-slave-dr9f"
I20240502 01:58:06.857319 13123 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:06.859361 13138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:06.860356 13123 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:06.860451 13123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "3d7bf587aa5a49eb92c3a53d17717149"
format_stamp: "Formatted at 2024-05-02 01:58:06 on dist-test-slave-dr9f"
I20240502 01:58:06.860541 13123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:06.876180 13123 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:06.876796 13123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:06.876921 13123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:06.877367 13123 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:06.878250 13123 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:06.878296 13123 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:06.878333 13123 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:06.878353 13123 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:06.886772 13123 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.196:32825
I20240502 01:58:06.886813 13254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.196:32825 every 8 connection(s)
I20240502 01:58:06.887703 13123 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20240502 01:58:06.891211 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 13123
I20240502 01:58:06.891335 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20240502 01:58:06.893224 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.197:0
--local_ip_for_outbound_sockets=127.10.133.197
--webserver_interface=127.10.133.197
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41317
--builtin_ntp_servers=127.10.133.212:37675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:58:06.896144 13255 heartbeater.cc:347] Connected to a master server at 127.10.133.254:41317
I20240502 01:58:06.896348 13255 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:06.896852 13255 heartbeater.cc:511] Master 127.10.133.254:41317 requested a full tablet report, sending...
I20240502 01:58:06.897876 12662 ts_manager.cc:194] Registered new tserver with Master: 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825)
I20240502 01:58:06.898725 12662 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.196:52497
W20240502 01:58:06.996966 13258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:06.997166 13258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:06.997227 13258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:07.000175 13258 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:07.000234 13258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:07.000298 13258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.197
I20240502 01:58:07.003762 13258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:37675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.197:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.10.133.197
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41317
--never_fsync=true
--heap_profile_path=/tmp/kudu.13258
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.197
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:07.004603 13258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:07.005632 13258 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:07.013564 13263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:07.013758 13266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:07.014293 13264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:07.014961 13258 server_base.cc:1034] running on GCE node
I20240502 01:58:07.015264 13258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:07.015781 13258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:07.016925 13258 hybrid_clock.cc:648] HybridClock initialized: now 1714615087016902 us; error 39 us; skew 500 ppm
I20240502 01:58:07.018839 13258 webserver.cc:460] Webserver started at http://127.10.133.197:43047/ using document root <none> and password file <none>
I20240502 01:58:07.019380 13258 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:07.019441 13258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:07.019623 13258 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:07.021184 13258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "6b1e63d6b84a440a8864db2d36b57665"
format_stamp: "Formatted at 2024-05-02 01:58:07 on dist-test-slave-dr9f"
I20240502 01:58:07.021631 13258 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "6b1e63d6b84a440a8864db2d36b57665"
format_stamp: "Formatted at 2024-05-02 01:58:07 on dist-test-slave-dr9f"
I20240502 01:58:07.024798 13258 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 01:58:07.026857 13272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:07.027783 13258 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:07.027891 13258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "6b1e63d6b84a440a8864db2d36b57665"
format_stamp: "Formatted at 2024-05-02 01:58:07 on dist-test-slave-dr9f"
I20240502 01:58:07.027967 13258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:07.050226 13258 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:07.050818 13258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:07.050957 13258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:07.051483 13258 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:07.052400 13258 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:07.052459 13258 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:07.052518 13258 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:07.052549 13258 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:07.060356 13258 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.197:42283
I20240502 01:58:07.060377 13387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.197:42283 every 8 connection(s)
I20240502 01:58:07.061272 13258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20240502 01:58:07.068850 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 13258
I20240502 01:58:07.068979 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20240502 01:58:07.069439 13388 heartbeater.cc:347] Connected to a master server at 127.10.133.254:41317
I20240502 01:58:07.069648 13388 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:07.070129 13388 heartbeater.cc:511] Master 127.10.133.254:41317 requested a full tablet report, sending...
I20240502 01:58:07.070892 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.198:0
--local_ip_for_outbound_sockets=127.10.133.198
--webserver_interface=127.10.133.198
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41317
--builtin_ntp_servers=127.10.133.212:37675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:58:07.071043 12662 ts_manager.cc:194] Registered new tserver with Master: 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283)
I20240502 01:58:07.071616 12662 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.197:47979
W20240502 01:58:07.177124 13391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:07.177315 13391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:07.177382 13391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:07.180305 13391 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:07.180361 13391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:07.180454 13391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.198
I20240502 01:58:07.183825 13391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:37675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.198:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.10.133.198
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41317
--never_fsync=true
--heap_profile_path=/tmp/kudu.13391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.198
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:07.184669 13391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:07.185743 13391 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:07.193604 13397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:07.193832 13399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:07.194362 13396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:07.194890 13391 server_base.cc:1034] running on GCE node
I20240502 01:58:07.195211 13391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:07.195708 13391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:07.196864 13391 hybrid_clock.cc:648] HybridClock initialized: now 1714615087196853 us; error 24 us; skew 500 ppm
I20240502 01:58:07.198520 13391 webserver.cc:460] Webserver started at http://127.10.133.198:39573/ using document root <none> and password file <none>
I20240502 01:58:07.199021 13391 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:07.199071 13391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:07.199239 13391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:07.200749 13391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/instance:
uuid: "1928367ae8d64ba49a7f5761b2d3dc4a"
format_stamp: "Formatted at 2024-05-02 01:58:07 on dist-test-slave-dr9f"
I20240502 01:58:07.201221 13391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal/instance:
uuid: "1928367ae8d64ba49a7f5761b2d3dc4a"
format_stamp: "Formatted at 2024-05-02 01:58:07 on dist-test-slave-dr9f"
I20240502 01:58:07.204305 13391 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20240502 01:58:07.206426 13405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:07.207371 13391 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:07.207460 13391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "1928367ae8d64ba49a7f5761b2d3dc4a"
format_stamp: "Formatted at 2024-05-02 01:58:07 on dist-test-slave-dr9f"
I20240502 01:58:07.207551 13391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:07.224537 13391 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:07.225121 13391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:07.225262 13391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:07.225736 13391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:07.226583 13391 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:07.226627 13391 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:07.226683 13391 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:07.226709 13391 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:07.234833 13391 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.198:39759
I20240502 01:58:07.234875 13520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.198:39759 every 8 connection(s)
I20240502 01:58:07.235692 13391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/info.pb
I20240502 01:58:07.236099 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 13391
I20240502 01:58:07.236209 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal/instance
I20240502 01:58:07.238516 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.199:0
--local_ip_for_outbound_sockets=127.10.133.199
--webserver_interface=127.10.133.199
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41317
--builtin_ntp_servers=127.10.133.212:37675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:58:07.244134 13521 heartbeater.cc:347] Connected to a master server at 127.10.133.254:41317
I20240502 01:58:07.244336 13521 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:07.244827 13521 heartbeater.cc:511] Master 127.10.133.254:41317 requested a full tablet report, sending...
I20240502 01:58:07.245780 12662 ts_manager.cc:194] Registered new tserver with Master: 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759)
I20240502 01:58:07.246320 12662 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.198:39157
W20240502 01:58:07.342888 13524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:07.343101 13524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:07.343175 13524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:07.346213 13524 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:07.346285 13524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:07.346381 13524 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.199
I20240502 01:58:07.349970 13524 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:37675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.199:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--webserver_interface=127.10.133.199
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41317
--never_fsync=true
--heap_profile_path=/tmp/kudu.13524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.199
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:07.350880 13524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:07.352030 13524 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:07.359905 13532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:07.360086 13530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:07.360670 13529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:07.361294 13524 server_base.cc:1034] running on GCE node
I20240502 01:58:07.361626 13524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:07.362157 13524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:07.363327 13524 hybrid_clock.cc:648] HybridClock initialized: now 1714615087363313 us; error 24 us; skew 500 ppm
I20240502 01:58:07.365046 13524 webserver.cc:460] Webserver started at http://127.10.133.199:35291/ using document root <none> and password file <none>
I20240502 01:58:07.365561 13524 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:07.365614 13524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:07.365790 13524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:07.367419 13524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/instance:
uuid: "1ef9768a03e545fba961cfeee4c1c867"
format_stamp: "Formatted at 2024-05-02 01:58:07 on dist-test-slave-dr9f"
I20240502 01:58:07.367858 13524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal/instance:
uuid: "1ef9768a03e545fba961cfeee4c1c867"
format_stamp: "Formatted at 2024-05-02 01:58:07 on dist-test-slave-dr9f"
I20240502 01:58:07.370965 13524 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20240502 01:58:07.372920 13538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:07.373821 13524 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20240502 01:58:07.373926 13524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
uuid: "1ef9768a03e545fba961cfeee4c1c867"
format_stamp: "Formatted at 2024-05-02 01:58:07 on dist-test-slave-dr9f"
I20240502 01:58:07.374034 13524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:07.383235 13524 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:07.383783 13524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:07.383917 13524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:07.384370 13524 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:07.385221 13524 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:07.385267 13524 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:07.385310 13524 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:07.385341 13524 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:07.389133 12851 heartbeater.cc:503] Master 127.10.133.254:41317 was elected leader, sending a full tablet report...
I20240502 01:58:07.393612 13524 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.199:34821
I20240502 01:58:07.393659 13654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.199:34821 every 8 connection(s)
I20240502 01:58:07.394495 13524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/info.pb
I20240502 01:58:07.402417 13655 heartbeater.cc:347] Connected to a master server at 127.10.133.254:41317
I20240502 01:58:07.402626 13655 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:07.403113 13655 heartbeater.cc:511] Master 127.10.133.254:41317 requested a full tablet report, sending...
I20240502 01:58:07.403623 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 13524
I20240502 01:58:07.403749 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal/instance
I20240502 01:58:07.404152 12662 ts_manager.cc:194] Registered new tserver with Master: 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199:34821)
I20240502 01:58:07.404809 12662 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.199:51923
I20240502 01:58:07.405931 10775 external_mini_cluster.cc:930] 7 TS(s) registered with all masters
I20240502 01:58:07.414379 12662 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43822:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20240502 01:58:07.433471 13453 tablet_service.cc:1467] Processing CreateTablet for tablet 52775623e580480b83a6148e0b453ae5 (DEFAULT_TABLE table=TestTable [id=844e44214ba04ed5a1c080b35744bee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:07.434530 13453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52775623e580480b83a6148e0b453ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:07.434265 12918 tablet_service.cc:1467] Processing CreateTablet for tablet 52775623e580480b83a6148e0b453ae5 (DEFAULT_TABLE table=TestTable [id=844e44214ba04ed5a1c080b35744bee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:07.435217 12918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52775623e580480b83a6148e0b453ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:07.435797 12785 tablet_service.cc:1467] Processing CreateTablet for tablet 52775623e580480b83a6148e0b453ae5 (DEFAULT_TABLE table=TestTable [id=844e44214ba04ed5a1c080b35744bee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:07.436663 12785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52775623e580480b83a6148e0b453ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:07.437515 13321 tablet_service.cc:1467] Processing CreateTablet for tablet 52775623e580480b83a6148e0b453ae5 (DEFAULT_TABLE table=TestTable [id=844e44214ba04ed5a1c080b35744bee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:07.438369 13321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52775623e580480b83a6148e0b453ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:07.439675 13587 tablet_service.cc:1467] Processing CreateTablet for tablet 52775623e580480b83a6148e0b453ae5 (DEFAULT_TABLE table=TestTable [id=844e44214ba04ed5a1c080b35744bee3]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:07.440500 13587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52775623e580480b83a6148e0b453ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:07.441972 13678 tablet_bootstrap.cc:492] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e: Bootstrap starting.
I20240502 01:58:07.444196 13678 tablet_bootstrap.cc:654] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:07.444794 13679 tablet_bootstrap.cc:492] T 52775623e580480b83a6148e0b453ae5 P 6b1e63d6b84a440a8864db2d36b57665: Bootstrap starting.
I20240502 01:58:07.445037 13678 log.cc:824] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:07.445758 13677 tablet_bootstrap.cc:492] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a: Bootstrap starting.
I20240502 01:58:07.446913 13679 tablet_bootstrap.cc:654] T 52775623e580480b83a6148e0b453ae5 P 6b1e63d6b84a440a8864db2d36b57665: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:07.447679 13679 log.cc:824] T 52775623e580480b83a6148e0b453ae5 P 6b1e63d6b84a440a8864db2d36b57665: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:07.447753 13677 tablet_bootstrap.cc:654] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:07.448246 13678 tablet_bootstrap.cc:492] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e: No bootstrap required, opened a new log
I20240502 01:58:07.448431 13678 ts_tablet_manager.cc:1367] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.004s
I20240502 01:58:07.448490 13677 log.cc:824] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:07.449326 13679 tablet_bootstrap.cc:492] T 52775623e580480b83a6148e0b453ae5 P 6b1e63d6b84a440a8864db2d36b57665: No bootstrap required, opened a new log
I20240502 01:58:07.449482 13679 ts_tablet_manager.cc:1367] T 52775623e580480b83a6148e0b453ae5 P 6b1e63d6b84a440a8864db2d36b57665: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:58:07.450040 13677 tablet_bootstrap.cc:492] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a: No bootstrap required, opened a new log
I20240502 01:58:07.450197 13677 ts_tablet_manager.cc:1367] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:58:07.450453 13681 tablet_bootstrap.cc:492] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap starting.
I20240502 01:58:07.451979 13678 raft_consensus.cc:348] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:07.452724 13678 raft_consensus.cc:374] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:07.452790 13678 raft_consensus.cc:729] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42bc78875b454c7ab7fce86d56a28c1e, State: Initialized, Role: FOLLOWER
I20240502 01:58:07.453279 13678 consensus_queue.cc:260] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:07.453321 13679 raft_consensus.cc:348] T 52775623e580480b83a6148e0b453ae5 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:07.453536 13679 raft_consensus.cc:374] T 52775623e580480b83a6148e0b453ae5 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:07.453601 13679 raft_consensus.cc:729] T 52775623e580480b83a6148e0b453ae5 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1e63d6b84a440a8864db2d36b57665, State: Initialized, Role: FOLLOWER
I20240502 01:58:07.454111 13681 tablet_bootstrap.cc:654] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:07.454056 13679 consensus_queue.cc:260] T 52775623e580480b83a6148e0b453ae5 P 6b1e63d6b84a440a8864db2d36b57665 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:07.454245 13678 ts_tablet_manager.cc:1398] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20240502 01:58:07.454365 13677 raft_consensus.cc:348] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:07.454568 13677 raft_consensus.cc:374] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:07.454624 13677 raft_consensus.cc:729] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1928367ae8d64ba49a7f5761b2d3dc4a, State: Initialized, Role: FOLLOWER
I20240502 01:58:07.454630 12985 heartbeater.cc:503] Master 127.10.133.254:41317 was elected leader, sending a full tablet report...
I20240502 01:58:07.454867 13679 ts_tablet_manager.cc:1398] T 52775623e580480b83a6148e0b453ae5 P 6b1e63d6b84a440a8864db2d36b57665: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20240502 01:58:07.455058 13677 consensus_queue.cc:260] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:07.455197 13388 heartbeater.cc:503] Master 127.10.133.254:41317 was elected leader, sending a full tablet report...
I20240502 01:58:07.455324 13681 log.cc:824] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:07.455859 13677 ts_tablet_manager.cc:1398] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20240502 01:58:07.456199 13521 heartbeater.cc:503] Master 127.10.133.254:41317 was elected leader, sending a full tablet report...
I20240502 01:58:07.457540 13683 tablet_bootstrap.cc:492] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88: Bootstrap starting.
I20240502 01:58:07.457854 13681 tablet_bootstrap.cc:492] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867: No bootstrap required, opened a new log
I20240502 01:58:07.458063 13681 ts_tablet_manager.cc:1367] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.002s
I20240502 01:58:07.459636 13683 tablet_bootstrap.cc:654] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:07.460692 13683 log.cc:824] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:07.461870 13681 raft_consensus.cc:348] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:07.462126 13681 raft_consensus.cc:374] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:07.462188 13681 raft_consensus.cc:729] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef9768a03e545fba961cfeee4c1c867, State: Initialized, Role: FOLLOWER
I20240502 01:58:07.462641 13681 consensus_queue.cc:260] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:07.463279 13655 heartbeater.cc:503] Master 127.10.133.254:41317 was elected leader, sending a full tablet report...
I20240502 01:58:07.463436 13683 tablet_bootstrap.cc:492] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88: No bootstrap required, opened a new log
I20240502 01:58:07.463476 13681 ts_tablet_manager.cc:1398] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20240502 01:58:07.463610 13683 ts_tablet_manager.cc:1367] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240502 01:58:07.467058 13683 raft_consensus.cc:348] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:07.467221 13683 raft_consensus.cc:374] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:07.467269 13683 raft_consensus.cc:729] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Initialized, Role: FOLLOWER
I20240502 01:58:07.467617 13683 consensus_queue.cc:260] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:07.468302 13683 ts_tablet_manager.cc:1398] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20240502 01:58:07.486652 13522 tablet.cc:2369] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 01:58:07.545120 12986 tablet.cc:2369] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 01:58:07.562312 13389 tablet.cc:2369] T 52775623e580480b83a6148e0b453ae5 P 6b1e63d6b84a440a8864db2d36b57665: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 01:58:07.627162 12852 tablet.cc:2369] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 01:58:07.645366 13656 tablet.cc:2369] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 01:58:07.728884 13120 heartbeater.cc:503] Master 127.10.133.254:41317 was elected leader, sending a full tablet report...
I20240502 01:58:07.759611 13691 raft_consensus.cc:482] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:07.759794 13691 raft_consensus.cc:504] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:07.761054 13691 leader_election.cc:288] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759), 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199:34821), 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283), 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143)
I20240502 01:58:07.766604 12938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52775623e580480b83a6148e0b453ae5" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e" is_pre_election: true
I20240502 01:58:07.766613 13341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52775623e580480b83a6148e0b453ae5" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665" is_pre_election: true
I20240502 01:58:07.766618 13607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52775623e580480b83a6148e0b453ae5" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef9768a03e545fba961cfeee4c1c867" is_pre_election: true
I20240502 01:58:07.766928 13607 raft_consensus.cc:2454] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:07.766923 12938 raft_consensus.cc:2454] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:07.766923 13341 raft_consensus.cc:2454] T 52775623e580480b83a6148e0b453ae5 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:07.767314 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52775623e580480b83a6148e0b453ae5" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" is_pre_election: true
I20240502 01:58:07.767396 12741 leader_election.cc:302] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 27e2acacdad14caa8f66bc81fa8a2f88, 42bc78875b454c7ab7fce86d56a28c1e, 6b1e63d6b84a440a8864db2d36b57665; no voters:
I20240502 01:58:07.767567 13473 raft_consensus.cc:2454] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:07.767666 13691 raft_consensus.cc:2781] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:07.767731 13691 raft_consensus.cc:482] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:07.767791 13691 raft_consensus.cc:3037] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:07.768646 13691 raft_consensus.cc:504] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:07.769026 13691 leader_election.cc:288] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 election: Requested vote from peers 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759), 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199:34821), 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283), 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143)
I20240502 01:58:07.769357 13341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52775623e580480b83a6148e0b453ae5" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665"
I20240502 01:58:07.769387 12938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52775623e580480b83a6148e0b453ae5" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e"
I20240502 01:58:07.769471 13607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52775623e580480b83a6148e0b453ae5" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ef9768a03e545fba961cfeee4c1c867"
I20240502 01:58:07.769493 12938 raft_consensus.cc:3037] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:07.769477 13341 raft_consensus.cc:3037] T 52775623e580480b83a6148e0b453ae5 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:07.769471 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52775623e580480b83a6148e0b453ae5" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a"
I20240502 01:58:07.769582 13607 raft_consensus.cc:3037] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:07.769608 13473 raft_consensus.cc:3037] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:07.770550 12938 raft_consensus.cc:2454] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:07.770550 13341 raft_consensus.cc:2454] T 52775623e580480b83a6148e0b453ae5 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:07.770740 13473 raft_consensus.cc:2454] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:07.770740 13607 raft_consensus.cc:2454] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:07.770998 12740 leader_election.cc:302] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1ef9768a03e545fba961cfeee4c1c867, 27e2acacdad14caa8f66bc81fa8a2f88, 42bc78875b454c7ab7fce86d56a28c1e; no voters:
I20240502 01:58:07.771183 13691 raft_consensus.cc:2781] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:07.771407 13691 raft_consensus.cc:686] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Becoming Leader. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Running, Role: LEADER
I20240502 01:58:07.771695 13691 consensus_queue.cc:237] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:07.774976 12662 catalog_manager.cc:5484] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193). New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } }
I20240502 01:58:07.793170 10775 external_mini_cluster.cc:930] 7 TS(s) registered with all masters
I20240502 01:58:07.794517 10775 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 27e2acacdad14caa8f66bc81fa8a2f88 to finish bootstrapping
I20240502 01:58:07.803764 10775 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 42bc78875b454c7ab7fce86d56a28c1e to finish bootstrapping
I20240502 01:58:07.808228 10775 ts_itest-base.cc:233] Waiting for 0 tablets on tserver 71010353c29d4e988704295c8cd73ef7 to finish bootstrapping
I20240502 01:58:07.813555 10775 ts_itest-base.cc:233] Waiting for 0 tablets on tserver 3d7bf587aa5a49eb92c3a53d17717149 to finish bootstrapping
I20240502 01:58:07.818696 10775 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 6b1e63d6b84a440a8864db2d36b57665 to finish bootstrapping
I20240502 01:58:07.823124 10775 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 1928367ae8d64ba49a7f5761b2d3dc4a to finish bootstrapping
I20240502 01:58:07.827083 10775 ts_itest-base.cc:233] Waiting for 1 tablets on tserver 1ef9768a03e545fba961cfeee4c1c867 to finish bootstrapping
I20240502 01:58:07.831045 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 13524
I20240502 01:58:07.900661 13255 heartbeater.cc:503] Master 127.10.133.254:41317 was elected leader, sending a full tablet report...
I20240502 01:58:08.212951 13691 consensus_queue.cc:1035] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240502 01:58:08.214082 12740 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.133.199:34821: connect: Connection refused (error 111)
W20240502 01:58:08.214973 12740 consensus_peers.cc:485] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 -> Peer 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199:34821): Couldn't send request to peer 1ef9768a03e545fba961cfeee4c1c867. Status: Network error: Client connection negotiation failed: client connection to 127.10.133.199:34821: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:08.216454 13696 consensus_queue.cc:1035] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:08.221383 13691 consensus_queue.cc:1035] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240502 01:58:10.738412 12740 consensus_peers.cc:485] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 -> Peer 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199:34821): Couldn't send request to peer 1ef9768a03e545fba961cfeee4c1c867. Status: Network error: Client connection negotiation failed: client connection to 127.10.133.199:34821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20240502 01:58:11.588865 12660 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43822:
name: "rebalance_test_table_0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 01:58:11.595810 12918 tablet_service.cc:1467] Processing CreateTablet for tablet 24d91cbbc7cb4be7a0034613b96ac1cd (DEFAULT_TABLE table=rebalance_test_table_0 [id=87bf6032f2ab4ef8a4f1c2692004f94c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:11.596184 12918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d91cbbc7cb4be7a0034613b96ac1cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:11.596691 12785 tablet_service.cc:1467] Processing CreateTablet for tablet 24d91cbbc7cb4be7a0034613b96ac1cd (DEFAULT_TABLE table=rebalance_test_table_0 [id=87bf6032f2ab4ef8a4f1c2692004f94c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:11.596800 13321 tablet_service.cc:1467] Processing CreateTablet for tablet 24d91cbbc7cb4be7a0034613b96ac1cd (DEFAULT_TABLE table=rebalance_test_table_0 [id=87bf6032f2ab4ef8a4f1c2692004f94c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:11.596982 12785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d91cbbc7cb4be7a0034613b96ac1cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:11.597115 13321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d91cbbc7cb4be7a0034613b96ac1cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:11.598233 13453 tablet_service.cc:1467] Processing CreateTablet for tablet 400199df936243f2b49a4b556f29c575 (DEFAULT_TABLE table=rebalance_test_table_0 [id=87bf6032f2ab4ef8a4f1c2692004f94c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:11.598529 13453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 400199df936243f2b49a4b556f29c575. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:11.599364 13729 tablet_bootstrap.cc:492] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88: Bootstrap starting.
I20240502 01:58:11.599596 13731 tablet_bootstrap.cc:492] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665: Bootstrap starting.
I20240502 01:58:11.600297 13729 tablet_bootstrap.cc:654] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:11.600503 13731 tablet_bootstrap.cc:654] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:11.600486 12918 tablet_service.cc:1467] Processing CreateTablet for tablet 400199df936243f2b49a4b556f29c575 (DEFAULT_TABLE table=rebalance_test_table_0 [id=87bf6032f2ab4ef8a4f1c2692004f94c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:11.600718 12918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 400199df936243f2b49a4b556f29c575. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:11.601058 13452 tablet_service.cc:1467] Processing CreateTablet for tablet 5175c37ef65f4f2fb83d64497592a180 (DEFAULT_TABLE table=rebalance_test_table_0 [id=87bf6032f2ab4ef8a4f1c2692004f94c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:11.601286 13452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5175c37ef65f4f2fb83d64497592a180. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:11.601598 13729 tablet_bootstrap.cc:492] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88: No bootstrap required, opened a new log
I20240502 01:58:11.601676 13729 ts_tablet_manager.cc:1367] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:11.602249 13729 raft_consensus.cc:348] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.602361 13729 raft_consensus.cc:374] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:11.602391 13729 raft_consensus.cc:729] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Initialized, Role: FOLLOWER
I20240502 01:58:11.602509 13729 consensus_queue.cc:260] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.602775 13729 ts_tablet_manager.cc:1398] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:11.603245 13733 tablet_bootstrap.cc:492] T 400199df936243f2b49a4b556f29c575 P 1928367ae8d64ba49a7f5761b2d3dc4a: Bootstrap starting.
I20240502 01:58:11.603724 13320 tablet_service.cc:1467] Processing CreateTablet for tablet 5175c37ef65f4f2fb83d64497592a180 (DEFAULT_TABLE table=rebalance_test_table_0 [id=87bf6032f2ab4ef8a4f1c2692004f94c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:11.603986 13320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5175c37ef65f4f2fb83d64497592a180. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:11.604368 13733 tablet_bootstrap.cc:654] T 400199df936243f2b49a4b556f29c575 P 1928367ae8d64ba49a7f5761b2d3dc4a: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:11.605438 13733 tablet_bootstrap.cc:492] T 400199df936243f2b49a4b556f29c575 P 1928367ae8d64ba49a7f5761b2d3dc4a: No bootstrap required, opened a new log
I20240502 01:58:11.605528 13733 ts_tablet_manager.cc:1367] T 400199df936243f2b49a4b556f29c575 P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:11.606084 13733 raft_consensus.cc:348] T 400199df936243f2b49a4b556f29c575 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.606194 13733 raft_consensus.cc:374] T 400199df936243f2b49a4b556f29c575 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:11.606226 13733 raft_consensus.cc:729] T 400199df936243f2b49a4b556f29c575 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1928367ae8d64ba49a7f5761b2d3dc4a, State: Initialized, Role: FOLLOWER
I20240502 01:58:11.606350 13733 consensus_queue.cc:260] T 400199df936243f2b49a4b556f29c575 P 1928367ae8d64ba49a7f5761b2d3dc4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.606695 13733 ts_tablet_manager.cc:1398] T 400199df936243f2b49a4b556f29c575 P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:11.606865 13733 tablet_bootstrap.cc:492] T 5175c37ef65f4f2fb83d64497592a180 P 1928367ae8d64ba49a7f5761b2d3dc4a: Bootstrap starting.
I20240502 01:58:11.607583 12785 tablet_service.cc:1467] Processing CreateTablet for tablet 400199df936243f2b49a4b556f29c575 (DEFAULT_TABLE table=rebalance_test_table_0 [id=87bf6032f2ab4ef8a4f1c2692004f94c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:11.607733 13733 tablet_bootstrap.cc:654] T 5175c37ef65f4f2fb83d64497592a180 P 1928367ae8d64ba49a7f5761b2d3dc4a: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:11.607821 12785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 400199df936243f2b49a4b556f29c575. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:11.607805 13051 tablet_service.cc:1467] Processing CreateTablet for tablet 400199df936243f2b49a4b556f29c575 (DEFAULT_TABLE table=rebalance_test_table_0 [id=87bf6032f2ab4ef8a4f1c2692004f94c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:11.608765 13051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 400199df936243f2b49a4b556f29c575. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:11.608840 13050 tablet_service.cc:1467] Processing CreateTablet for tablet 5175c37ef65f4f2fb83d64497592a180 (DEFAULT_TABLE table=rebalance_test_table_0 [id=87bf6032f2ab4ef8a4f1c2692004f94c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:11.609119 13050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5175c37ef65f4f2fb83d64497592a180. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:11.609556 12784 tablet_service.cc:1467] Processing CreateTablet for tablet 5175c37ef65f4f2fb83d64497592a180 (DEFAULT_TABLE table=rebalance_test_table_0 [id=87bf6032f2ab4ef8a4f1c2692004f94c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:11.609815 12784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5175c37ef65f4f2fb83d64497592a180. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:11.609930 13729 tablet_bootstrap.cc:492] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88: Bootstrap starting.
I20240502 01:58:11.609948 13052 tablet_service.cc:1467] Processing CreateTablet for tablet 24d91cbbc7cb4be7a0034613b96ac1cd (DEFAULT_TABLE table=rebalance_test_table_0 [id=87bf6032f2ab4ef8a4f1c2692004f94c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:11.610203 13052 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d91cbbc7cb4be7a0034613b96ac1cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:11.611066 13729 tablet_bootstrap.cc:654] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:11.611310 13731 tablet_bootstrap.cc:492] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665: No bootstrap required, opened a new log
I20240502 01:58:11.611418 13731 ts_tablet_manager.cc:1367] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20240502 01:58:11.612067 13728 tablet_bootstrap.cc:492] T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e: Bootstrap starting.
I20240502 01:58:11.611987 13731 raft_consensus.cc:348] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.612125 13731 raft_consensus.cc:374] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:11.612162 13731 raft_consensus.cc:729] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1e63d6b84a440a8864db2d36b57665, State: Initialized, Role: FOLLOWER
I20240502 01:58:11.612288 13731 consensus_queue.cc:260] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.612639 13731 ts_tablet_manager.cc:1398] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:11.612746 13733 tablet_bootstrap.cc:492] T 5175c37ef65f4f2fb83d64497592a180 P 1928367ae8d64ba49a7f5761b2d3dc4a: No bootstrap required, opened a new log
I20240502 01:58:11.612819 13733 ts_tablet_manager.cc:1367] T 5175c37ef65f4f2fb83d64497592a180 P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240502 01:58:11.612818 13731 tablet_bootstrap.cc:492] T 5175c37ef65f4f2fb83d64497592a180 P 6b1e63d6b84a440a8864db2d36b57665: Bootstrap starting.
I20240502 01:58:11.613248 13733 raft_consensus.cc:348] T 5175c37ef65f4f2fb83d64497592a180 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.613344 13733 raft_consensus.cc:374] T 5175c37ef65f4f2fb83d64497592a180 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:11.613375 13733 raft_consensus.cc:729] T 5175c37ef65f4f2fb83d64497592a180 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1928367ae8d64ba49a7f5761b2d3dc4a, State: Initialized, Role: FOLLOWER
I20240502 01:58:11.613440 13728 tablet_bootstrap.cc:654] T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:11.613476 13733 consensus_queue.cc:260] T 5175c37ef65f4f2fb83d64497592a180 P 1928367ae8d64ba49a7f5761b2d3dc4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.613726 13731 tablet_bootstrap.cc:654] T 5175c37ef65f4f2fb83d64497592a180 P 6b1e63d6b84a440a8864db2d36b57665: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:11.613822 13733 ts_tablet_manager.cc:1398] T 5175c37ef65f4f2fb83d64497592a180 P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:11.614773 13728 tablet_bootstrap.cc:492] T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e: No bootstrap required, opened a new log
I20240502 01:58:11.614863 13728 ts_tablet_manager.cc:1367] T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20240502 01:58:11.614924 13729 tablet_bootstrap.cc:492] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88: No bootstrap required, opened a new log
I20240502 01:58:11.615010 13729 ts_tablet_manager.cc:1367] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:58:11.615410 13728 raft_consensus.cc:348] T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.615417 13729 raft_consensus.cc:348] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.615536 13728 raft_consensus.cc:374] T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:11.615545 13729 raft_consensus.cc:374] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:11.615578 13729 raft_consensus.cc:729] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Initialized, Role: FOLLOWER
I20240502 01:58:11.615576 13728 raft_consensus.cc:729] T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42bc78875b454c7ab7fce86d56a28c1e, State: Initialized, Role: FOLLOWER
I20240502 01:58:11.615700 13729 consensus_queue.cc:260] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.615790 13728 consensus_queue.cc:260] T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.615936 13729 ts_tablet_manager.cc:1398] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:11.616078 13729 tablet_bootstrap.cc:492] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88: Bootstrap starting.
I20240502 01:58:11.616586 13731 tablet_bootstrap.cc:492] T 5175c37ef65f4f2fb83d64497592a180 P 6b1e63d6b84a440a8864db2d36b57665: No bootstrap required, opened a new log
I20240502 01:58:11.616658 13731 ts_tablet_manager.cc:1367] T 5175c37ef65f4f2fb83d64497592a180 P 6b1e63d6b84a440a8864db2d36b57665: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:58:11.616919 13729 tablet_bootstrap.cc:654] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:11.617105 13731 raft_consensus.cc:348] T 5175c37ef65f4f2fb83d64497592a180 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.617230 13731 raft_consensus.cc:374] T 5175c37ef65f4f2fb83d64497592a180 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:11.617269 13731 raft_consensus.cc:729] T 5175c37ef65f4f2fb83d64497592a180 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1e63d6b84a440a8864db2d36b57665, State: Initialized, Role: FOLLOWER
I20240502 01:58:11.617385 13731 consensus_queue.cc:260] T 5175c37ef65f4f2fb83d64497592a180 P 6b1e63d6b84a440a8864db2d36b57665 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.617447 13728 ts_tablet_manager.cc:1398] T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20240502 01:58:11.617630 13731 ts_tablet_manager.cc:1398] T 5175c37ef65f4f2fb83d64497592a180 P 6b1e63d6b84a440a8864db2d36b57665: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:11.618294 13728 tablet_bootstrap.cc:492] T 400199df936243f2b49a4b556f29c575 P 42bc78875b454c7ab7fce86d56a28c1e: Bootstrap starting.
I20240502 01:58:11.619232 13728 tablet_bootstrap.cc:654] T 400199df936243f2b49a4b556f29c575 P 42bc78875b454c7ab7fce86d56a28c1e: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:11.620249 13728 tablet_bootstrap.cc:492] T 400199df936243f2b49a4b556f29c575 P 42bc78875b454c7ab7fce86d56a28c1e: No bootstrap required, opened a new log
I20240502 01:58:11.620332 13728 ts_tablet_manager.cc:1367] T 400199df936243f2b49a4b556f29c575 P 42bc78875b454c7ab7fce86d56a28c1e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240502 01:58:11.620908 13728 raft_consensus.cc:348] T 400199df936243f2b49a4b556f29c575 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.621022 13728 raft_consensus.cc:374] T 400199df936243f2b49a4b556f29c575 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:11.621059 13728 raft_consensus.cc:729] T 400199df936243f2b49a4b556f29c575 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42bc78875b454c7ab7fce86d56a28c1e, State: Initialized, Role: FOLLOWER
I20240502 01:58:11.621177 13728 consensus_queue.cc:260] T 400199df936243f2b49a4b556f29c575 P 42bc78875b454c7ab7fce86d56a28c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.621448 13728 ts_tablet_manager.cc:1398] T 400199df936243f2b49a4b556f29c575 P 42bc78875b454c7ab7fce86d56a28c1e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:11.621721 13708 raft_consensus.cc:482] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:11.621817 13708 raft_consensus.cc:504] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.622215 13729 tablet_bootstrap.cc:492] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88: No bootstrap required, opened a new log
I20240502 01:58:11.622283 13729 ts_tablet_manager.cc:1367] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240502 01:58:11.622483 13708 leader_election.cc:288] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825), 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759)
I20240502 01:58:11.622702 13729 raft_consensus.cc:348] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.622805 13729 raft_consensus.cc:374] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:11.622844 13729 raft_consensus.cc:729] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Initialized, Role: FOLLOWER
I20240502 01:58:11.622983 13729 consensus_queue.cc:260] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.623255 13729 ts_tablet_manager.cc:1398] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:11.621760 13744 tablet_bootstrap.cc:492] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7: Bootstrap starting.
I20240502 01:58:11.623703 12938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "400199df936243f2b49a4b556f29c575" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e" is_pre_election: true
I20240502 01:58:11.623709 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "400199df936243f2b49a4b556f29c575" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" is_pre_election: true
I20240502 01:58:11.623836 12938 raft_consensus.cc:2454] T 400199df936243f2b49a4b556f29c575 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:11.623836 13473 raft_consensus.cc:2454] T 400199df936243f2b49a4b556f29c575 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:11.624356 12741 leader_election.cc:302] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1928367ae8d64ba49a7f5761b2d3dc4a, 27e2acacdad14caa8f66bc81fa8a2f88, 42bc78875b454c7ab7fce86d56a28c1e; no voters:
I20240502 01:58:11.624555 13708 raft_consensus.cc:2781] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:11.624617 13708 raft_consensus.cc:482] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:11.624663 13708 raft_consensus.cc:3037] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:11.625761 13708 raft_consensus.cc:504] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.626302 13708 leader_election.cc:288] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 election: Requested vote from peers 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825), 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759)
I20240502 01:58:11.626531 13744 tablet_bootstrap.cc:654] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:11.626652 12938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "400199df936243f2b49a4b556f29c575" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e"
I20240502 01:58:11.626762 12938 raft_consensus.cc:3037] T 400199df936243f2b49a4b556f29c575 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:11.627420 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "400199df936243f2b49a4b556f29c575" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a"
I20240502 01:58:11.627436 13744 log.cc:824] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:11.627557 13473 raft_consensus.cc:3037] T 400199df936243f2b49a4b556f29c575 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:11.627749 12938 raft_consensus.cc:2454] T 400199df936243f2b49a4b556f29c575 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:11.628603 13473 raft_consensus.cc:2454] T 400199df936243f2b49a4b556f29c575 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:11.628886 12741 leader_election.cc:302] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1928367ae8d64ba49a7f5761b2d3dc4a, 27e2acacdad14caa8f66bc81fa8a2f88, 42bc78875b454c7ab7fce86d56a28c1e; no voters:
I20240502 01:58:11.629056 13708 raft_consensus.cc:2781] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:11.628779 13185 tablet_service.cc:1467] Processing CreateTablet for tablet 5175c37ef65f4f2fb83d64497592a180 (DEFAULT_TABLE table=rebalance_test_table_0 [id=87bf6032f2ab4ef8a4f1c2692004f94c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:11.629249 13708 raft_consensus.cc:686] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Becoming Leader. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Running, Role: LEADER
I20240502 01:58:11.629392 13708 consensus_queue.cc:237] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.629688 13185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5175c37ef65f4f2fb83d64497592a180. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:11.630324 13186 tablet_service.cc:1467] Processing CreateTablet for tablet 400199df936243f2b49a4b556f29c575 (DEFAULT_TABLE table=rebalance_test_table_0 [id=87bf6032f2ab4ef8a4f1c2692004f94c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:11.630615 13186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 400199df936243f2b49a4b556f29c575. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:11.631027 12662 catalog_manager.cc:5484] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193). New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } }
I20240502 01:58:11.635942 13187 tablet_service.cc:1467] Processing CreateTablet for tablet 24d91cbbc7cb4be7a0034613b96ac1cd (DEFAULT_TABLE table=rebalance_test_table_0 [id=87bf6032f2ab4ef8a4f1c2692004f94c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:11.637079 13744 tablet_bootstrap.cc:492] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7: No bootstrap required, opened a new log
I20240502 01:58:11.637262 13744 ts_tablet_manager.cc:1367] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.000s
I20240502 01:58:11.637271 13187 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d91cbbc7cb4be7a0034613b96ac1cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:11.636514 13073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "400199df936243f2b49a4b556f29c575" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7" is_pre_election: true
I20240502 01:58:11.637910 13072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "400199df936243f2b49a4b556f29c575" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7"
W20240502 01:58:11.638433 12741 leader_election.cc:341] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887): Illegal state: must be running to vote when last-logged opid is not known
W20240502 01:58:11.638584 12741 leader_election.cc:341] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:58:11.637795 13208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "400199df936243f2b49a4b556f29c575" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149" is_pre_election: true
I20240502 01:58:11.639161 13207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "400199df936243f2b49a4b556f29c575" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149"
W20240502 01:58:11.639690 12740 leader_election.cc:341] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:58:11.639910 13753 tablet_bootstrap.cc:492] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149: Bootstrap starting.
W20240502 01:58:11.639930 12740 leader_election.cc:341] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:58:11.640611 13744 raft_consensus.cc:348] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.640882 13744 raft_consensus.cc:374] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:11.640954 13744 raft_consensus.cc:729] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71010353c29d4e988704295c8cd73ef7, State: Initialized, Role: FOLLOWER
I20240502 01:58:11.641391 13744 consensus_queue.cc:260] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.642290 13744 ts_tablet_manager.cc:1398] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20240502 01:58:11.642290 13753 tablet_bootstrap.cc:654] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:11.642596 13744 tablet_bootstrap.cc:492] T 400199df936243f2b49a4b556f29c575 P 71010353c29d4e988704295c8cd73ef7: Bootstrap starting.
I20240502 01:58:11.643080 13753 log.cc:824] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:11.643679 13744 tablet_bootstrap.cc:654] T 400199df936243f2b49a4b556f29c575 P 71010353c29d4e988704295c8cd73ef7: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:11.644840 13753 tablet_bootstrap.cc:492] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149: No bootstrap required, opened a new log
I20240502 01:58:11.644857 13744 tablet_bootstrap.cc:492] T 400199df936243f2b49a4b556f29c575 P 71010353c29d4e988704295c8cd73ef7: No bootstrap required, opened a new log
I20240502 01:58:11.644939 13744 ts_tablet_manager.cc:1367] T 400199df936243f2b49a4b556f29c575 P 71010353c29d4e988704295c8cd73ef7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:11.645017 13753 ts_tablet_manager.cc:1367] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:58:11.645442 13744 raft_consensus.cc:348] T 400199df936243f2b49a4b556f29c575 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.645565 13744 raft_consensus.cc:374] T 400199df936243f2b49a4b556f29c575 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:11.645604 13744 raft_consensus.cc:729] T 400199df936243f2b49a4b556f29c575 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71010353c29d4e988704295c8cd73ef7, State: Initialized, Role: FOLLOWER
I20240502 01:58:11.645720 13744 consensus_queue.cc:260] T 400199df936243f2b49a4b556f29c575 P 71010353c29d4e988704295c8cd73ef7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.645978 13744 ts_tablet_manager.cc:1398] T 400199df936243f2b49a4b556f29c575 P 71010353c29d4e988704295c8cd73ef7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:11.646198 13744 tablet_bootstrap.cc:492] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7: Bootstrap starting.
I20240502 01:58:11.647132 13744 tablet_bootstrap.cc:654] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:11.647608 13753 raft_consensus.cc:348] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.647850 13753 raft_consensus.cc:374] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:11.647913 13753 raft_consensus.cc:729] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d7bf587aa5a49eb92c3a53d17717149, State: Initialized, Role: FOLLOWER
I20240502 01:58:11.648342 13753 consensus_queue.cc:260] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.649046 13744 tablet_bootstrap.cc:492] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7: No bootstrap required, opened a new log
I20240502 01:58:11.649113 13753 ts_tablet_manager.cc:1398] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20240502 01:58:11.649130 13744 ts_tablet_manager.cc:1367] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:11.649412 13753 tablet_bootstrap.cc:492] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149: Bootstrap starting.
I20240502 01:58:11.649523 13744 raft_consensus.cc:348] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.649626 13744 raft_consensus.cc:374] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:11.649665 13744 raft_consensus.cc:729] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71010353c29d4e988704295c8cd73ef7, State: Initialized, Role: FOLLOWER
I20240502 01:58:11.649791 13744 consensus_queue.cc:260] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.650079 13744 ts_tablet_manager.cc:1398] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:11.650501 13753 tablet_bootstrap.cc:654] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:11.651821 13753 tablet_bootstrap.cc:492] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149: No bootstrap required, opened a new log
I20240502 01:58:11.651970 13753 ts_tablet_manager.cc:1367] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:11.652609 13753 raft_consensus.cc:348] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.652729 13753 raft_consensus.cc:374] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:11.652792 13753 raft_consensus.cc:729] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d7bf587aa5a49eb92c3a53d17717149, State: Initialized, Role: FOLLOWER
I20240502 01:58:11.652911 13753 consensus_queue.cc:260] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.653209 13753 ts_tablet_manager.cc:1398] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:11.653354 13753 tablet_bootstrap.cc:492] T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149: Bootstrap starting.
I20240502 01:58:11.654098 13753 tablet_bootstrap.cc:654] T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:11.655764 13753 tablet_bootstrap.cc:492] T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149: No bootstrap required, opened a new log
I20240502 01:58:11.655841 13753 ts_tablet_manager.cc:1367] T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20240502 01:58:11.656006 13740 raft_consensus.cc:482] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:11.656105 13740 raft_consensus.cc:504] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.656251 13753 raft_consensus.cc:348] T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.656348 13753 raft_consensus.cc:374] T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:11.656394 13753 raft_consensus.cc:729] T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d7bf587aa5a49eb92c3a53d17717149, State: Initialized, Role: FOLLOWER
I20240502 01:58:11.656531 13753 consensus_queue.cc:260] T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.656796 13753 ts_tablet_manager.cc:1398] T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:11.657517 13740 leader_election.cc:288] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825), 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263)
I20240502 01:58:11.662258 13072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d91cbbc7cb4be7a0034613b96ac1cd" candidate_uuid: "6b1e63d6b84a440a8864db2d36b57665" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7" is_pre_election: true
I20240502 01:58:11.662535 13072 raft_consensus.cc:2454] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1e63d6b84a440a8864db2d36b57665 in term 0.
I20240502 01:58:11.663300 13207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d91cbbc7cb4be7a0034613b96ac1cd" candidate_uuid: "6b1e63d6b84a440a8864db2d36b57665" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149" is_pre_election: true
I20240502 01:58:11.663503 13207 raft_consensus.cc:2454] T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1e63d6b84a440a8864db2d36b57665 in term 0.
I20240502 01:58:11.663471 12938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d91cbbc7cb4be7a0034613b96ac1cd" candidate_uuid: "6b1e63d6b84a440a8864db2d36b57665" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e" is_pre_election: true
I20240502 01:58:11.663599 12938 raft_consensus.cc:2454] T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1e63d6b84a440a8864db2d36b57665 in term 0.
I20240502 01:58:11.663789 13275 leader_election.cc:302] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 3d7bf587aa5a49eb92c3a53d17717149, 6b1e63d6b84a440a8864db2d36b57665, 71010353c29d4e988704295c8cd73ef7; no voters:
I20240502 01:58:11.664017 13740 raft_consensus.cc:2781] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:11.664075 13740 raft_consensus.cc:482] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:11.664117 13740 raft_consensus.cc:3037] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:11.665226 13740 raft_consensus.cc:504] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.665745 13740 leader_election.cc:288] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [CANDIDATE]: Term 1 election: Requested vote from peers 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825), 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263)
I20240502 01:58:11.666076 12938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d91cbbc7cb4be7a0034613b96ac1cd" candidate_uuid: "6b1e63d6b84a440a8864db2d36b57665" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e"
I20240502 01:58:11.666190 12938 raft_consensus.cc:3037] T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:11.666234 13072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d91cbbc7cb4be7a0034613b96ac1cd" candidate_uuid: "6b1e63d6b84a440a8864db2d36b57665" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7"
I20240502 01:58:11.666338 13072 raft_consensus.cc:3037] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:11.666325 12805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d91cbbc7cb4be7a0034613b96ac1cd" candidate_uuid: "6b1e63d6b84a440a8864db2d36b57665" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" is_pre_election: true
I20240502 01:58:11.666482 12805 raft_consensus.cc:2454] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1e63d6b84a440a8864db2d36b57665 in term 0.
I20240502 01:58:11.666749 12804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d91cbbc7cb4be7a0034613b96ac1cd" candidate_uuid: "6b1e63d6b84a440a8864db2d36b57665" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e2acacdad14caa8f66bc81fa8a2f88"
I20240502 01:58:11.666829 12804 raft_consensus.cc:3037] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:11.667192 12938 raft_consensus.cc:2454] T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1e63d6b84a440a8864db2d36b57665 in term 1.
I20240502 01:58:11.667460 13072 raft_consensus.cc:2454] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1e63d6b84a440a8864db2d36b57665 in term 1.
I20240502 01:58:11.667708 12804 raft_consensus.cc:2454] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1e63d6b84a440a8864db2d36b57665 in term 1.
I20240502 01:58:11.667752 13276 leader_election.cc:302] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 42bc78875b454c7ab7fce86d56a28c1e, 6b1e63d6b84a440a8864db2d36b57665, 71010353c29d4e988704295c8cd73ef7; no voters:
I20240502 01:58:11.667949 13207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24d91cbbc7cb4be7a0034613b96ac1cd" candidate_uuid: "6b1e63d6b84a440a8864db2d36b57665" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149"
I20240502 01:58:11.668067 13207 raft_consensus.cc:3037] T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:11.668850 13207 raft_consensus.cc:2454] T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1e63d6b84a440a8864db2d36b57665 in term 1.
I20240502 01:58:11.669029 13740 raft_consensus.cc:2781] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:11.669229 13740 raft_consensus.cc:686] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [term 1 LEADER]: Becoming Leader. State: Replica: 6b1e63d6b84a440a8864db2d36b57665, State: Running, Role: LEADER
I20240502 01:58:11.669507 13740 consensus_queue.cc:237] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.671801 12660 catalog_manager.cc:5484] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197). New cstate: current_term: 1 leader_uuid: "6b1e63d6b84a440a8864db2d36b57665" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:11.686131 13708 raft_consensus.cc:482] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:11.686242 13708 raft_consensus.cc:504] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.686676 13708 leader_election.cc:288] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825), 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759)
I20240502 01:58:11.686998 13341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5175c37ef65f4f2fb83d64497592a180" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665" is_pre_election: true
I20240502 01:58:11.687027 13207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5175c37ef65f4f2fb83d64497592a180" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149" is_pre_election: true
I20240502 01:58:11.687045 13072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5175c37ef65f4f2fb83d64497592a180" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7" is_pre_election: true
I20240502 01:58:11.687134 13341 raft_consensus.cc:2454] T 5175c37ef65f4f2fb83d64497592a180 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:11.687150 13072 raft_consensus.cc:2454] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:11.687151 13207 raft_consensus.cc:2454] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:11.687245 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5175c37ef65f4f2fb83d64497592a180" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" is_pre_election: true
I20240502 01:58:11.687382 13473 raft_consensus.cc:2454] T 5175c37ef65f4f2fb83d64497592a180 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:11.687453 12741 leader_election.cc:302] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 27e2acacdad14caa8f66bc81fa8a2f88, 6b1e63d6b84a440a8864db2d36b57665, 71010353c29d4e988704295c8cd73ef7; no voters:
I20240502 01:58:11.687619 13708 raft_consensus.cc:2781] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:11.687685 13708 raft_consensus.cc:482] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:11.687716 13708 raft_consensus.cc:3037] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:11.688431 13708 raft_consensus.cc:504] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.688795 13708 leader_election.cc:288] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825), 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759)
I20240502 01:58:11.689031 13341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5175c37ef65f4f2fb83d64497592a180" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665"
I20240502 01:58:11.689050 13207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5175c37ef65f4f2fb83d64497592a180" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149"
I20240502 01:58:11.689141 13207 raft_consensus.cc:3037] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:11.689141 13341 raft_consensus.cc:3037] T 5175c37ef65f4f2fb83d64497592a180 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:11.689122 13072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5175c37ef65f4f2fb83d64497592a180" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7"
I20240502 01:58:11.689126 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5175c37ef65f4f2fb83d64497592a180" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a"
I20240502 01:58:11.689224 13072 raft_consensus.cc:3037] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:11.689224 13473 raft_consensus.cc:3037] T 5175c37ef65f4f2fb83d64497592a180 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:11.690016 13207 raft_consensus.cc:2454] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:11.690026 13341 raft_consensus.cc:2454] T 5175c37ef65f4f2fb83d64497592a180 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:11.690142 13473 raft_consensus.cc:2454] T 5175c37ef65f4f2fb83d64497592a180 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:11.690261 13072 raft_consensus.cc:2454] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:11.690310 12741 leader_election.cc:302] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 27e2acacdad14caa8f66bc81fa8a2f88, 3d7bf587aa5a49eb92c3a53d17717149, 6b1e63d6b84a440a8864db2d36b57665; no voters:
I20240502 01:58:11.690477 13708 raft_consensus.cc:2781] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:11.690574 13708 raft_consensus.cc:686] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Becoming Leader. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Running, Role: LEADER
I20240502 01:58:11.690737 13708 consensus_queue.cc:237] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:11.692363 12660 catalog_manager.cc:5484] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193). New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } }
W20240502 01:58:11.721026 13121 tablet.cc:2369] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 01:58:11.805001 13771 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:11.805212 13771 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:11.808240 13771 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_0'
W20240502 01:58:11.892359 13256 tablet.cc:2369] T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 01:58:11.899626 12804 raft_consensus.cc:1261] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:11.899608 13207 raft_consensus.cc:1261] T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:11.900190 13768 consensus_queue.cc:1035] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:11.900346 13740 consensus_queue.cc:1035] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:11.900650 12938 raft_consensus.cc:1261] T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:11.901530 13072 raft_consensus.cc:1261] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:11.901870 13768 consensus_queue.cc:1035] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:11.902189 13768 consensus_queue.cc:1035] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:11.902360 13208 raft_consensus.cc:1261] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:11.902961 13708 consensus_queue.cc:1035] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:11.903051 13341 raft_consensus.cc:1261] T 5175c37ef65f4f2fb83d64497592a180 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:11.904330 13751 consensus_queue.cc:1035] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:11.905979 13473 raft_consensus.cc:1261] T 5175c37ef65f4f2fb83d64497592a180 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:11.906674 13751 consensus_queue.cc:1035] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:11.906903 13073 raft_consensus.cc:1261] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:11.908352 13751 consensus_queue.cc:1035] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:11.914181 13472 raft_consensus.cc:1261] T 400199df936243f2b49a4b556f29c575 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:11.914285 12937 raft_consensus.cc:1261] T 400199df936243f2b49a4b556f29c575 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:11.914675 13206 raft_consensus.cc:3037] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:11.914752 13708 consensus_queue.cc:1035] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:11.915369 13751 consensus_queue.cc:1035] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:11.915814 13206 raft_consensus.cc:1261] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:11.918552 13708 consensus_queue.cc:1035] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:11.919291 13071 raft_consensus.cc:3037] T 400199df936243f2b49a4b556f29c575 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:11.920435 13071 raft_consensus.cc:1261] T 400199df936243f2b49a4b556f29c575 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:11.921435 13708 consensus_queue.cc:1035] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:11.926915 13819 mvcc.cc:205] Tried to move back new op lower bound from 7023063416426844160 to 7023063415566893056. Current Snapshot: MvccSnapshot[applied={T|T < 7023063416426844160}]
I20240502 01:58:11.930805 13808 mvcc.cc:205] Tried to move back new op lower bound from 7023063416426844160 to 7023063415566893056. Current Snapshot: MvccSnapshot[applied={T|T < 7023063416426844160}]
I20240502 01:58:11.944007 13828 mvcc.cc:205] Tried to move back new op lower bound from 7023063416414359552 to 7023063415481888768. Current Snapshot: MvccSnapshot[applied={T|T < 7023063416414359552}]
I20240502 01:58:11.945935 13816 mvcc.cc:205] Tried to move back new op lower bound from 7023063416426844160 to 7023063415566893056. Current Snapshot: MvccSnapshot[applied={T|T < 7023063416426844160}]
I20240502 01:58:11.950479 13810 mvcc.cc:205] Tried to move back new op lower bound from 7023063416517799936 to 7023063415481888768. Current Snapshot: MvccSnapshot[applied={T|T < 7023063416414359552}]
I20240502 01:58:11.961036 13806 mvcc.cc:205] Tried to move back new op lower bound from 7023063416475541504 to 7023063415316107264. Current Snapshot: MvccSnapshot[applied={T|T < 7023063416475541504}]
INSERT report
rows total: 2000
time total: 173.2 ms
time per row: 0.0866002 ms
I20240502 01:58:12.022068 12657 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43822:
name: "rebalance_test_table_1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 01:58:12.028275 13320 tablet_service.cc:1467] Processing CreateTablet for tablet 6b4405ed71824af7bde2e54f5f592d10 (DEFAULT_TABLE table=rebalance_test_table_1 [id=744919a455134d42b3ec60abe824250b]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.028371 13452 tablet_service.cc:1467] Processing CreateTablet for tablet 6b4405ed71824af7bde2e54f5f592d10 (DEFAULT_TABLE table=rebalance_test_table_1 [id=744919a455134d42b3ec60abe824250b]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.028601 13320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b4405ed71824af7bde2e54f5f592d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.028618 13452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b4405ed71824af7bde2e54f5f592d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.029208 12918 tablet_service.cc:1467] Processing CreateTablet for tablet 6b4405ed71824af7bde2e54f5f592d10 (DEFAULT_TABLE table=rebalance_test_table_1 [id=744919a455134d42b3ec60abe824250b]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.029428 12918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b4405ed71824af7bde2e54f5f592d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.030726 13731 tablet_bootstrap.cc:492] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665: Bootstrap starting.
I20240502 01:58:12.031241 12916 tablet_service.cc:1467] Processing CreateTablet for tablet f1e0f3e6a85b4998bdaaf83117af6f20 (DEFAULT_TABLE table=rebalance_test_table_1 [id=744919a455134d42b3ec60abe824250b]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.031378 13050 tablet_service.cc:1467] Processing CreateTablet for tablet 6b4405ed71824af7bde2e54f5f592d10 (DEFAULT_TABLE table=rebalance_test_table_1 [id=744919a455134d42b3ec60abe824250b]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.031453 13728 tablet_bootstrap.cc:492] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e: Bootstrap starting.
I20240502 01:58:12.031241 12917 tablet_service.cc:1467] Processing CreateTablet for tablet eeb77a056e494d5ab85138d8ecc52db9 (DEFAULT_TABLE table=rebalance_test_table_1 [id=744919a455134d42b3ec60abe824250b]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.031538 12916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1e0f3e6a85b4998bdaaf83117af6f20. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.031608 13731 tablet_bootstrap.cc:654] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.031661 13050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b4405ed71824af7bde2e54f5f592d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.031663 12917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeb77a056e494d5ab85138d8ecc52db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.032204 13733 tablet_bootstrap.cc:492] T 6b4405ed71824af7bde2e54f5f592d10 P 1928367ae8d64ba49a7f5761b2d3dc4a: Bootstrap starting.
I20240502 01:58:12.033169 13733 tablet_bootstrap.cc:654] T 6b4405ed71824af7bde2e54f5f592d10 P 1928367ae8d64ba49a7f5761b2d3dc4a: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.033936 13744 tablet_bootstrap.cc:492] T 6b4405ed71824af7bde2e54f5f592d10 P 71010353c29d4e988704295c8cd73ef7: Bootstrap starting.
I20240502 01:58:12.034400 13728 tablet_bootstrap.cc:654] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.034488 13733 tablet_bootstrap.cc:492] T 6b4405ed71824af7bde2e54f5f592d10 P 1928367ae8d64ba49a7f5761b2d3dc4a: No bootstrap required, opened a new log
I20240502 01:58:12.034575 13733 ts_tablet_manager.cc:1367] T 6b4405ed71824af7bde2e54f5f592d10 P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:12.034719 13744 tablet_bootstrap.cc:654] T 6b4405ed71824af7bde2e54f5f592d10 P 71010353c29d4e988704295c8cd73ef7: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.035110 13733 raft_consensus.cc:348] T 6b4405ed71824af7bde2e54f5f592d10 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.035238 13733 raft_consensus.cc:374] T 6b4405ed71824af7bde2e54f5f592d10 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.035284 13733 raft_consensus.cc:729] T 6b4405ed71824af7bde2e54f5f592d10 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1928367ae8d64ba49a7f5761b2d3dc4a, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.035899 13733 consensus_queue.cc:260] T 6b4405ed71824af7bde2e54f5f592d10 P 1928367ae8d64ba49a7f5761b2d3dc4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.035977 13728 tablet_bootstrap.cc:492] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e: No bootstrap required, opened a new log
I20240502 01:58:12.036056 13728 ts_tablet_manager.cc:1367] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:58:12.036016 13185 tablet_service.cc:1467] Processing CreateTablet for tablet eeb77a056e494d5ab85138d8ecc52db9 (DEFAULT_TABLE table=rebalance_test_table_1 [id=744919a455134d42b3ec60abe824250b]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.036049 13187 tablet_service.cc:1467] Processing CreateTablet for tablet 6b4405ed71824af7bde2e54f5f592d10 (DEFAULT_TABLE table=rebalance_test_table_1 [id=744919a455134d42b3ec60abe824250b]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.036289 13185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeb77a056e494d5ab85138d8ecc52db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.036307 13733 ts_tablet_manager.cc:1398] T 6b4405ed71824af7bde2e54f5f592d10 P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:12.036358 13186 tablet_service.cc:1467] Processing CreateTablet for tablet f1e0f3e6a85b4998bdaaf83117af6f20 (DEFAULT_TABLE table=rebalance_test_table_1 [id=744919a455134d42b3ec60abe824250b]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.036496 13728 raft_consensus.cc:348] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.036608 13728 raft_consensus.cc:374] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.036639 13728 raft_consensus.cc:729] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42bc78875b454c7ab7fce86d56a28c1e, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.036749 13728 consensus_queue.cc:260] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.036938 12784 tablet_service.cc:1467] Processing CreateTablet for tablet f1e0f3e6a85b4998bdaaf83117af6f20 (DEFAULT_TABLE table=rebalance_test_table_1 [id=744919a455134d42b3ec60abe824250b]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.037226 12784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1e0f3e6a85b4998bdaaf83117af6f20. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.037577 13051 tablet_service.cc:1467] Processing CreateTablet for tablet f1e0f3e6a85b4998bdaaf83117af6f20 (DEFAULT_TABLE table=rebalance_test_table_1 [id=744919a455134d42b3ec60abe824250b]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.037783 13051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1e0f3e6a85b4998bdaaf83117af6f20. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.037869 13321 tablet_service.cc:1467] Processing CreateTablet for tablet f1e0f3e6a85b4998bdaaf83117af6f20 (DEFAULT_TABLE table=rebalance_test_table_1 [id=744919a455134d42b3ec60abe824250b]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.038126 13321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1e0f3e6a85b4998bdaaf83117af6f20. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.039377 13729 tablet_bootstrap.cc:492] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88: Bootstrap starting.
I20240502 01:58:12.039734 13186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1e0f3e6a85b4998bdaaf83117af6f20. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.040211 13729 tablet_bootstrap.cc:654] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.040709 13320 tablet_service.cc:1467] Processing CreateTablet for tablet eeb77a056e494d5ab85138d8ecc52db9 (DEFAULT_TABLE table=rebalance_test_table_1 [id=744919a455134d42b3ec60abe824250b]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.040963 13320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeb77a056e494d5ab85138d8ecc52db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.041684 13753 tablet_bootstrap.cc:492] T f1e0f3e6a85b4998bdaaf83117af6f20 P 3d7bf587aa5a49eb92c3a53d17717149: Bootstrap starting.
I20240502 01:58:12.042057 13452 tablet_service.cc:1467] Processing CreateTablet for tablet eeb77a056e494d5ab85138d8ecc52db9 (DEFAULT_TABLE table=rebalance_test_table_1 [id=744919a455134d42b3ec60abe824250b]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.042275 13452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeb77a056e494d5ab85138d8ecc52db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.042519 13753 tablet_bootstrap.cc:654] T f1e0f3e6a85b4998bdaaf83117af6f20 P 3d7bf587aa5a49eb92c3a53d17717149: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.043148 13728 ts_tablet_manager.cc:1398] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20240502 01:58:12.043365 13728 tablet_bootstrap.cc:492] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e: Bootstrap starting.
I20240502 01:58:12.044066 13728 tablet_bootstrap.cc:654] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.044385 13733 tablet_bootstrap.cc:492] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a: Bootstrap starting.
I20240502 01:58:12.044595 13753 tablet_bootstrap.cc:492] T f1e0f3e6a85b4998bdaaf83117af6f20 P 3d7bf587aa5a49eb92c3a53d17717149: No bootstrap required, opened a new log
I20240502 01:58:12.044672 13753 ts_tablet_manager.cc:1367] T f1e0f3e6a85b4998bdaaf83117af6f20 P 3d7bf587aa5a49eb92c3a53d17717149: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:58:12.045074 13187 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b4405ed71824af7bde2e54f5f592d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.045136 13753 raft_consensus.cc:348] T f1e0f3e6a85b4998bdaaf83117af6f20 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:12.045228 13753 raft_consensus.cc:374] T f1e0f3e6a85b4998bdaaf83117af6f20 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.045260 13753 raft_consensus.cc:729] T f1e0f3e6a85b4998bdaaf83117af6f20 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d7bf587aa5a49eb92c3a53d17717149, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.045397 13733 tablet_bootstrap.cc:654] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.045364 13753 consensus_queue.cc:260] T f1e0f3e6a85b4998bdaaf83117af6f20 P 3d7bf587aa5a49eb92c3a53d17717149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:12.045612 13753 ts_tablet_manager.cc:1398] T f1e0f3e6a85b4998bdaaf83117af6f20 P 3d7bf587aa5a49eb92c3a53d17717149: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:12.045773 13753 tablet_bootstrap.cc:492] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149: Bootstrap starting.
I20240502 01:58:12.045789 13744 tablet_bootstrap.cc:492] T 6b4405ed71824af7bde2e54f5f592d10 P 71010353c29d4e988704295c8cd73ef7: No bootstrap required, opened a new log
I20240502 01:58:12.045871 13744 ts_tablet_manager.cc:1367] T 6b4405ed71824af7bde2e54f5f592d10 P 71010353c29d4e988704295c8cd73ef7: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20240502 01:58:12.046348 13744 raft_consensus.cc:348] T 6b4405ed71824af7bde2e54f5f592d10 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.046464 13744 raft_consensus.cc:374] T 6b4405ed71824af7bde2e54f5f592d10 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.046499 13744 raft_consensus.cc:729] T 6b4405ed71824af7bde2e54f5f592d10 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71010353c29d4e988704295c8cd73ef7, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.046547 13733 tablet_bootstrap.cc:492] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a: No bootstrap required, opened a new log
I20240502 01:58:12.046623 13733 ts_tablet_manager.cc:1367] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:12.046617 13744 consensus_queue.cc:260] T 6b4405ed71824af7bde2e54f5f592d10 P 71010353c29d4e988704295c8cd73ef7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.046891 13744 ts_tablet_manager.cc:1398] T 6b4405ed71824af7bde2e54f5f592d10 P 71010353c29d4e988704295c8cd73ef7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:12.047057 13744 tablet_bootstrap.cc:492] T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7: Bootstrap starting.
I20240502 01:58:12.047024 13733 raft_consensus.cc:348] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:12.047132 13733 raft_consensus.cc:374] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.047163 13733 raft_consensus.cc:729] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1928367ae8d64ba49a7f5761b2d3dc4a, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.047293 13733 consensus_queue.cc:260] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:12.047572 13733 ts_tablet_manager.cc:1398] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:12.047669 13050 tablet_service.cc:1467] Processing CreateTablet for tablet eeb77a056e494d5ab85138d8ecc52db9 (DEFAULT_TABLE table=rebalance_test_table_1 [id=744919a455134d42b3ec60abe824250b]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.047904 13050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeb77a056e494d5ab85138d8ecc52db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.047889 13744 tablet_bootstrap.cc:654] T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.050653 13753 tablet_bootstrap.cc:654] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.051465 13744 tablet_bootstrap.cc:492] T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7: No bootstrap required, opened a new log
I20240502 01:58:12.051554 13744 ts_tablet_manager.cc:1367] T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20240502 01:58:12.051625 13731 tablet_bootstrap.cc:492] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665: No bootstrap required, opened a new log
I20240502 01:58:12.051716 13731 ts_tablet_manager.cc:1367] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.000s
I20240502 01:58:12.051765 13729 tablet_bootstrap.cc:492] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88: No bootstrap required, opened a new log
I20240502 01:58:12.051853 13729 ts_tablet_manager.cc:1367] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20240502 01:58:12.052000 13744 raft_consensus.cc:348] T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:12.052088 13744 raft_consensus.cc:374] T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.052120 13744 raft_consensus.cc:729] T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71010353c29d4e988704295c8cd73ef7, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.052162 13731 raft_consensus.cc:348] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.052224 13744 consensus_queue.cc:260] T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:12.052215 13729 raft_consensus.cc:348] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:12.052294 13731 raft_consensus.cc:374] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.052309 13729 raft_consensus.cc:374] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.052338 13731 raft_consensus.cc:729] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1e63d6b84a440a8864db2d36b57665, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.052345 13729 raft_consensus.cc:729] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.052467 13744 ts_tablet_manager.cc:1398] T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:12.052459 13731 consensus_queue.cc:260] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.052462 13729 consensus_queue.cc:260] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:12.052657 13744 tablet_bootstrap.cc:492] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7: Bootstrap starting.
I20240502 01:58:12.052713 13729 ts_tablet_manager.cc:1398] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:12.052735 13731 ts_tablet_manager.cc:1398] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:12.053428 13731 tablet_bootstrap.cc:492] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665: Bootstrap starting.
I20240502 01:58:12.054548 13731 tablet_bootstrap.cc:654] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.054965 13744 tablet_bootstrap.cc:654] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.055533 13731 tablet_bootstrap.cc:492] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665: No bootstrap required, opened a new log
I20240502 01:58:12.055617 13731 ts_tablet_manager.cc:1367] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:12.056007 13744 tablet_bootstrap.cc:492] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7: No bootstrap required, opened a new log
I20240502 01:58:12.056092 13744 ts_tablet_manager.cc:1367] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240502 01:58:12.056033 13731 raft_consensus.cc:348] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:12.056136 13731 raft_consensus.cc:374] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.056175 13731 raft_consensus.cc:729] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1e63d6b84a440a8864db2d36b57665, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.056308 13731 consensus_queue.cc:260] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:12.056563 13731 ts_tablet_manager.cc:1398] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:12.056516 13744 raft_consensus.cc:348] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:12.056617 13744 raft_consensus.cc:374] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.056658 13744 raft_consensus.cc:729] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71010353c29d4e988704295c8cd73ef7, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.056727 13731 tablet_bootstrap.cc:492] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665: Bootstrap starting.
I20240502 01:58:12.056777 13744 consensus_queue.cc:260] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:12.057024 13744 ts_tablet_manager.cc:1398] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:12.057529 13731 tablet_bootstrap.cc:654] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.058569 13731 tablet_bootstrap.cc:492] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665: No bootstrap required, opened a new log
I20240502 01:58:12.058878 13753 tablet_bootstrap.cc:492] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149: No bootstrap required, opened a new log
I20240502 01:58:12.058954 13753 ts_tablet_manager.cc:1367] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20240502 01:58:12.058650 13731 ts_tablet_manager.cc:1367] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:12.059492 13753 raft_consensus.cc:348] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:12.059618 13753 raft_consensus.cc:374] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.059652 13753 raft_consensus.cc:729] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d7bf587aa5a49eb92c3a53d17717149, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.059782 13753 consensus_queue.cc:260] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:12.060027 13753 ts_tablet_manager.cc:1398] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:12.059994 13731 raft_consensus.cc:348] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:12.060091 13731 raft_consensus.cc:374] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.060148 13731 raft_consensus.cc:729] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1e63d6b84a440a8864db2d36b57665, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.060215 13753 tablet_bootstrap.cc:492] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149: Bootstrap starting.
I20240502 01:58:12.060273 13731 consensus_queue.cc:260] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:12.061102 13753 tablet_bootstrap.cc:654] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.061188 13731 ts_tablet_manager.cc:1398] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:12.062150 13728 tablet_bootstrap.cc:492] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e: No bootstrap required, opened a new log
I20240502 01:58:12.062222 13728 ts_tablet_manager.cc:1367] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.001s
I20240502 01:58:12.062588 13728 raft_consensus.cc:348] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:12.062678 13728 raft_consensus.cc:374] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.062702 13728 raft_consensus.cc:729] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42bc78875b454c7ab7fce86d56a28c1e, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.062808 13728 consensus_queue.cc:260] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:12.063030 13728 ts_tablet_manager.cc:1398] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:12.063287 13728 tablet_bootstrap.cc:492] T f1e0f3e6a85b4998bdaaf83117af6f20 P 42bc78875b454c7ab7fce86d56a28c1e: Bootstrap starting.
I20240502 01:58:12.063572 13753 tablet_bootstrap.cc:492] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149: No bootstrap required, opened a new log
I20240502 01:58:12.063647 13753 ts_tablet_manager.cc:1367] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:58:12.064013 13753 raft_consensus.cc:348] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.064098 13753 raft_consensus.cc:374] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.064118 13728 tablet_bootstrap.cc:654] T f1e0f3e6a85b4998bdaaf83117af6f20 P 42bc78875b454c7ab7fce86d56a28c1e: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.064122 13753 raft_consensus.cc:729] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d7bf587aa5a49eb92c3a53d17717149, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.064205 13753 consensus_queue.cc:260] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.064411 13753 ts_tablet_manager.cc:1398] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:12.066946 13728 tablet_bootstrap.cc:492] T f1e0f3e6a85b4998bdaaf83117af6f20 P 42bc78875b454c7ab7fce86d56a28c1e: No bootstrap required, opened a new log
I20240502 01:58:12.067036 13728 ts_tablet_manager.cc:1367] T f1e0f3e6a85b4998bdaaf83117af6f20 P 42bc78875b454c7ab7fce86d56a28c1e: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240502 01:58:12.067504 13728 raft_consensus.cc:348] T f1e0f3e6a85b4998bdaaf83117af6f20 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:12.067639 13728 raft_consensus.cc:374] T f1e0f3e6a85b4998bdaaf83117af6f20 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.067688 13728 raft_consensus.cc:729] T f1e0f3e6a85b4998bdaaf83117af6f20 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42bc78875b454c7ab7fce86d56a28c1e, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.067867 13728 consensus_queue.cc:260] T f1e0f3e6a85b4998bdaaf83117af6f20 P 42bc78875b454c7ab7fce86d56a28c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:12.068239 13728 ts_tablet_manager.cc:1398] T f1e0f3e6a85b4998bdaaf83117af6f20 P 42bc78875b454c7ab7fce86d56a28c1e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:12.090406 13759 raft_consensus.cc:482] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:12.090528 13759 raft_consensus.cc:504] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.091724 13759 leader_election.cc:288] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283), 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759)
I20240502 01:58:12.096856 12937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b4405ed71824af7bde2e54f5f592d10" candidate_uuid: "3d7bf587aa5a49eb92c3a53d17717149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e" is_pre_election: true
I20240502 01:58:12.096922 13072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b4405ed71824af7bde2e54f5f592d10" candidate_uuid: "3d7bf587aa5a49eb92c3a53d17717149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7" is_pre_election: true
I20240502 01:58:12.096949 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b4405ed71824af7bde2e54f5f592d10" candidate_uuid: "3d7bf587aa5a49eb92c3a53d17717149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" is_pre_election: true
I20240502 01:58:12.096949 13341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b4405ed71824af7bde2e54f5f592d10" candidate_uuid: "3d7bf587aa5a49eb92c3a53d17717149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665" is_pre_election: true
I20240502 01:58:12.097002 12937 raft_consensus.cc:2454] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d7bf587aa5a49eb92c3a53d17717149 in term 0.
I20240502 01:58:12.097038 13072 raft_consensus.cc:2454] T 6b4405ed71824af7bde2e54f5f592d10 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d7bf587aa5a49eb92c3a53d17717149 in term 0.
I20240502 01:58:12.097074 13341 raft_consensus.cc:2454] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d7bf587aa5a49eb92c3a53d17717149 in term 0.
I20240502 01:58:12.097074 13473 raft_consensus.cc:2454] T 6b4405ed71824af7bde2e54f5f592d10 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d7bf587aa5a49eb92c3a53d17717149 in term 0.
I20240502 01:58:12.097385 13143 leader_election.cc:302] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 3d7bf587aa5a49eb92c3a53d17717149, 42bc78875b454c7ab7fce86d56a28c1e, 71010353c29d4e988704295c8cd73ef7; no voters:
I20240502 01:58:12.097635 13759 raft_consensus.cc:2781] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:12.097692 13759 raft_consensus.cc:482] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:12.097746 13759 raft_consensus.cc:3037] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.098590 13759 raft_consensus.cc:504] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.098976 13759 leader_election.cc:288] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [CANDIDATE]: Term 1 election: Requested vote from peers 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283), 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759)
I20240502 01:58:12.099262 13341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b4405ed71824af7bde2e54f5f592d10" candidate_uuid: "3d7bf587aa5a49eb92c3a53d17717149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665"
I20240502 01:58:12.099303 12937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b4405ed71824af7bde2e54f5f592d10" candidate_uuid: "3d7bf587aa5a49eb92c3a53d17717149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e"
I20240502 01:58:12.099366 13341 raft_consensus.cc:3037] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.099403 12937 raft_consensus.cc:3037] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.099406 13072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b4405ed71824af7bde2e54f5f592d10" candidate_uuid: "3d7bf587aa5a49eb92c3a53d17717149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7"
I20240502 01:58:12.099426 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b4405ed71824af7bde2e54f5f592d10" candidate_uuid: "3d7bf587aa5a49eb92c3a53d17717149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a"
I20240502 01:58:12.099503 13072 raft_consensus.cc:3037] T 6b4405ed71824af7bde2e54f5f592d10 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.099545 13473 raft_consensus.cc:3037] T 6b4405ed71824af7bde2e54f5f592d10 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.100296 13341 raft_consensus.cc:2454] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d7bf587aa5a49eb92c3a53d17717149 in term 1.
I20240502 01:58:12.100400 13072 raft_consensus.cc:2454] T 6b4405ed71824af7bde2e54f5f592d10 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d7bf587aa5a49eb92c3a53d17717149 in term 1.
I20240502 01:58:12.100400 12937 raft_consensus.cc:2454] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d7bf587aa5a49eb92c3a53d17717149 in term 1.
I20240502 01:58:12.100467 13473 raft_consensus.cc:2454] T 6b4405ed71824af7bde2e54f5f592d10 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d7bf587aa5a49eb92c3a53d17717149 in term 1.
I20240502 01:58:12.100675 13143 leader_election.cc:302] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1928367ae8d64ba49a7f5761b2d3dc4a, 3d7bf587aa5a49eb92c3a53d17717149, 6b1e63d6b84a440a8864db2d36b57665; no voters:
I20240502 01:58:12.100904 13759 raft_consensus.cc:2781] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:12.101094 13759 raft_consensus.cc:686] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 LEADER]: Becoming Leader. State: Replica: 3d7bf587aa5a49eb92c3a53d17717149, State: Running, Role: LEADER
I20240502 01:58:12.101388 13759 consensus_queue.cc:237] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.103929 12655 catalog_manager.cc:5484] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196). New cstate: current_term: 1 leader_uuid: "3d7bf587aa5a49eb92c3a53d17717149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:12.125504 13759 raft_consensus.cc:482] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:12.125633 13759 raft_consensus.cc:504] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:12.126160 13759 leader_election.cc:288] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759), 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283)
I20240502 01:58:12.126538 12937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb77a056e494d5ab85138d8ecc52db9" candidate_uuid: "3d7bf587aa5a49eb92c3a53d17717149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e" is_pre_election: true
I20240502 01:58:12.126616 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb77a056e494d5ab85138d8ecc52db9" candidate_uuid: "3d7bf587aa5a49eb92c3a53d17717149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" is_pre_election: true
I20240502 01:58:12.126633 13341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb77a056e494d5ab85138d8ecc52db9" candidate_uuid: "3d7bf587aa5a49eb92c3a53d17717149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665" is_pre_election: true
I20240502 01:58:12.126648 13072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb77a056e494d5ab85138d8ecc52db9" candidate_uuid: "3d7bf587aa5a49eb92c3a53d17717149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7" is_pre_election: true
I20240502 01:58:12.126693 12937 raft_consensus.cc:2454] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d7bf587aa5a49eb92c3a53d17717149 in term 0.
I20240502 01:58:12.126753 13473 raft_consensus.cc:2454] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d7bf587aa5a49eb92c3a53d17717149 in term 0.
I20240502 01:58:12.126765 13341 raft_consensus.cc:2454] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d7bf587aa5a49eb92c3a53d17717149 in term 0.
I20240502 01:58:12.126780 13072 raft_consensus.cc:2454] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d7bf587aa5a49eb92c3a53d17717149 in term 0.
I20240502 01:58:12.127087 13143 leader_election.cc:302] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 3d7bf587aa5a49eb92c3a53d17717149, 42bc78875b454c7ab7fce86d56a28c1e, 71010353c29d4e988704295c8cd73ef7; no voters:
I20240502 01:58:12.127955 13759 raft_consensus.cc:2781] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:12.128010 13759 raft_consensus.cc:482] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:12.128046 13759 raft_consensus.cc:3037] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.142199 13759 raft_consensus.cc:504] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:12.142792 13759 leader_election.cc:288] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [CANDIDATE]: Term 1 election: Requested vote from peers 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759), 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283)
I20240502 01:58:12.143121 12937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb77a056e494d5ab85138d8ecc52db9" candidate_uuid: "3d7bf587aa5a49eb92c3a53d17717149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e"
I20240502 01:58:12.143260 12937 raft_consensus.cc:3037] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.144134 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb77a056e494d5ab85138d8ecc52db9" candidate_uuid: "3d7bf587aa5a49eb92c3a53d17717149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a"
I20240502 01:58:12.144269 13473 raft_consensus.cc:3037] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.144456 12937 raft_consensus.cc:2454] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d7bf587aa5a49eb92c3a53d17717149 in term 1.
I20240502 01:58:12.145116 13473 raft_consensus.cc:2454] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d7bf587aa5a49eb92c3a53d17717149 in term 1.
I20240502 01:58:12.145102 13341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb77a056e494d5ab85138d8ecc52db9" candidate_uuid: "3d7bf587aa5a49eb92c3a53d17717149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665"
I20240502 01:58:12.145231 13341 raft_consensus.cc:3037] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.145529 13072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb77a056e494d5ab85138d8ecc52db9" candidate_uuid: "3d7bf587aa5a49eb92c3a53d17717149" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7"
I20240502 01:58:12.145653 13072 raft_consensus.cc:3037] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.145715 13143 leader_election.cc:302] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1928367ae8d64ba49a7f5761b2d3dc4a, 3d7bf587aa5a49eb92c3a53d17717149, 42bc78875b454c7ab7fce86d56a28c1e; no voters:
I20240502 01:58:12.145917 13759 raft_consensus.cc:2781] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:12.146057 13759 raft_consensus.cc:686] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 LEADER]: Becoming Leader. State: Replica: 3d7bf587aa5a49eb92c3a53d17717149, State: Running, Role: LEADER
I20240502 01:58:12.146243 13759 consensus_queue.cc:237] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:12.148245 12655 catalog_manager.cc:5484] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196). New cstate: current_term: 1 leader_uuid: "3d7bf587aa5a49eb92c3a53d17717149" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:12.179459 13072 raft_consensus.cc:2454] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d7bf587aa5a49eb92c3a53d17717149 in term 1.
I20240502 01:58:12.179468 13341 raft_consensus.cc:2454] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d7bf587aa5a49eb92c3a53d17717149 in term 1.
I20240502 01:58:12.184948 13834 raft_consensus.cc:482] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:12.185065 13834 raft_consensus.cc:504] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:12.185628 13834 leader_election.cc:288] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825), 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263)
I20240502 01:58:12.186056 12937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1e0f3e6a85b4998bdaaf83117af6f20" candidate_uuid: "6b1e63d6b84a440a8864db2d36b57665" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e" is_pre_election: true
I20240502 01:58:12.186056 13072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1e0f3e6a85b4998bdaaf83117af6f20" candidate_uuid: "6b1e63d6b84a440a8864db2d36b57665" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7" is_pre_election: true
I20240502 01:58:12.186199 13072 raft_consensus.cc:2454] T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1e63d6b84a440a8864db2d36b57665 in term 0.
I20240502 01:58:12.186199 12937 raft_consensus.cc:2454] T f1e0f3e6a85b4998bdaaf83117af6f20 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1e63d6b84a440a8864db2d36b57665 in term 0.
I20240502 01:58:12.186339 13208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1e0f3e6a85b4998bdaaf83117af6f20" candidate_uuid: "6b1e63d6b84a440a8864db2d36b57665" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149" is_pre_election: true
I20240502 01:58:12.186461 12804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1e0f3e6a85b4998bdaaf83117af6f20" candidate_uuid: "6b1e63d6b84a440a8864db2d36b57665" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" is_pre_election: true
I20240502 01:58:12.186506 13208 raft_consensus.cc:2454] T f1e0f3e6a85b4998bdaaf83117af6f20 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1e63d6b84a440a8864db2d36b57665 in term 0.
I20240502 01:58:12.186640 12804 raft_consensus.cc:2454] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b1e63d6b84a440a8864db2d36b57665 in term 0.
I20240502 01:58:12.186719 13273 leader_election.cc:302] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 42bc78875b454c7ab7fce86d56a28c1e, 6b1e63d6b84a440a8864db2d36b57665, 71010353c29d4e988704295c8cd73ef7; no voters:
I20240502 01:58:12.186909 13834 raft_consensus.cc:2781] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:12.186977 13834 raft_consensus.cc:482] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:12.187023 13834 raft_consensus.cc:3037] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.219964 13834 raft_consensus.cc:504] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:12.220536 13834 leader_election.cc:288] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [CANDIDATE]: Term 1 election: Requested vote from peers 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825), 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263)
I20240502 01:58:12.220975 13072 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1e0f3e6a85b4998bdaaf83117af6f20" candidate_uuid: "6b1e63d6b84a440a8864db2d36b57665" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7"
I20240502 01:58:12.220975 12937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1e0f3e6a85b4998bdaaf83117af6f20" candidate_uuid: "6b1e63d6b84a440a8864db2d36b57665" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e"
I20240502 01:58:12.221107 12937 raft_consensus.cc:3037] T f1e0f3e6a85b4998bdaaf83117af6f20 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.221107 13072 raft_consensus.cc:3037] T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.221237 13208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1e0f3e6a85b4998bdaaf83117af6f20" candidate_uuid: "6b1e63d6b84a440a8864db2d36b57665" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149"
I20240502 01:58:12.221385 13208 raft_consensus.cc:3037] T f1e0f3e6a85b4998bdaaf83117af6f20 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.222093 12937 raft_consensus.cc:2454] T f1e0f3e6a85b4998bdaaf83117af6f20 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1e63d6b84a440a8864db2d36b57665 in term 1.
I20240502 01:58:12.222093 13072 raft_consensus.cc:2454] T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1e63d6b84a440a8864db2d36b57665 in term 1.
I20240502 01:58:12.222373 12804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1e0f3e6a85b4998bdaaf83117af6f20" candidate_uuid: "6b1e63d6b84a440a8864db2d36b57665" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e2acacdad14caa8f66bc81fa8a2f88"
I20240502 01:58:12.222505 12804 raft_consensus.cc:3037] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.222806 13276 leader_election.cc:302] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 42bc78875b454c7ab7fce86d56a28c1e, 6b1e63d6b84a440a8864db2d36b57665, 71010353c29d4e988704295c8cd73ef7; no voters:
I20240502 01:58:12.222995 13834 raft_consensus.cc:2781] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:12.223078 13834 raft_consensus.cc:686] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 LEADER]: Becoming Leader. State: Replica: 6b1e63d6b84a440a8864db2d36b57665, State: Running, Role: LEADER
I20240502 01:58:12.223219 13834 consensus_queue.cc:237] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:12.225174 12655 catalog_manager.cc:5484] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197). New cstate: current_term: 1 leader_uuid: "6b1e63d6b84a440a8864db2d36b57665" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:12.250217 13208 raft_consensus.cc:2454] T f1e0f3e6a85b4998bdaaf83117af6f20 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1e63d6b84a440a8864db2d36b57665 in term 1.
I20240502 01:58:12.250217 12804 raft_consensus.cc:2454] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b1e63d6b84a440a8864db2d36b57665 in term 1.
W20240502 01:58:12.346666 13883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:12.346896 13883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:12.349856 13883 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_1'
I20240502 01:58:12.436338 13341 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:12.436398 13473 raft_consensus.cc:1261] T 6b4405ed71824af7bde2e54f5f592d10 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:12.437356 12937 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:12.437549 13208 raft_consensus.cc:1261] T f1e0f3e6a85b4998bdaaf83117af6f20 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:12.437928 12804 raft_consensus.cc:1261] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:12.438035 13759 consensus_queue.cc:1035] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:12.438401 13877 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:12.438572 13768 consensus_queue.cc:1035] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:12.438660 13072 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:12.438869 13834 consensus_queue.cc:1035] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:12.439364 13072 raft_consensus.cc:1261] T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:12.440119 13473 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:12.440830 13759 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:12.441130 13759 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:12.441417 13759 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:12.441715 13768 consensus_queue.cc:1035] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:12.443115 12938 raft_consensus.cc:1261] T f1e0f3e6a85b4998bdaaf83117af6f20 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:12.446044 13768 consensus_queue.cc:1035] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:12.469185 13340 raft_consensus.cc:1261] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:12.470420 13072 raft_consensus.cc:1261] T 6b4405ed71824af7bde2e54f5f592d10 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:12.470559 13759 consensus_queue.cc:1035] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:12.471371 13877 consensus_queue.cc:1035] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:12.482259 12936 raft_consensus.cc:1261] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:12.486450 13910 consensus_queue.cc:1035] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 173.657 ms
time per row: 0.0868287 ms
I20240502 01:58:12.567359 12657 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43822:
name: "rebalance_test_table_2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 01:58:12.573343 13452 tablet_service.cc:1467] Processing CreateTablet for tablet 8ec2e7e6494c42749311d109abfdd205 (DEFAULT_TABLE table=rebalance_test_table_2 [id=41727fe31ec64883ac850e582b40cb0b]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.573649 13452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ec2e7e6494c42749311d109abfdd205. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.573647 13050 tablet_service.cc:1467] Processing CreateTablet for tablet 8ec2e7e6494c42749311d109abfdd205 (DEFAULT_TABLE table=rebalance_test_table_2 [id=41727fe31ec64883ac850e582b40cb0b]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.573957 13050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ec2e7e6494c42749311d109abfdd205. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.575353 12784 tablet_service.cc:1467] Processing CreateTablet for tablet 8ec2e7e6494c42749311d109abfdd205 (DEFAULT_TABLE table=rebalance_test_table_2 [id=41727fe31ec64883ac850e582b40cb0b]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.575475 12785 tablet_service.cc:1467] Processing CreateTablet for tablet bc637bf633fc4fe58db54a6bc0821417 (DEFAULT_TABLE table=rebalance_test_table_2 [id=41727fe31ec64883ac850e582b40cb0b]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.575685 12784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ec2e7e6494c42749311d109abfdd205. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.576067 12783 tablet_service.cc:1467] Processing CreateTablet for tablet a8e8a2483ab8452f9b798930ebc069ac (DEFAULT_TABLE table=rebalance_test_table_2 [id=41727fe31ec64883ac850e582b40cb0b]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.576283 12783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8e8a2483ab8452f9b798930ebc069ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.576577 13320 tablet_service.cc:1467] Processing CreateTablet for tablet bc637bf633fc4fe58db54a6bc0821417 (DEFAULT_TABLE table=rebalance_test_table_2 [id=41727fe31ec64883ac850e582b40cb0b]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.576756 13453 tablet_service.cc:1467] Processing CreateTablet for tablet a8e8a2483ab8452f9b798930ebc069ac (DEFAULT_TABLE table=rebalance_test_table_2 [id=41727fe31ec64883ac850e582b40cb0b]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.576855 13320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc637bf633fc4fe58db54a6bc0821417. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.576990 13453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8e8a2483ab8452f9b798930ebc069ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.578572 13937 tablet_bootstrap.cc:492] T 8ec2e7e6494c42749311d109abfdd205 P 27e2acacdad14caa8f66bc81fa8a2f88: Bootstrap starting.
I20240502 01:58:12.579147 13321 tablet_service.cc:1467] Processing CreateTablet for tablet a8e8a2483ab8452f9b798930ebc069ac (DEFAULT_TABLE table=rebalance_test_table_2 [id=41727fe31ec64883ac850e582b40cb0b]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.579384 13321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8e8a2483ab8452f9b798930ebc069ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.579468 13937 tablet_bootstrap.cc:654] T 8ec2e7e6494c42749311d109abfdd205 P 27e2acacdad14caa8f66bc81fa8a2f88: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.579648 12785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc637bf633fc4fe58db54a6bc0821417. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.580365 13937 tablet_bootstrap.cc:492] T 8ec2e7e6494c42749311d109abfdd205 P 27e2acacdad14caa8f66bc81fa8a2f88: No bootstrap required, opened a new log
I20240502 01:58:12.580426 13937 ts_tablet_manager.cc:1367] T 8ec2e7e6494c42749311d109abfdd205 P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:12.580751 13937 raft_consensus.cc:348] T 8ec2e7e6494c42749311d109abfdd205 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:12.580837 13937 raft_consensus.cc:374] T 8ec2e7e6494c42749311d109abfdd205 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.580858 13937 raft_consensus.cc:729] T 8ec2e7e6494c42749311d109abfdd205 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.580966 13937 consensus_queue.cc:260] T 8ec2e7e6494c42749311d109abfdd205 P 27e2acacdad14caa8f66bc81fa8a2f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:12.581210 13937 ts_tablet_manager.cc:1398] T 8ec2e7e6494c42749311d109abfdd205 P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:12.581329 13937 tablet_bootstrap.cc:492] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88: Bootstrap starting.
I20240502 01:58:12.581763 13187 tablet_service.cc:1467] Processing CreateTablet for tablet 8ec2e7e6494c42749311d109abfdd205 (DEFAULT_TABLE table=rebalance_test_table_2 [id=41727fe31ec64883ac850e582b40cb0b]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.582067 13937 tablet_bootstrap.cc:654] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.582110 13187 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ec2e7e6494c42749311d109abfdd205. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.582919 13937 tablet_bootstrap.cc:492] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88: No bootstrap required, opened a new log
I20240502 01:58:12.583003 13937 ts_tablet_manager.cc:1367] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240502 01:58:12.583017 13050 tablet_service.cc:1467] Processing CreateTablet for tablet bc637bf633fc4fe58db54a6bc0821417 (DEFAULT_TABLE table=rebalance_test_table_2 [id=41727fe31ec64883ac850e582b40cb0b]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.583281 13050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc637bf633fc4fe58db54a6bc0821417. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.583379 13937 raft_consensus.cc:348] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.583487 13937 raft_consensus.cc:374] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.583528 13937 raft_consensus.cc:729] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.583640 13937 consensus_queue.cc:260] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.583900 13937 ts_tablet_manager.cc:1398] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:12.583902 12917 tablet_service.cc:1467] Processing CreateTablet for tablet bc637bf633fc4fe58db54a6bc0821417 (DEFAULT_TABLE table=rebalance_test_table_2 [id=41727fe31ec64883ac850e582b40cb0b]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.584060 13937 tablet_bootstrap.cc:492] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88: Bootstrap starting.
I20240502 01:58:12.584168 12917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc637bf633fc4fe58db54a6bc0821417. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.584126 12918 tablet_service.cc:1467] Processing CreateTablet for tablet a8e8a2483ab8452f9b798930ebc069ac (DEFAULT_TABLE table=rebalance_test_table_2 [id=41727fe31ec64883ac850e582b40cb0b]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.584327 12918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8e8a2483ab8452f9b798930ebc069ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.583896 12916 tablet_service.cc:1467] Processing CreateTablet for tablet 8ec2e7e6494c42749311d109abfdd205 (DEFAULT_TABLE table=rebalance_test_table_2 [id=41727fe31ec64883ac850e582b40cb0b]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.581766 13185 tablet_service.cc:1467] Processing CreateTablet for tablet a8e8a2483ab8452f9b798930ebc069ac (DEFAULT_TABLE table=rebalance_test_table_2 [id=41727fe31ec64883ac850e582b40cb0b]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.584591 12916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ec2e7e6494c42749311d109abfdd205. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.584676 13185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8e8a2483ab8452f9b798930ebc069ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.585116 13937 tablet_bootstrap.cc:654] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.587083 13452 tablet_service.cc:1467] Processing CreateTablet for tablet bc637bf633fc4fe58db54a6bc0821417 (DEFAULT_TABLE table=rebalance_test_table_2 [id=41727fe31ec64883ac850e582b40cb0b]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:12.587399 13452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc637bf633fc4fe58db54a6bc0821417. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:12.590162 13938 tablet_bootstrap.cc:492] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665: Bootstrap starting.
I20240502 01:58:12.590265 13936 tablet_bootstrap.cc:492] T 8ec2e7e6494c42749311d109abfdd205 P 71010353c29d4e988704295c8cd73ef7: Bootstrap starting.
I20240502 01:58:12.591101 13936 tablet_bootstrap.cc:654] T 8ec2e7e6494c42749311d109abfdd205 P 71010353c29d4e988704295c8cd73ef7: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.591181 13938 tablet_bootstrap.cc:654] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.591992 13943 tablet_bootstrap.cc:492] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e: Bootstrap starting.
I20240502 01:58:12.592012 13941 tablet_bootstrap.cc:492] T 8ec2e7e6494c42749311d109abfdd205 P 3d7bf587aa5a49eb92c3a53d17717149: Bootstrap starting.
I20240502 01:58:12.592216 13937 tablet_bootstrap.cc:492] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88: No bootstrap required, opened a new log
I20240502 01:58:12.592299 13937 ts_tablet_manager.cc:1367] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20240502 01:58:12.592741 13943 tablet_bootstrap.cc:654] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.592772 13937 raft_consensus.cc:348] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } }
I20240502 01:58:12.592895 13937 raft_consensus.cc:374] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.592936 13937 raft_consensus.cc:729] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.593000 13941 tablet_bootstrap.cc:654] T 8ec2e7e6494c42749311d109abfdd205 P 3d7bf587aa5a49eb92c3a53d17717149: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.593089 13937 consensus_queue.cc:260] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } }
I20240502 01:58:12.593415 13937 ts_tablet_manager.cc:1398] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:12.593731 13943 tablet_bootstrap.cc:492] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e: No bootstrap required, opened a new log
I20240502 01:58:12.593818 13943 ts_tablet_manager.cc:1367] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:12.594128 13935 tablet_bootstrap.cc:492] T 8ec2e7e6494c42749311d109abfdd205 P 1928367ae8d64ba49a7f5761b2d3dc4a: Bootstrap starting.
I20240502 01:58:12.594280 13941 tablet_bootstrap.cc:492] T 8ec2e7e6494c42749311d109abfdd205 P 3d7bf587aa5a49eb92c3a53d17717149: No bootstrap required, opened a new log
I20240502 01:58:12.594374 13941 ts_tablet_manager.cc:1367] T 8ec2e7e6494c42749311d109abfdd205 P 3d7bf587aa5a49eb92c3a53d17717149: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:12.594880 13941 raft_consensus.cc:348] T 8ec2e7e6494c42749311d109abfdd205 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:12.594981 13941 raft_consensus.cc:374] T 8ec2e7e6494c42749311d109abfdd205 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.595021 13941 raft_consensus.cc:729] T 8ec2e7e6494c42749311d109abfdd205 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d7bf587aa5a49eb92c3a53d17717149, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.595158 13941 consensus_queue.cc:260] T 8ec2e7e6494c42749311d109abfdd205 P 3d7bf587aa5a49eb92c3a53d17717149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:12.595206 13943 raft_consensus.cc:348] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.595373 13943 raft_consensus.cc:374] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.595413 13943 raft_consensus.cc:729] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42bc78875b454c7ab7fce86d56a28c1e, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.595446 13941 ts_tablet_manager.cc:1398] T 8ec2e7e6494c42749311d109abfdd205 P 3d7bf587aa5a49eb92c3a53d17717149: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:12.595630 13941 tablet_bootstrap.cc:492] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149: Bootstrap starting.
I20240502 01:58:12.595939 13935 tablet_bootstrap.cc:654] T 8ec2e7e6494c42749311d109abfdd205 P 1928367ae8d64ba49a7f5761b2d3dc4a: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.595870 13943 consensus_queue.cc:260] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.596427 13941 tablet_bootstrap.cc:654] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.597414 13936 tablet_bootstrap.cc:492] T 8ec2e7e6494c42749311d109abfdd205 P 71010353c29d4e988704295c8cd73ef7: No bootstrap required, opened a new log
I20240502 01:58:12.597482 13935 tablet_bootstrap.cc:492] T 8ec2e7e6494c42749311d109abfdd205 P 1928367ae8d64ba49a7f5761b2d3dc4a: No bootstrap required, opened a new log
I20240502 01:58:12.597517 13936 ts_tablet_manager.cc:1367] T 8ec2e7e6494c42749311d109abfdd205 P 71010353c29d4e988704295c8cd73ef7: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240502 01:58:12.597573 13935 ts_tablet_manager.cc:1367] T 8ec2e7e6494c42749311d109abfdd205 P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:58:12.597929 13936 raft_consensus.cc:348] T 8ec2e7e6494c42749311d109abfdd205 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:12.598078 13936 raft_consensus.cc:374] T 8ec2e7e6494c42749311d109abfdd205 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.598120 13936 raft_consensus.cc:729] T 8ec2e7e6494c42749311d109abfdd205 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71010353c29d4e988704295c8cd73ef7, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.598091 13935 raft_consensus.cc:348] T 8ec2e7e6494c42749311d109abfdd205 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:12.598207 13935 raft_consensus.cc:374] T 8ec2e7e6494c42749311d109abfdd205 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.598253 13935 raft_consensus.cc:729] T 8ec2e7e6494c42749311d109abfdd205 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1928367ae8d64ba49a7f5761b2d3dc4a, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.598328 13938 tablet_bootstrap.cc:492] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665: No bootstrap required, opened a new log
I20240502 01:58:12.598269 13936 consensus_queue.cc:260] T 8ec2e7e6494c42749311d109abfdd205 P 71010353c29d4e988704295c8cd73ef7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:12.598418 13938 ts_tablet_manager.cc:1367] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20240502 01:58:12.598384 13935 consensus_queue.cc:260] T 8ec2e7e6494c42749311d109abfdd205 P 1928367ae8d64ba49a7f5761b2d3dc4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:12.598578 13936 ts_tablet_manager.cc:1398] T 8ec2e7e6494c42749311d109abfdd205 P 71010353c29d4e988704295c8cd73ef7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:12.598740 13936 tablet_bootstrap.cc:492] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7: Bootstrap starting.
I20240502 01:58:12.598876 13938 raft_consensus.cc:348] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } }
I20240502 01:58:12.599004 13938 raft_consensus.cc:374] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.599037 13938 raft_consensus.cc:729] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1e63d6b84a440a8864db2d36b57665, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.599210 13938 consensus_queue.cc:260] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } }
I20240502 01:58:12.599922 13936 tablet_bootstrap.cc:654] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.600435 13938 ts_tablet_manager.cc:1398] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:12.600641 13938 tablet_bootstrap.cc:492] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665: Bootstrap starting.
I20240502 01:58:12.602491 13941 tablet_bootstrap.cc:492] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149: No bootstrap required, opened a new log
I20240502 01:58:12.602586 13941 ts_tablet_manager.cc:1367] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20240502 01:58:12.602823 13938 tablet_bootstrap.cc:654] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.603040 13941 raft_consensus.cc:348] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.603168 13941 raft_consensus.cc:374] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.603186 13935 ts_tablet_manager.cc:1398] T 8ec2e7e6494c42749311d109abfdd205 P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20240502 01:58:12.603202 13941 raft_consensus.cc:729] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d7bf587aa5a49eb92c3a53d17717149, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.603322 13941 consensus_queue.cc:260] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.603480 13943 ts_tablet_manager.cc:1398] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20240502 01:58:12.603602 13941 ts_tablet_manager.cc:1398] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:12.604118 13935 tablet_bootstrap.cc:492] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a: Bootstrap starting.
I20240502 01:58:12.605119 13935 tablet_bootstrap.cc:654] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.605361 13943 tablet_bootstrap.cc:492] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e: Bootstrap starting.
I20240502 01:58:12.606253 13935 tablet_bootstrap.cc:492] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a: No bootstrap required, opened a new log
I20240502 01:58:12.606315 13943 tablet_bootstrap.cc:654] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.606353 13935 ts_tablet_manager.cc:1367] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:12.606813 13935 raft_consensus.cc:348] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.606956 13935 raft_consensus.cc:374] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.607062 13935 raft_consensus.cc:729] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1928367ae8d64ba49a7f5761b2d3dc4a, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.607209 13935 consensus_queue.cc:260] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.607403 13943 tablet_bootstrap.cc:492] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e: No bootstrap required, opened a new log
I20240502 01:58:12.607460 13936 tablet_bootstrap.cc:492] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7: No bootstrap required, opened a new log
I20240502 01:58:12.607492 13943 ts_tablet_manager.cc:1367] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:12.607553 13936 ts_tablet_manager.cc:1367] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240502 01:58:12.607604 13935 ts_tablet_manager.cc:1398] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:12.607761 13935 tablet_bootstrap.cc:492] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a: Bootstrap starting.
I20240502 01:58:12.607930 13943 raft_consensus.cc:348] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:12.608049 13943 raft_consensus.cc:374] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.608088 13943 raft_consensus.cc:729] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42bc78875b454c7ab7fce86d56a28c1e, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.608042 13936 raft_consensus.cc:348] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } }
I20240502 01:58:12.608157 13936 raft_consensus.cc:374] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.608206 13936 raft_consensus.cc:729] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71010353c29d4e988704295c8cd73ef7, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.608235 13943 consensus_queue.cc:260] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:12.608342 13936 consensus_queue.cc:260] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } }
I20240502 01:58:12.608726 13936 ts_tablet_manager.cc:1398] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:12.609463 13938 tablet_bootstrap.cc:492] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665: No bootstrap required, opened a new log
I20240502 01:58:12.609560 13938 ts_tablet_manager.cc:1367] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240502 01:58:12.610483 13935 tablet_bootstrap.cc:654] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.610741 13938 raft_consensus.cc:348] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.610860 13938 raft_consensus.cc:374] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.610895 13938 raft_consensus.cc:729] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1e63d6b84a440a8864db2d36b57665, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.611011 13938 consensus_queue.cc:260] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.611343 13938 ts_tablet_manager.cc:1398] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:12.612149 13943 ts_tablet_manager.cc:1398] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20240502 01:58:12.612329 13943 tablet_bootstrap.cc:492] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e: Bootstrap starting.
I20240502 01:58:12.612910 13935 tablet_bootstrap.cc:492] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a: No bootstrap required, opened a new log
I20240502 01:58:12.612993 13935 ts_tablet_manager.cc:1367] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:58:12.613236 13943 tablet_bootstrap.cc:654] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:12.613432 13935 raft_consensus.cc:348] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } }
I20240502 01:58:12.613574 13935 raft_consensus.cc:374] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.613620 13935 raft_consensus.cc:729] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1928367ae8d64ba49a7f5761b2d3dc4a, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.613744 13935 consensus_queue.cc:260] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } }
I20240502 01:58:12.614689 13943 tablet_bootstrap.cc:492] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e: No bootstrap required, opened a new log
I20240502 01:58:12.614733 13935 ts_tablet_manager.cc:1398] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:12.614776 13943 ts_tablet_manager.cc:1367] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:12.615252 13943 raft_consensus.cc:348] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } }
I20240502 01:58:12.615376 13943 raft_consensus.cc:374] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:12.615412 13943 raft_consensus.cc:729] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42bc78875b454c7ab7fce86d56a28c1e, State: Initialized, Role: FOLLOWER
I20240502 01:58:12.615541 13943 consensus_queue.cc:260] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } }
I20240502 01:58:12.615816 13943 ts_tablet_manager.cc:1398] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:12.649446 13932 raft_consensus.cc:482] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:12.649598 13932 raft_consensus.cc:504] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.650136 13932 leader_election.cc:288] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283), 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825), 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759)
I20240502 01:58:12.650462 13340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8e8a2483ab8452f9b798930ebc069ac" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665" is_pre_election: true
I20240502 01:58:12.650450 12936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8e8a2483ab8452f9b798930ebc069ac" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e" is_pre_election: true
I20240502 01:58:12.650523 13208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8e8a2483ab8452f9b798930ebc069ac" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149" is_pre_election: true
I20240502 01:58:12.650605 13340 raft_consensus.cc:2454] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:12.650606 12936 raft_consensus.cc:2454] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:12.650668 13208 raft_consensus.cc:2454] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:12.650661 13472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8e8a2483ab8452f9b798930ebc069ac" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" is_pre_election: true
I20240502 01:58:12.650791 13472 raft_consensus.cc:2454] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:12.650954 12738 leader_election.cc:302] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 27e2acacdad14caa8f66bc81fa8a2f88, 42bc78875b454c7ab7fce86d56a28c1e, 6b1e63d6b84a440a8864db2d36b57665; no voters:
I20240502 01:58:12.651134 13932 raft_consensus.cc:2781] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:12.651191 13932 raft_consensus.cc:482] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:12.651239 13932 raft_consensus.cc:3037] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.688344 13741 raft_consensus.cc:482] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:12.688508 13741 raft_consensus.cc:504] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } }
I20240502 01:58:12.689723 13741 leader_election.cc:288] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263), 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143)
I20240502 01:58:12.694516 13340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc637bf633fc4fe58db54a6bc0821417" candidate_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665" is_pre_election: true
I20240502 01:58:12.694689 13340 raft_consensus.cc:2454] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1928367ae8d64ba49a7f5761b2d3dc4a in term 0.
I20240502 01:58:12.695039 13071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc637bf633fc4fe58db54a6bc0821417" candidate_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7" is_pre_election: true
I20240502 01:58:12.695088 12936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc637bf633fc4fe58db54a6bc0821417" candidate_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e" is_pre_election: true
I20240502 01:58:12.695201 13071 raft_consensus.cc:2454] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1928367ae8d64ba49a7f5761b2d3dc4a in term 0.
I20240502 01:58:12.695225 12936 raft_consensus.cc:2454] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1928367ae8d64ba49a7f5761b2d3dc4a in term 0.
I20240502 01:58:12.695508 13406 leader_election.cc:302] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1928367ae8d64ba49a7f5761b2d3dc4a, 42bc78875b454c7ab7fce86d56a28c1e, 6b1e63d6b84a440a8864db2d36b57665; no voters:
I20240502 01:58:12.695766 13741 raft_consensus.cc:2781] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:12.695827 13741 raft_consensus.cc:482] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:12.695873 13741 raft_consensus.cc:3037] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.696100 12804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc637bf633fc4fe58db54a6bc0821417" candidate_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" is_pre_election: true
I20240502 01:58:12.696236 12804 raft_consensus.cc:2454] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1928367ae8d64ba49a7f5761b2d3dc4a in term 0.
I20240502 01:58:12.734769 13741 raft_consensus.cc:504] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } }
I20240502 01:58:12.734778 13932 raft_consensus.cc:504] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.735338 13741 leader_election.cc:288] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [CANDIDATE]: Term 1 election: Requested vote from peers 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263), 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143)
I20240502 01:58:12.735502 13932 leader_election.cc:288] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 election: Requested vote from peers 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283), 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825), 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759)
I20240502 01:58:12.735881 13071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc637bf633fc4fe58db54a6bc0821417" candidate_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7"
I20240502 01:58:12.735996 13071 raft_consensus.cc:3037] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.736218 13208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8e8a2483ab8452f9b798930ebc069ac" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149"
I20240502 01:58:12.736366 13208 raft_consensus.cc:3037] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.737027 13071 raft_consensus.cc:2454] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1928367ae8d64ba49a7f5761b2d3dc4a in term 1.
I20240502 01:58:12.737586 13208 raft_consensus.cc:2454] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:12.738086 13472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8e8a2483ab8452f9b798930ebc069ac" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a"
I20240502 01:58:12.738195 13472 raft_consensus.cc:3037] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.738592 12937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc637bf633fc4fe58db54a6bc0821417" candidate_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e"
I20240502 01:58:12.738725 12937 raft_consensus.cc:3037] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.738816 13340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc637bf633fc4fe58db54a6bc0821417" candidate_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665"
I20240502 01:58:12.738936 13340 raft_consensus.cc:3037] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.739275 12936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8e8a2483ab8452f9b798930ebc069ac" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e"
I20240502 01:58:12.739384 12936 raft_consensus.cc:3037] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.739919 13341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8e8a2483ab8452f9b798930ebc069ac" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665"
I20240502 01:58:12.740029 13341 raft_consensus.cc:3037] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.740200 12804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc637bf633fc4fe58db54a6bc0821417" candidate_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e2acacdad14caa8f66bc81fa8a2f88"
I20240502 01:58:12.740301 12804 raft_consensus.cc:3037] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.783830 13745 raft_consensus.cc:482] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:12.783969 13745 raft_consensus.cc:504] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:12.785190 13745 leader_election.cc:288] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825)
I20240502 01:58:12.790585 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ec2e7e6494c42749311d109abfdd205" candidate_uuid: "42bc78875b454c7ab7fce86d56a28c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" is_pre_election: true
I20240502 01:58:12.790625 13071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ec2e7e6494c42749311d109abfdd205" candidate_uuid: "42bc78875b454c7ab7fce86d56a28c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7" is_pre_election: true
I20240502 01:58:12.790760 13473 raft_consensus.cc:2454] T 8ec2e7e6494c42749311d109abfdd205 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42bc78875b454c7ab7fce86d56a28c1e in term 0.
I20240502 01:58:12.790733 13208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ec2e7e6494c42749311d109abfdd205" candidate_uuid: "42bc78875b454c7ab7fce86d56a28c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149" is_pre_election: true
I20240502 01:58:12.790792 13071 raft_consensus.cc:2454] T 8ec2e7e6494c42749311d109abfdd205 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42bc78875b454c7ab7fce86d56a28c1e in term 0.
I20240502 01:58:12.790859 13208 raft_consensus.cc:2454] T 8ec2e7e6494c42749311d109abfdd205 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42bc78875b454c7ab7fce86d56a28c1e in term 0.
I20240502 01:58:12.790982 12805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ec2e7e6494c42749311d109abfdd205" candidate_uuid: "42bc78875b454c7ab7fce86d56a28c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" is_pre_election: true
I20240502 01:58:12.791134 12805 raft_consensus.cc:2454] T 8ec2e7e6494c42749311d109abfdd205 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42bc78875b454c7ab7fce86d56a28c1e in term 0.
I20240502 01:58:12.791252 12873 leader_election.cc:302] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1928367ae8d64ba49a7f5761b2d3dc4a, 42bc78875b454c7ab7fce86d56a28c1e, 71010353c29d4e988704295c8cd73ef7; no voters:
I20240502 01:58:12.791543 13745 raft_consensus.cc:2781] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:12.791611 13745 raft_consensus.cc:482] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:12.791651 13745 raft_consensus.cc:3037] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.831943 13340 raft_consensus.cc:2454] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1928367ae8d64ba49a7f5761b2d3dc4a in term 1.
I20240502 01:58:12.831944 13472 raft_consensus.cc:2454] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:12.831944 12937 raft_consensus.cc:2454] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1928367ae8d64ba49a7f5761b2d3dc4a in term 1.
I20240502 01:58:12.832305 12804 raft_consensus.cc:2454] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1928367ae8d64ba49a7f5761b2d3dc4a in term 1.
I20240502 01:58:12.832329 12936 raft_consensus.cc:2454] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:12.832857 13409 leader_election.cc:302] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1928367ae8d64ba49a7f5761b2d3dc4a, 6b1e63d6b84a440a8864db2d36b57665, 71010353c29d4e988704295c8cd73ef7; no voters:
I20240502 01:58:12.832890 12741 leader_election.cc:302] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1928367ae8d64ba49a7f5761b2d3dc4a, 27e2acacdad14caa8f66bc81fa8a2f88, 3d7bf587aa5a49eb92c3a53d17717149; no voters:
I20240502 01:58:12.833055 13741 raft_consensus.cc:2781] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:12.833207 13932 raft_consensus.cc:2781] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:12.833266 13741 raft_consensus.cc:686] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 LEADER]: Becoming Leader. State: Replica: 1928367ae8d64ba49a7f5761b2d3dc4a, State: Running, Role: LEADER
I20240502 01:58:12.833302 13932 raft_consensus.cc:686] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Becoming Leader. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Running, Role: LEADER
I20240502 01:58:12.833506 13745 raft_consensus.cc:504] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:12.833477 13932 consensus_queue.cc:237] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:12.833611 13741 consensus_queue.cc:237] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } }
I20240502 01:58:12.834506 13071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ec2e7e6494c42749311d109abfdd205" candidate_uuid: "42bc78875b454c7ab7fce86d56a28c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7"
I20240502 01:58:12.834635 13071 raft_consensus.cc:3037] T 8ec2e7e6494c42749311d109abfdd205 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.835462 13745 leader_election.cc:288] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [CANDIDATE]: Term 1 election: Requested vote from peers 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825)
I20240502 01:58:12.835958 13472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ec2e7e6494c42749311d109abfdd205" candidate_uuid: "42bc78875b454c7ab7fce86d56a28c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a"
I20240502 01:58:12.836063 13472 raft_consensus.cc:3037] T 8ec2e7e6494c42749311d109abfdd205 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.836603 12804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ec2e7e6494c42749311d109abfdd205" candidate_uuid: "42bc78875b454c7ab7fce86d56a28c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e2acacdad14caa8f66bc81fa8a2f88"
I20240502 01:58:12.836724 12804 raft_consensus.cc:3037] T 8ec2e7e6494c42749311d109abfdd205 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.836860 12659 catalog_manager.cc:5484] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198). New cstate: current_term: 1 leader_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:12.837473 13208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ec2e7e6494c42749311d109abfdd205" candidate_uuid: "42bc78875b454c7ab7fce86d56a28c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149"
I20240502 01:58:12.837399 12657 catalog_manager.cc:5484] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193). New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:12.837615 13208 raft_consensus.cc:3037] T 8ec2e7e6494c42749311d109abfdd205 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:12.924930 13208 raft_consensus.cc:2454] T 8ec2e7e6494c42749311d109abfdd205 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42bc78875b454c7ab7fce86d56a28c1e in term 1.
I20240502 01:58:12.924952 13472 raft_consensus.cc:2454] T 8ec2e7e6494c42749311d109abfdd205 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42bc78875b454c7ab7fce86d56a28c1e in term 1.
I20240502 01:58:12.924948 13071 raft_consensus.cc:2454] T 8ec2e7e6494c42749311d109abfdd205 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42bc78875b454c7ab7fce86d56a28c1e in term 1.
I20240502 01:58:12.925328 13341 raft_consensus.cc:2454] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:12.925426 12872 leader_election.cc:302] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1928367ae8d64ba49a7f5761b2d3dc4a, 3d7bf587aa5a49eb92c3a53d17717149, 42bc78875b454c7ab7fce86d56a28c1e; no voters:
I20240502 01:58:12.925640 13745 raft_consensus.cc:2781] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:12.925895 13745 raft_consensus.cc:686] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 LEADER]: Becoming Leader. State: Replica: 42bc78875b454c7ab7fce86d56a28c1e, State: Running, Role: LEADER
I20240502 01:58:12.926019 12804 raft_consensus.cc:2454] T 8ec2e7e6494c42749311d109abfdd205 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42bc78875b454c7ab7fce86d56a28c1e in term 1.
I20240502 01:58:12.926298 13745 consensus_queue.cc:237] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:12.929133 12657 catalog_manager.cc:5484] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194). New cstate: current_term: 1 leader_uuid: "42bc78875b454c7ab7fce86d56a28c1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: UNKNOWN } } }
W20240502 01:58:12.957664 12740 consensus_peers.cc:485] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 -> Peer 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199:34821): Couldn't send request to peer 1ef9768a03e545fba961cfeee4c1c867. Status: Network error: Client connection negotiation failed: client connection to 127.10.133.199:34821: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20240502 01:58:13.067680 13974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:13.067950 13974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:13.072284 13974 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_2'
I20240502 01:58:13.170198 12936 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.170198 13071 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.171245 13741 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.171635 13208 raft_consensus.cc:1261] T 8ec2e7e6494c42749311d109abfdd205 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.171679 13741 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.171829 12804 raft_consensus.cc:1261] T 8ec2e7e6494c42749311d109abfdd205 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.172070 13472 raft_consensus.cc:1261] T 8ec2e7e6494c42749311d109abfdd205 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.172291 13745 consensus_queue.cc:1035] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.172430 13972 consensus_queue.cc:1035] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.172688 13071 raft_consensus.cc:1261] T 8ec2e7e6494c42749311d109abfdd205 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.173151 14008 consensus_queue.cc:1035] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.174433 13341 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.174902 12804 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.175282 13968 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.175940 13968 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.177888 13972 consensus_queue.cc:1035] T 8ec2e7e6494c42749311d109abfdd205 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.193192 13473 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.193806 13827 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.198107 13207 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.200176 13827 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.205359 13341 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.207618 13827 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.210134 12936 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.210523 13827 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 175.5 ms
time per row: 0.0877502 ms
I20240502 01:58:13.295900 12657 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43822:
name: "rebalance_test_table_3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 01:58:13.301311 13050 tablet_service.cc:1467] Processing CreateTablet for tablet 16195ae890d445e39ed7ecdadde3009c (DEFAULT_TABLE table=rebalance_test_table_3 [id=e192d1fc91574f419257f076074a1378]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.301452 13185 tablet_service.cc:1467] Processing CreateTablet for tablet 16195ae890d445e39ed7ecdadde3009c (DEFAULT_TABLE table=rebalance_test_table_3 [id=e192d1fc91574f419257f076074a1378]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.301672 13050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16195ae890d445e39ed7ecdadde3009c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.301757 13185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16195ae890d445e39ed7ecdadde3009c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.302503 13051 tablet_service.cc:1467] Processing CreateTablet for tablet 281ea2fa1f9f49cebd4bb3620335168a (DEFAULT_TABLE table=rebalance_test_table_3 [id=e192d1fc91574f419257f076074a1378]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.302726 13051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281ea2fa1f9f49cebd4bb3620335168a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.303056 13321 tablet_service.cc:1467] Processing CreateTablet for tablet 16195ae890d445e39ed7ecdadde3009c (DEFAULT_TABLE table=rebalance_test_table_3 [id=e192d1fc91574f419257f076074a1378]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.303329 13321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16195ae890d445e39ed7ecdadde3009c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.303992 14058 tablet_bootstrap.cc:492] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7: Bootstrap starting.
I20240502 01:58:13.304462 12785 tablet_service.cc:1467] Processing CreateTablet for tablet 16195ae890d445e39ed7ecdadde3009c (DEFAULT_TABLE table=rebalance_test_table_3 [id=e192d1fc91574f419257f076074a1378]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.304736 12785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16195ae890d445e39ed7ecdadde3009c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.304843 14058 tablet_bootstrap.cc:654] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:13.305706 13452 tablet_service.cc:1467] Processing CreateTablet for tablet 16195ae890d445e39ed7ecdadde3009c (DEFAULT_TABLE table=rebalance_test_table_3 [id=e192d1fc91574f419257f076074a1378]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.305958 14058 tablet_bootstrap.cc:492] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7: No bootstrap required, opened a new log
I20240502 01:58:13.306017 13452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16195ae890d445e39ed7ecdadde3009c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.306056 14058 ts_tablet_manager.cc:1367] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:13.306470 14058 raft_consensus.cc:348] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:13.306586 14058 raft_consensus.cc:374] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:13.306612 14058 raft_consensus.cc:729] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71010353c29d4e988704295c8cd73ef7, State: Initialized, Role: FOLLOWER
I20240502 01:58:13.306766 14058 consensus_queue.cc:260] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:13.306978 14059 tablet_bootstrap.cc:492] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149: Bootstrap starting.
I20240502 01:58:13.307227 14062 tablet_bootstrap.cc:492] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88: Bootstrap starting.
I20240502 01:58:13.308185 14062 tablet_bootstrap.cc:654] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:13.308408 13453 tablet_service.cc:1467] Processing CreateTablet for tablet 281ea2fa1f9f49cebd4bb3620335168a (DEFAULT_TABLE table=rebalance_test_table_3 [id=e192d1fc91574f419257f076074a1378]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.308609 14059 tablet_bootstrap.cc:654] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:13.308652 13453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281ea2fa1f9f49cebd4bb3620335168a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.308982 14058 ts_tablet_manager.cc:1398] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:58:13.309309 14062 tablet_bootstrap.cc:492] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88: No bootstrap required, opened a new log
I20240502 01:58:13.309401 14062 ts_tablet_manager.cc:1367] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:13.309900 14062 raft_consensus.cc:348] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:13.310031 14062 raft_consensus.cc:374] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:13.310020 14059 tablet_bootstrap.cc:492] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149: No bootstrap required, opened a new log
I20240502 01:58:13.310065 14062 raft_consensus.cc:729] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Initialized, Role: FOLLOWER
I20240502 01:58:13.310127 14059 ts_tablet_manager.cc:1367] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:13.310180 14062 consensus_queue.cc:260] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:13.310465 14062 ts_tablet_manager.cc:1398] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:13.310611 14059 raft_consensus.cc:348] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:13.310708 14059 raft_consensus.cc:374] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:13.310740 14059 raft_consensus.cc:729] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d7bf587aa5a49eb92c3a53d17717149, State: Initialized, Role: FOLLOWER
I20240502 01:58:13.310849 12917 tablet_service.cc:1467] Processing CreateTablet for tablet 2963f09accd44e3db75d2f2c9b38b6cd (DEFAULT_TABLE table=rebalance_test_table_3 [id=e192d1fc91574f419257f076074a1378]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.310868 14059 consensus_queue.cc:260] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:13.311112 12917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2963f09accd44e3db75d2f2c9b38b6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.311152 14059 ts_tablet_manager.cc:1398] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:13.312165 14058 tablet_bootstrap.cc:492] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7: Bootstrap starting.
I20240502 01:58:13.313055 14058 tablet_bootstrap.cc:654] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:13.313050 14067 tablet_bootstrap.cc:492] T 2963f09accd44e3db75d2f2c9b38b6cd P 42bc78875b454c7ab7fce86d56a28c1e: Bootstrap starting.
I20240502 01:58:13.313931 14067 tablet_bootstrap.cc:654] T 2963f09accd44e3db75d2f2c9b38b6cd P 42bc78875b454c7ab7fce86d56a28c1e: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:13.314304 13187 tablet_service.cc:1467] Processing CreateTablet for tablet 2963f09accd44e3db75d2f2c9b38b6cd (DEFAULT_TABLE table=rebalance_test_table_3 [id=e192d1fc91574f419257f076074a1378]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.314335 12785 tablet_service.cc:1467] Processing CreateTablet for tablet 281ea2fa1f9f49cebd4bb3620335168a (DEFAULT_TABLE table=rebalance_test_table_3 [id=e192d1fc91574f419257f076074a1378]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.314378 12783 tablet_service.cc:1467] Processing CreateTablet for tablet 2963f09accd44e3db75d2f2c9b38b6cd (DEFAULT_TABLE table=rebalance_test_table_3 [id=e192d1fc91574f419257f076074a1378]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.314548 13187 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2963f09accd44e3db75d2f2c9b38b6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.314602 12785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281ea2fa1f9f49cebd4bb3620335168a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.314713 13185 tablet_service.cc:1467] Processing CreateTablet for tablet 281ea2fa1f9f49cebd4bb3620335168a (DEFAULT_TABLE table=rebalance_test_table_3 [id=e192d1fc91574f419257f076074a1378]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.314929 13185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281ea2fa1f9f49cebd4bb3620335168a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.316583 14062 tablet_bootstrap.cc:492] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88: Bootstrap starting.
I20240502 01:58:13.316704 14059 tablet_bootstrap.cc:492] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149: Bootstrap starting.
I20240502 01:58:13.316848 12783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2963f09accd44e3db75d2f2c9b38b6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.317553 14059 tablet_bootstrap.cc:654] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:13.317770 14062 tablet_bootstrap.cc:654] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:13.318907 13320 tablet_service.cc:1467] Processing CreateTablet for tablet 2963f09accd44e3db75d2f2c9b38b6cd (DEFAULT_TABLE table=rebalance_test_table_3 [id=e192d1fc91574f419257f076074a1378]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.318946 13051 tablet_service.cc:1467] Processing CreateTablet for tablet 2963f09accd44e3db75d2f2c9b38b6cd (DEFAULT_TABLE table=rebalance_test_table_3 [id=e192d1fc91574f419257f076074a1378]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.319110 14059 tablet_bootstrap.cc:492] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149: No bootstrap required, opened a new log
I20240502 01:58:13.319164 13320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2963f09accd44e3db75d2f2c9b38b6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.319164 13051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2963f09accd44e3db75d2f2c9b38b6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.319185 14059 ts_tablet_manager.cc:1367] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:13.319640 14059 raft_consensus.cc:348] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:13.319746 14059 raft_consensus.cc:374] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:13.319783 14059 raft_consensus.cc:729] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d7bf587aa5a49eb92c3a53d17717149, State: Initialized, Role: FOLLOWER
I20240502 01:58:13.319911 14059 consensus_queue.cc:260] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:13.320192 14059 ts_tablet_manager.cc:1398] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:13.320354 14059 tablet_bootstrap.cc:492] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149: Bootstrap starting.
I20240502 01:58:13.321189 14059 tablet_bootstrap.cc:654] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:13.321771 13321 tablet_service.cc:1467] Processing CreateTablet for tablet 281ea2fa1f9f49cebd4bb3620335168a (DEFAULT_TABLE table=rebalance_test_table_3 [id=e192d1fc91574f419257f076074a1378]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.322044 13321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281ea2fa1f9f49cebd4bb3620335168a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.322314 14059 tablet_bootstrap.cc:492] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149: No bootstrap required, opened a new log
I20240502 01:58:13.322386 14059 ts_tablet_manager.cc:1367] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:13.322480 14067 tablet_bootstrap.cc:492] T 2963f09accd44e3db75d2f2c9b38b6cd P 42bc78875b454c7ab7fce86d56a28c1e: No bootstrap required, opened a new log
I20240502 01:58:13.322585 14067 ts_tablet_manager.cc:1367] T 2963f09accd44e3db75d2f2c9b38b6cd P 42bc78875b454c7ab7fce86d56a28c1e: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20240502 01:58:13.322796 14059 raft_consensus.cc:348] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:13.322894 14059 raft_consensus.cc:374] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:13.322930 14059 raft_consensus.cc:729] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d7bf587aa5a49eb92c3a53d17717149, State: Initialized, Role: FOLLOWER
I20240502 01:58:13.322995 14067 raft_consensus.cc:348] T 2963f09accd44e3db75d2f2c9b38b6cd P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:13.323110 14067 raft_consensus.cc:374] T 2963f09accd44e3db75d2f2c9b38b6cd P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:13.323060 14059 consensus_queue.cc:260] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:13.323150 14067 raft_consensus.cc:729] T 2963f09accd44e3db75d2f2c9b38b6cd P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42bc78875b454c7ab7fce86d56a28c1e, State: Initialized, Role: FOLLOWER
I20240502 01:58:13.323274 14067 consensus_queue.cc:260] T 2963f09accd44e3db75d2f2c9b38b6cd P 42bc78875b454c7ab7fce86d56a28c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:13.323339 14059 ts_tablet_manager.cc:1398] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:13.323560 14067 ts_tablet_manager.cc:1398] T 2963f09accd44e3db75d2f2c9b38b6cd P 42bc78875b454c7ab7fce86d56a28c1e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:13.323969 14063 tablet_bootstrap.cc:492] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a: Bootstrap starting.
I20240502 01:58:13.324244 14060 tablet_bootstrap.cc:492] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665: Bootstrap starting.
I20240502 01:58:13.324870 14063 tablet_bootstrap.cc:654] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:13.324946 14060 tablet_bootstrap.cc:654] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:13.325940 14060 tablet_bootstrap.cc:492] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665: No bootstrap required, opened a new log
I20240502 01:58:13.326049 14060 ts_tablet_manager.cc:1367] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:13.326436 14060 raft_consensus.cc:348] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:13.326553 14060 raft_consensus.cc:374] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:13.326586 14060 raft_consensus.cc:729] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1e63d6b84a440a8864db2d36b57665, State: Initialized, Role: FOLLOWER
I20240502 01:58:13.327010 14058 tablet_bootstrap.cc:492] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7: No bootstrap required, opened a new log
I20240502 01:58:13.327018 14062 tablet_bootstrap.cc:492] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88: No bootstrap required, opened a new log
I20240502 01:58:13.327103 14062 ts_tablet_manager.cc:1367] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20240502 01:58:13.327108 14058 ts_tablet_manager.cc:1367] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20240502 01:58:13.327193 14063 tablet_bootstrap.cc:492] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a: No bootstrap required, opened a new log
I20240502 01:58:13.327284 14063 ts_tablet_manager.cc:1367] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:13.327531 14058 raft_consensus.cc:348] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:13.327555 14062 raft_consensus.cc:348] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:13.327626 14058 raft_consensus.cc:374] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:13.327661 14058 raft_consensus.cc:729] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71010353c29d4e988704295c8cd73ef7, State: Initialized, Role: FOLLOWER
I20240502 01:58:13.327658 14062 raft_consensus.cc:374] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:13.327698 14062 raft_consensus.cc:729] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Initialized, Role: FOLLOWER
I20240502 01:58:13.327697 14063 raft_consensus.cc:348] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:13.327809 14063 raft_consensus.cc:374] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:13.327850 14063 raft_consensus.cc:729] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1928367ae8d64ba49a7f5761b2d3dc4a, State: Initialized, Role: FOLLOWER
I20240502 01:58:13.327791 14058 consensus_queue.cc:260] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:13.327843 14062 consensus_queue.cc:260] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:13.327973 14063 consensus_queue.cc:260] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:13.328058 14058 ts_tablet_manager.cc:1398] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:13.328120 14062 ts_tablet_manager.cc:1398] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:13.328228 14058 tablet_bootstrap.cc:492] T 2963f09accd44e3db75d2f2c9b38b6cd P 71010353c29d4e988704295c8cd73ef7: Bootstrap starting.
I20240502 01:58:13.328243 14063 ts_tablet_manager.cc:1398] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:13.328277 14062 tablet_bootstrap.cc:492] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88: Bootstrap starting.
I20240502 01:58:13.328397 14063 tablet_bootstrap.cc:492] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a: Bootstrap starting.
I20240502 01:58:13.329149 14062 tablet_bootstrap.cc:654] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:13.329166 14063 tablet_bootstrap.cc:654] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:13.330828 14058 tablet_bootstrap.cc:654] T 2963f09accd44e3db75d2f2c9b38b6cd P 71010353c29d4e988704295c8cd73ef7: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:13.331537 14060 consensus_queue.cc:260] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:13.331859 14060 ts_tablet_manager.cc:1398] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20240502 01:58:13.332034 14060 tablet_bootstrap.cc:492] T 2963f09accd44e3db75d2f2c9b38b6cd P 6b1e63d6b84a440a8864db2d36b57665: Bootstrap starting.
I20240502 01:58:13.332931 14060 tablet_bootstrap.cc:654] T 2963f09accd44e3db75d2f2c9b38b6cd P 6b1e63d6b84a440a8864db2d36b57665: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:13.333076 14062 tablet_bootstrap.cc:492] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88: No bootstrap required, opened a new log
I20240502 01:58:13.333200 14062 ts_tablet_manager.cc:1367] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:58:13.333772 14062 raft_consensus.cc:348] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:13.334005 14062 raft_consensus.cc:374] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:13.334089 14062 raft_consensus.cc:729] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Initialized, Role: FOLLOWER
I20240502 01:58:13.334270 14062 consensus_queue.cc:260] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:13.334648 14062 ts_tablet_manager.cc:1398] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:13.334904 14063 tablet_bootstrap.cc:492] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a: No bootstrap required, opened a new log
I20240502 01:58:13.334990 14063 ts_tablet_manager.cc:1367] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20240502 01:58:13.335408 14063 raft_consensus.cc:348] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:13.335520 14058 tablet_bootstrap.cc:492] T 2963f09accd44e3db75d2f2c9b38b6cd P 71010353c29d4e988704295c8cd73ef7: No bootstrap required, opened a new log
I20240502 01:58:13.335538 14063 raft_consensus.cc:374] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:13.335583 14063 raft_consensus.cc:729] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1928367ae8d64ba49a7f5761b2d3dc4a, State: Initialized, Role: FOLLOWER
I20240502 01:58:13.335604 14058 ts_tablet_manager.cc:1367] T 2963f09accd44e3db75d2f2c9b38b6cd P 71010353c29d4e988704295c8cd73ef7: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240502 01:58:13.335701 14060 tablet_bootstrap.cc:492] T 2963f09accd44e3db75d2f2c9b38b6cd P 6b1e63d6b84a440a8864db2d36b57665: No bootstrap required, opened a new log
I20240502 01:58:13.335707 14063 consensus_queue.cc:260] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:13.335780 14060 ts_tablet_manager.cc:1367] T 2963f09accd44e3db75d2f2c9b38b6cd P 6b1e63d6b84a440a8864db2d36b57665: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:58:13.335999 14063 ts_tablet_manager.cc:1398] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:13.336056 14058 raft_consensus.cc:348] T 2963f09accd44e3db75d2f2c9b38b6cd P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:13.336172 14058 raft_consensus.cc:374] T 2963f09accd44e3db75d2f2c9b38b6cd P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:13.336208 14058 raft_consensus.cc:729] T 2963f09accd44e3db75d2f2c9b38b6cd P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71010353c29d4e988704295c8cd73ef7, State: Initialized, Role: FOLLOWER
I20240502 01:58:13.336172 14060 raft_consensus.cc:348] T 2963f09accd44e3db75d2f2c9b38b6cd P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:13.336267 14060 raft_consensus.cc:374] T 2963f09accd44e3db75d2f2c9b38b6cd P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:13.336297 14060 raft_consensus.cc:729] T 2963f09accd44e3db75d2f2c9b38b6cd P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1e63d6b84a440a8864db2d36b57665, State: Initialized, Role: FOLLOWER
I20240502 01:58:13.336325 14058 consensus_queue.cc:260] T 2963f09accd44e3db75d2f2c9b38b6cd P 71010353c29d4e988704295c8cd73ef7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:13.336401 14060 consensus_queue.cc:260] T 2963f09accd44e3db75d2f2c9b38b6cd P 6b1e63d6b84a440a8864db2d36b57665 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:13.336596 14058 ts_tablet_manager.cc:1398] T 2963f09accd44e3db75d2f2c9b38b6cd P 71010353c29d4e988704295c8cd73ef7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:13.337160 14060 ts_tablet_manager.cc:1398] T 2963f09accd44e3db75d2f2c9b38b6cd P 6b1e63d6b84a440a8864db2d36b57665: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:13.337342 14060 tablet_bootstrap.cc:492] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665: Bootstrap starting.
I20240502 01:58:13.338359 14060 tablet_bootstrap.cc:654] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:13.339921 14060 tablet_bootstrap.cc:492] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665: No bootstrap required, opened a new log
I20240502 01:58:13.340008 14060 ts_tablet_manager.cc:1367] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:13.340338 14060 raft_consensus.cc:348] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:13.340425 14060 raft_consensus.cc:374] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:13.340626 14060 raft_consensus.cc:729] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1e63d6b84a440a8864db2d36b57665, State: Initialized, Role: FOLLOWER
I20240502 01:58:13.340744 14060 consensus_queue.cc:260] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:13.340998 14060 ts_tablet_manager.cc:1398] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:13.345662 14030 raft_consensus.cc:482] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:13.345767 14030 raft_consensus.cc:504] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:13.346271 14030 leader_election.cc:288] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825), 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263), 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283)
I20240502 01:58:13.346578 13071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16195ae890d445e39ed7ecdadde3009c" candidate_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7" is_pre_election: true
I20240502 01:58:13.346688 13071 raft_consensus.cc:2454] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1928367ae8d64ba49a7f5761b2d3dc4a in term 0.
I20240502 01:58:13.346975 12804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16195ae890d445e39ed7ecdadde3009c" candidate_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" is_pre_election: true
I20240502 01:58:13.347110 12804 raft_consensus.cc:2454] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1928367ae8d64ba49a7f5761b2d3dc4a in term 0.
I20240502 01:58:13.347229 13341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16195ae890d445e39ed7ecdadde3009c" candidate_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665" is_pre_election: true
I20240502 01:58:13.347347 13341 raft_consensus.cc:2454] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1928367ae8d64ba49a7f5761b2d3dc4a in term 0.
I20240502 01:58:13.347391 13408 leader_election.cc:302] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1928367ae8d64ba49a7f5761b2d3dc4a, 27e2acacdad14caa8f66bc81fa8a2f88, 71010353c29d4e988704295c8cd73ef7; no voters:
I20240502 01:58:13.347568 14030 raft_consensus.cc:2781] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:13.347623 14030 raft_consensus.cc:482] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:13.347671 14030 raft_consensus.cc:3037] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:13.350694 13207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16195ae890d445e39ed7ecdadde3009c" candidate_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149" is_pre_election: true
I20240502 01:58:13.350814 13207 raft_consensus.cc:2454] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1928367ae8d64ba49a7f5761b2d3dc4a in term 0.
I20240502 01:58:13.375846 13827 raft_consensus.cc:482] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:13.375962 13827 raft_consensus.cc:504] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:13.376523 13827 leader_election.cc:288] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143), 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825)
I20240502 01:58:13.376812 13341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2963f09accd44e3db75d2f2c9b38b6cd" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665" is_pre_election: true
I20240502 01:58:13.376869 13071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2963f09accd44e3db75d2f2c9b38b6cd" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7" is_pre_election: true
I20240502 01:58:13.376932 13341 raft_consensus.cc:2454] T 2963f09accd44e3db75d2f2c9b38b6cd P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:13.377009 13071 raft_consensus.cc:2454] T 2963f09accd44e3db75d2f2c9b38b6cd P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:13.377110 13207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2963f09accd44e3db75d2f2c9b38b6cd" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149" is_pre_election: true
I20240502 01:58:13.377238 12741 leader_election.cc:302] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 27e2acacdad14caa8f66bc81fa8a2f88, 6b1e63d6b84a440a8864db2d36b57665, 71010353c29d4e988704295c8cd73ef7; no voters:
I20240502 01:58:13.377259 13207 raft_consensus.cc:2454] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:13.377379 12936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2963f09accd44e3db75d2f2c9b38b6cd" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e" is_pre_election: true
I20240502 01:58:13.377528 12936 raft_consensus.cc:2454] T 2963f09accd44e3db75d2f2c9b38b6cd P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:13.377560 13827 raft_consensus.cc:2781] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:13.377606 13827 raft_consensus.cc:482] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:13.377647 13827 raft_consensus.cc:3037] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:13.434864 14030 raft_consensus.cc:504] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:13.434872 13827 raft_consensus.cc:504] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:13.435427 14030 leader_election.cc:288] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [CANDIDATE]: Term 1 election: Requested vote from peers 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825), 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263), 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283)
I20240502 01:58:13.435547 13827 leader_election.cc:288] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 election: Requested vote from peers 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143), 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825)
I20240502 01:58:13.435918 13071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16195ae890d445e39ed7ecdadde3009c" candidate_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7"
I20240502 01:58:13.435918 13207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16195ae890d445e39ed7ecdadde3009c" candidate_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149"
I20240502 01:58:13.436040 13207 raft_consensus.cc:3037] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:13.436040 13071 raft_consensus.cc:3037] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:13.436563 12804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16195ae890d445e39ed7ecdadde3009c" candidate_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e2acacdad14caa8f66bc81fa8a2f88"
I20240502 01:58:13.436681 12804 raft_consensus.cc:3037] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:13.437041 13071 raft_consensus.cc:2454] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1928367ae8d64ba49a7f5761b2d3dc4a in term 1.
I20240502 01:58:13.437041 13207 raft_consensus.cc:2454] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1928367ae8d64ba49a7f5761b2d3dc4a in term 1.
I20240502 01:58:13.437297 12936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2963f09accd44e3db75d2f2c9b38b6cd" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e"
I20240502 01:58:13.437419 12936 raft_consensus.cc:3037] T 2963f09accd44e3db75d2f2c9b38b6cd P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:13.437436 13208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2963f09accd44e3db75d2f2c9b38b6cd" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149"
I20240502 01:58:13.437536 13208 raft_consensus.cc:3037] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:13.437846 12804 raft_consensus.cc:2454] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1928367ae8d64ba49a7f5761b2d3dc4a in term 1.
I20240502 01:58:13.438376 13208 raft_consensus.cc:2454] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:13.438376 12936 raft_consensus.cc:2454] T 2963f09accd44e3db75d2f2c9b38b6cd P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:13.438486 13071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2963f09accd44e3db75d2f2c9b38b6cd" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7"
I20240502 01:58:13.438611 13071 raft_consensus.cc:3037] T 2963f09accd44e3db75d2f2c9b38b6cd P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:13.438606 13409 leader_election.cc:302] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1928367ae8d64ba49a7f5761b2d3dc4a, 27e2acacdad14caa8f66bc81fa8a2f88, 71010353c29d4e988704295c8cd73ef7; no voters:
I20240502 01:58:13.438750 13341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16195ae890d445e39ed7ecdadde3009c" candidate_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665"
I20240502 01:58:13.438803 14030 raft_consensus.cc:2781] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:13.438875 14030 raft_consensus.cc:686] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 LEADER]: Becoming Leader. State: Replica: 1928367ae8d64ba49a7f5761b2d3dc4a, State: Running, Role: LEADER
I20240502 01:58:13.438876 13341 raft_consensus.cc:3037] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:13.439055 13340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2963f09accd44e3db75d2f2c9b38b6cd" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665"
I20240502 01:58:13.439044 14030 consensus_queue.cc:237] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } }
I20240502 01:58:13.439157 13340 raft_consensus.cc:3037] T 2963f09accd44e3db75d2f2c9b38b6cd P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:13.440030 12740 leader_election.cc:302] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 27e2acacdad14caa8f66bc81fa8a2f88, 3d7bf587aa5a49eb92c3a53d17717149, 42bc78875b454c7ab7fce86d56a28c1e; no voters:
I20240502 01:58:13.440208 13827 raft_consensus.cc:2781] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:13.440299 13827 raft_consensus.cc:686] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Becoming Leader. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Running, Role: LEADER
I20240502 01:58:13.440443 13827 consensus_queue.cc:237] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:13.441406 12656 catalog_manager.cc:5484] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198). New cstate: current_term: 1 leader_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: HEALTHY } } }
I20240502 01:58:13.442319 12661 catalog_manager.cc:5484] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193). New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: UNKNOWN } } }
W20240502 01:58:13.443913 12740 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.133.199:34821: connect: Connection refused (error 111) [suppressed 10 similar messages]
I20240502 01:58:13.530414 13071 raft_consensus.cc:2454] T 2963f09accd44e3db75d2f2c9b38b6cd P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:13.530419 13341 raft_consensus.cc:2454] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1928367ae8d64ba49a7f5761b2d3dc4a in term 1.
I20240502 01:58:13.530520 13340 raft_consensus.cc:2454] T 2963f09accd44e3db75d2f2c9b38b6cd P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:13.554996 13827 raft_consensus.cc:482] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:13.555126 13827 raft_consensus.cc:504] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:13.555614 13827 leader_election.cc:288] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759), 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283)
I20240502 01:58:13.555893 13208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281ea2fa1f9f49cebd4bb3620335168a" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149" is_pre_election: true
I20240502 01:58:13.556035 13208 raft_consensus.cc:2454] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:13.556010 13071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281ea2fa1f9f49cebd4bb3620335168a" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7" is_pre_election: true
I20240502 01:58:13.556020 13340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281ea2fa1f9f49cebd4bb3620335168a" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665" is_pre_election: true
I20240502 01:58:13.556133 13071 raft_consensus.cc:2454] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:13.556142 13340 raft_consensus.cc:2454] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:13.556481 12741 leader_election.cc:302] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 27e2acacdad14caa8f66bc81fa8a2f88, 3d7bf587aa5a49eb92c3a53d17717149, 71010353c29d4e988704295c8cd73ef7; no voters:
I20240502 01:58:13.556615 13472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281ea2fa1f9f49cebd4bb3620335168a" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" is_pre_election: true
I20240502 01:58:13.556752 13472 raft_consensus.cc:2454] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:13.556798 13827 raft_consensus.cc:2781] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:13.557005 13827 raft_consensus.cc:482] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:13.557094 13827 raft_consensus.cc:3037] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:13.629318 13827 raft_consensus.cc:504] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:13.630105 13827 leader_election.cc:288] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 election: Requested vote from peers 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759), 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283)
I20240502 01:58:13.630319 13208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281ea2fa1f9f49cebd4bb3620335168a" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149"
I20240502 01:58:13.630457 13208 raft_consensus.cc:3037] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:13.630532 13071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281ea2fa1f9f49cebd4bb3620335168a" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7"
I20240502 01:58:13.630668 13071 raft_consensus.cc:3037] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:13.630677 13472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281ea2fa1f9f49cebd4bb3620335168a" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a"
I20240502 01:58:13.630800 13472 raft_consensus.cc:3037] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:13.631570 13208 raft_consensus.cc:2454] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:13.631759 13472 raft_consensus.cc:2454] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:13.631839 13071 raft_consensus.cc:2454] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:13.632200 12741 leader_election.cc:302] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1928367ae8d64ba49a7f5761b2d3dc4a, 27e2acacdad14caa8f66bc81fa8a2f88, 3d7bf587aa5a49eb92c3a53d17717149; no voters:
I20240502 01:58:13.632246 13340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281ea2fa1f9f49cebd4bb3620335168a" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665"
I20240502 01:58:13.632362 13340 raft_consensus.cc:3037] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:13.632477 13827 raft_consensus.cc:2781] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:13.632660 13827 raft_consensus.cc:686] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Becoming Leader. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Running, Role: LEADER
I20240502 01:58:13.632808 13827 consensus_queue.cc:237] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } }
I20240502 01:58:13.634709 12661 catalog_manager.cc:5484] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193). New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:13.730949 13340 raft_consensus.cc:2454] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
W20240502 01:58:13.782805 14086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:13.783027 14086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:13.786127 14086 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_3'
I20240502 01:58:13.831213 14030 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.845475 13827 consensus_queue.cc:1035] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.864137 13340 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.864559 13932 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.864650 13208 raft_consensus.cc:1261] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.865780 12936 raft_consensus.cc:1261] T 2963f09accd44e3db75d2f2c9b38b6cd P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.865960 13071 raft_consensus.cc:1261] T 2963f09accd44e3db75d2f2c9b38b6cd P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.866717 13827 consensus_queue.cc:1035] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.868655 13472 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.869135 13932 consensus_queue.cc:1035] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.869185 13072 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.869598 14121 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.869764 13827 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.870429 13208 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.870487 13932 consensus_queue.cc:1035] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.871197 14121 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.881645 13340 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.882159 14030 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.885437 12804 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.886329 13072 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:13.889097 13741 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.897686 13741 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:13.929076 14128 mvcc.cc:205] Tried to move back new op lower bound from 7023063424462921728 to 7023063423522258944. Current Snapshot: MvccSnapshot[applied={T|T < 7023063424462921728}]
INSERT report
rows total: 2000
time total: 155.508 ms
time per row: 0.0777538 ms
I20240502 01:58:13.984275 12656 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43822:
name: "rebalance_test_table_4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 5
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 01:58:13.989830 13051 tablet_service.cc:1467] Processing CreateTablet for tablet 6eef7d25de5541bbbc7576185e097ed1 (DEFAULT_TABLE table=rebalance_test_table_4 [id=8471dbb0ba2d474da8ff5cbfa12790d9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.990185 13051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eef7d25de5541bbbc7576185e097ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.990453 12783 tablet_service.cc:1467] Processing CreateTablet for tablet 6eef7d25de5541bbbc7576185e097ed1 (DEFAULT_TABLE table=rebalance_test_table_4 [id=8471dbb0ba2d474da8ff5cbfa12790d9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.990761 12783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eef7d25de5541bbbc7576185e097ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.991623 12785 tablet_service.cc:1467] Processing CreateTablet for tablet eb9d0001da2643ed8a9d78e79e30fccd (DEFAULT_TABLE table=rebalance_test_table_4 [id=8471dbb0ba2d474da8ff5cbfa12790d9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.991844 12785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb9d0001da2643ed8a9d78e79e30fccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.992825 13187 tablet_service.cc:1467] Processing CreateTablet for tablet 773b692c40df457caf7baea5a7b21c27 (DEFAULT_TABLE table=rebalance_test_table_4 [id=8471dbb0ba2d474da8ff5cbfa12790d9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.992870 13185 tablet_service.cc:1467] Processing CreateTablet for tablet 6eef7d25de5541bbbc7576185e097ed1 (DEFAULT_TABLE table=rebalance_test_table_4 [id=8471dbb0ba2d474da8ff5cbfa12790d9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.993115 13187 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 773b692c40df457caf7baea5a7b21c27. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.993248 13453 tablet_service.cc:1467] Processing CreateTablet for tablet 6eef7d25de5541bbbc7576185e097ed1 (DEFAULT_TABLE table=rebalance_test_table_4 [id=8471dbb0ba2d474da8ff5cbfa12790d9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.993516 13453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eef7d25de5541bbbc7576185e097ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.993768 12784 tablet_service.cc:1467] Processing CreateTablet for tablet 773b692c40df457caf7baea5a7b21c27 (DEFAULT_TABLE table=rebalance_test_table_4 [id=8471dbb0ba2d474da8ff5cbfa12790d9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.993973 12784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 773b692c40df457caf7baea5a7b21c27. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.995296 14171 tablet_bootstrap.cc:492] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149: Bootstrap starting.
I20240502 01:58:13.995342 13185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eef7d25de5541bbbc7576185e097ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.995908 13452 tablet_service.cc:1467] Processing CreateTablet for tablet eb9d0001da2643ed8a9d78e79e30fccd (DEFAULT_TABLE table=rebalance_test_table_4 [id=8471dbb0ba2d474da8ff5cbfa12790d9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.996145 13452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb9d0001da2643ed8a9d78e79e30fccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.996526 13320 tablet_service.cc:1467] Processing CreateTablet for tablet 773b692c40df457caf7baea5a7b21c27 (DEFAULT_TABLE table=rebalance_test_table_4 [id=8471dbb0ba2d474da8ff5cbfa12790d9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.996526 13321 tablet_service.cc:1467] Processing CreateTablet for tablet eb9d0001da2643ed8a9d78e79e30fccd (DEFAULT_TABLE table=rebalance_test_table_4 [id=8471dbb0ba2d474da8ff5cbfa12790d9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.996824 13320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 773b692c40df457caf7baea5a7b21c27. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.996984 13321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb9d0001da2643ed8a9d78e79e30fccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:13.998601 14171 tablet_bootstrap.cc:654] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:13.999287 12918 tablet_service.cc:1467] Processing CreateTablet for tablet eb9d0001da2643ed8a9d78e79e30fccd (DEFAULT_TABLE table=rebalance_test_table_4 [id=8471dbb0ba2d474da8ff5cbfa12790d9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.999330 12917 tablet_service.cc:1467] Processing CreateTablet for tablet 6eef7d25de5541bbbc7576185e097ed1 (DEFAULT_TABLE table=rebalance_test_table_4 [id=8471dbb0ba2d474da8ff5cbfa12790d9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.999336 12916 tablet_service.cc:1467] Processing CreateTablet for tablet 773b692c40df457caf7baea5a7b21c27 (DEFAULT_TABLE table=rebalance_test_table_4 [id=8471dbb0ba2d474da8ff5cbfa12790d9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:13.999811 14173 tablet_bootstrap.cc:492] T eb9d0001da2643ed8a9d78e79e30fccd P 6b1e63d6b84a440a8864db2d36b57665: Bootstrap starting.
I20240502 01:58:14.000286 12917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eef7d25de5541bbbc7576185e097ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:14.000473 12918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb9d0001da2643ed8a9d78e79e30fccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:14.000631 14169 tablet_bootstrap.cc:492] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7: Bootstrap starting.
I20240502 01:58:14.000815 14173 tablet_bootstrap.cc:654] T eb9d0001da2643ed8a9d78e79e30fccd P 6b1e63d6b84a440a8864db2d36b57665: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:14.001538 14169 tablet_bootstrap.cc:654] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:14.002076 12916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 773b692c40df457caf7baea5a7b21c27. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:14.002683 14173 tablet_bootstrap.cc:492] T eb9d0001da2643ed8a9d78e79e30fccd P 6b1e63d6b84a440a8864db2d36b57665: No bootstrap required, opened a new log
I20240502 01:58:14.002830 14173 ts_tablet_manager.cc:1367] T eb9d0001da2643ed8a9d78e79e30fccd P 6b1e63d6b84a440a8864db2d36b57665: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:14.003329 14173 raft_consensus.cc:348] T eb9d0001da2643ed8a9d78e79e30fccd P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } }
I20240502 01:58:14.003453 13452 tablet_service.cc:1467] Processing CreateTablet for tablet 773b692c40df457caf7baea5a7b21c27 (DEFAULT_TABLE table=rebalance_test_table_4 [id=8471dbb0ba2d474da8ff5cbfa12790d9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:14.003569 14173 raft_consensus.cc:374] T eb9d0001da2643ed8a9d78e79e30fccd P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:14.003659 14173 raft_consensus.cc:729] T eb9d0001da2643ed8a9d78e79e30fccd P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1e63d6b84a440a8864db2d36b57665, State: Initialized, Role: FOLLOWER
I20240502 01:58:14.003698 13452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 773b692c40df457caf7baea5a7b21c27. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:14.003822 14173 consensus_queue.cc:260] T eb9d0001da2643ed8a9d78e79e30fccd P 6b1e63d6b84a440a8864db2d36b57665 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } }
I20240502 01:58:14.004562 14173 ts_tablet_manager.cc:1398] T eb9d0001da2643ed8a9d78e79e30fccd P 6b1e63d6b84a440a8864db2d36b57665: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:14.004704 14173 tablet_bootstrap.cc:492] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665: Bootstrap starting.
I20240502 01:58:14.005378 14173 tablet_bootstrap.cc:654] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:14.005824 13051 tablet_service.cc:1467] Processing CreateTablet for tablet eb9d0001da2643ed8a9d78e79e30fccd (DEFAULT_TABLE table=rebalance_test_table_4 [id=8471dbb0ba2d474da8ff5cbfa12790d9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:14.006110 13051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb9d0001da2643ed8a9d78e79e30fccd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:14.006278 14177 tablet_bootstrap.cc:492] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e: Bootstrap starting.
I20240502 01:58:14.006744 14169 tablet_bootstrap.cc:492] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7: No bootstrap required, opened a new log
I20240502 01:58:14.006963 14169 ts_tablet_manager.cc:1367] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240502 01:58:14.007035 14177 tablet_bootstrap.cc:654] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:14.007468 14169 raft_consensus.cc:348] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:14.007570 14169 raft_consensus.cc:374] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:14.007599 14169 raft_consensus.cc:729] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71010353c29d4e988704295c8cd73ef7, State: Initialized, Role: FOLLOWER
I20240502 01:58:14.007592 14172 tablet_bootstrap.cc:492] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a: Bootstrap starting.
I20240502 01:58:14.007717 14169 consensus_queue.cc:260] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:14.007963 14177 tablet_bootstrap.cc:492] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e: No bootstrap required, opened a new log
I20240502 01:58:14.008001 14169 ts_tablet_manager.cc:1398] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:14.008037 14177 ts_tablet_manager.cc:1367] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:14.008445 14172 tablet_bootstrap.cc:654] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:14.008522 14177 raft_consensus.cc:348] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:14.008630 14177 raft_consensus.cc:374] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:14.008671 14177 raft_consensus.cc:729] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42bc78875b454c7ab7fce86d56a28c1e, State: Initialized, Role: FOLLOWER
I20240502 01:58:14.008852 14177 consensus_queue.cc:260] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:14.009222 14177 ts_tablet_manager.cc:1398] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:14.009415 14177 tablet_bootstrap.cc:492] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e: Bootstrap starting.
I20240502 01:58:14.009533 14170 tablet_bootstrap.cc:492] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88: Bootstrap starting.
I20240502 01:58:14.010236 14177 tablet_bootstrap.cc:654] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:14.010636 14172 tablet_bootstrap.cc:492] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a: No bootstrap required, opened a new log
I20240502 01:58:14.010743 14172 ts_tablet_manager.cc:1367] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:14.010911 14170 tablet_bootstrap.cc:654] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:14.011175 14172 raft_consensus.cc:348] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:14.011353 14172 raft_consensus.cc:374] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:14.011435 14172 raft_consensus.cc:729] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1928367ae8d64ba49a7f5761b2d3dc4a, State: Initialized, Role: FOLLOWER
I20240502 01:58:14.011577 14172 consensus_queue.cc:260] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:14.012120 14172 ts_tablet_manager.cc:1398] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:14.012349 14172 tablet_bootstrap.cc:492] T eb9d0001da2643ed8a9d78e79e30fccd P 1928367ae8d64ba49a7f5761b2d3dc4a: Bootstrap starting.
I20240502 01:58:14.012653 14169 tablet_bootstrap.cc:492] T eb9d0001da2643ed8a9d78e79e30fccd P 71010353c29d4e988704295c8cd73ef7: Bootstrap starting.
I20240502 01:58:14.013232 14172 tablet_bootstrap.cc:654] T eb9d0001da2643ed8a9d78e79e30fccd P 1928367ae8d64ba49a7f5761b2d3dc4a: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:14.013465 14169 tablet_bootstrap.cc:654] T eb9d0001da2643ed8a9d78e79e30fccd P 71010353c29d4e988704295c8cd73ef7: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:14.014190 14170 tablet_bootstrap.cc:492] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88: No bootstrap required, opened a new log
I20240502 01:58:14.014225 14172 tablet_bootstrap.cc:492] T eb9d0001da2643ed8a9d78e79e30fccd P 1928367ae8d64ba49a7f5761b2d3dc4a: No bootstrap required, opened a new log
I20240502 01:58:14.014297 14172 ts_tablet_manager.cc:1367] T eb9d0001da2643ed8a9d78e79e30fccd P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:14.014302 14170 ts_tablet_manager.cc:1367] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:58:14.014528 14169 tablet_bootstrap.cc:492] T eb9d0001da2643ed8a9d78e79e30fccd P 71010353c29d4e988704295c8cd73ef7: No bootstrap required, opened a new log
I20240502 01:58:14.014590 14169 ts_tablet_manager.cc:1367] T eb9d0001da2643ed8a9d78e79e30fccd P 71010353c29d4e988704295c8cd73ef7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:14.014681 14172 raft_consensus.cc:348] T eb9d0001da2643ed8a9d78e79e30fccd P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } }
I20240502 01:58:14.014699 14170 raft_consensus.cc:348] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:14.014792 14172 raft_consensus.cc:374] T eb9d0001da2643ed8a9d78e79e30fccd P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:14.014825 14172 raft_consensus.cc:729] T eb9d0001da2643ed8a9d78e79e30fccd P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1928367ae8d64ba49a7f5761b2d3dc4a, State: Initialized, Role: FOLLOWER
I20240502 01:58:14.014792 14170 raft_consensus.cc:374] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:14.014879 14170 raft_consensus.cc:729] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Initialized, Role: FOLLOWER
I20240502 01:58:14.014894 14169 raft_consensus.cc:348] T eb9d0001da2643ed8a9d78e79e30fccd P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } }
I20240502 01:58:14.014942 14172 consensus_queue.cc:260] T eb9d0001da2643ed8a9d78e79e30fccd P 1928367ae8d64ba49a7f5761b2d3dc4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } }
I20240502 01:58:14.015003 14169 raft_consensus.cc:374] T eb9d0001da2643ed8a9d78e79e30fccd P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:14.015028 14169 raft_consensus.cc:729] T eb9d0001da2643ed8a9d78e79e30fccd P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71010353c29d4e988704295c8cd73ef7, State: Initialized, Role: FOLLOWER
I20240502 01:58:14.014991 14170 consensus_queue.cc:260] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:14.015148 14169 consensus_queue.cc:260] T eb9d0001da2643ed8a9d78e79e30fccd P 71010353c29d4e988704295c8cd73ef7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } }
I20240502 01:58:14.015228 14172 ts_tablet_manager.cc:1398] T eb9d0001da2643ed8a9d78e79e30fccd P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:14.015348 14170 ts_tablet_manager.cc:1398] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:14.015388 14172 tablet_bootstrap.cc:492] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a: Bootstrap starting.
I20240502 01:58:14.015424 14169 ts_tablet_manager.cc:1398] T eb9d0001da2643ed8a9d78e79e30fccd P 71010353c29d4e988704295c8cd73ef7: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:14.016185 14172 tablet_bootstrap.cc:654] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:14.017014 14170 tablet_bootstrap.cc:492] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88: Bootstrap starting.
I20240502 01:58:14.017886 14170 tablet_bootstrap.cc:654] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:14.018924 14170 tablet_bootstrap.cc:492] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88: No bootstrap required, opened a new log
I20240502 01:58:14.018990 14177 tablet_bootstrap.cc:492] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e: No bootstrap required, opened a new log
I20240502 01:58:14.019016 14170 ts_tablet_manager.cc:1367] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:14.019093 14177 ts_tablet_manager.cc:1367] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20240502 01:58:14.019398 14170 raft_consensus.cc:348] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } }
I20240502 01:58:14.019526 14170 raft_consensus.cc:374] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:14.019582 14170 raft_consensus.cc:729] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Initialized, Role: FOLLOWER
I20240502 01:58:14.019549 14177 raft_consensus.cc:348] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:14.019724 14170 consensus_queue.cc:260] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } }
I20240502 01:58:14.019685 14177 raft_consensus.cc:374] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:14.020171 14170 ts_tablet_manager.cc:1398] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:14.020359 14170 tablet_bootstrap.cc:492] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88: Bootstrap starting.
I20240502 01:58:14.020362 14177 raft_consensus.cc:729] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42bc78875b454c7ab7fce86d56a28c1e, State: Initialized, Role: FOLLOWER
I20240502 01:58:14.020493 14177 consensus_queue.cc:260] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:14.020915 14177 ts_tablet_manager.cc:1398] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:14.021117 14177 tablet_bootstrap.cc:492] T eb9d0001da2643ed8a9d78e79e30fccd P 42bc78875b454c7ab7fce86d56a28c1e: Bootstrap starting.
I20240502 01:58:14.021217 14170 tablet_bootstrap.cc:654] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:14.021883 14177 tablet_bootstrap.cc:654] T eb9d0001da2643ed8a9d78e79e30fccd P 42bc78875b454c7ab7fce86d56a28c1e: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:14.022933 14170 tablet_bootstrap.cc:492] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88: No bootstrap required, opened a new log
I20240502 01:58:14.023041 14170 ts_tablet_manager.cc:1367] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:14.023494 14170 raft_consensus.cc:348] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:14.023602 14170 raft_consensus.cc:374] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:14.023674 14170 raft_consensus.cc:729] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Initialized, Role: FOLLOWER
I20240502 01:58:14.023808 14170 consensus_queue.cc:260] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:14.024111 14170 ts_tablet_manager.cc:1398] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:14.030337 14173 tablet_bootstrap.cc:492] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665: No bootstrap required, opened a new log
I20240502 01:58:14.030339 14171 tablet_bootstrap.cc:492] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149: No bootstrap required, opened a new log
I20240502 01:58:14.030437 14171 ts_tablet_manager.cc:1367] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.000s
I20240502 01:58:14.030437 14173 ts_tablet_manager.cc:1367] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.000s
I20240502 01:58:14.030874 14173 raft_consensus.cc:348] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:14.030898 14171 raft_consensus.cc:348] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:14.030999 14173 raft_consensus.cc:374] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:14.031003 14171 raft_consensus.cc:374] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:14.031041 14173 raft_consensus.cc:729] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b1e63d6b84a440a8864db2d36b57665, State: Initialized, Role: FOLLOWER
I20240502 01:58:14.031041 14171 raft_consensus.cc:729] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d7bf587aa5a49eb92c3a53d17717149, State: Initialized, Role: FOLLOWER
I20240502 01:58:14.031163 14173 consensus_queue.cc:260] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:14.031163 14171 consensus_queue.cc:260] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:14.031468 14171 ts_tablet_manager.cc:1398] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:14.031467 14173 ts_tablet_manager.cc:1398] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:14.031649 14171 tablet_bootstrap.cc:492] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149: Bootstrap starting.
I20240502 01:58:14.032639 14171 tablet_bootstrap.cc:654] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:14.033910 14171 tablet_bootstrap.cc:492] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149: No bootstrap required, opened a new log
I20240502 01:58:14.034020 14171 ts_tablet_manager.cc:1367] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:14.034531 14171 raft_consensus.cc:348] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:14.034668 14171 raft_consensus.cc:374] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:14.034709 14171 raft_consensus.cc:729] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d7bf587aa5a49eb92c3a53d17717149, State: Initialized, Role: FOLLOWER
I20240502 01:58:14.034864 14171 consensus_queue.cc:260] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:14.035230 14171 ts_tablet_manager.cc:1398] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:14.038326 14177 tablet_bootstrap.cc:492] T eb9d0001da2643ed8a9d78e79e30fccd P 42bc78875b454c7ab7fce86d56a28c1e: No bootstrap required, opened a new log
I20240502 01:58:14.038419 14177 ts_tablet_manager.cc:1367] T eb9d0001da2643ed8a9d78e79e30fccd P 42bc78875b454c7ab7fce86d56a28c1e: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20240502 01:58:14.038434 14172 tablet_bootstrap.cc:492] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a: No bootstrap required, opened a new log
I20240502 01:58:14.038540 14172 ts_tablet_manager.cc:1367] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.000s
I20240502 01:58:14.038856 14177 raft_consensus.cc:348] T eb9d0001da2643ed8a9d78e79e30fccd P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } }
I20240502 01:58:14.038959 14177 raft_consensus.cc:374] T eb9d0001da2643ed8a9d78e79e30fccd P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:14.038992 14177 raft_consensus.cc:729] T eb9d0001da2643ed8a9d78e79e30fccd P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42bc78875b454c7ab7fce86d56a28c1e, State: Initialized, Role: FOLLOWER
I20240502 01:58:14.038955 14172 raft_consensus.cc:348] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:14.039055 14172 raft_consensus.cc:374] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:14.039091 14172 raft_consensus.cc:729] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1928367ae8d64ba49a7f5761b2d3dc4a, State: Initialized, Role: FOLLOWER
I20240502 01:58:14.039124 14177 consensus_queue.cc:260] T eb9d0001da2643ed8a9d78e79e30fccd P 42bc78875b454c7ab7fce86d56a28c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } }
I20240502 01:58:14.039207 14172 consensus_queue.cc:260] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:14.039409 14177 ts_tablet_manager.cc:1398] T eb9d0001da2643ed8a9d78e79e30fccd P 42bc78875b454c7ab7fce86d56a28c1e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:14.039490 14172 ts_tablet_manager.cc:1398] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:14.040423 14121 raft_consensus.cc:482] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:14.040517 14121 raft_consensus.cc:504] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } }
I20240502 01:58:14.041064 14121 leader_election.cc:288] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759), 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143), 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887)
I20240502 01:58:14.041373 12936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9d0001da2643ed8a9d78e79e30fccd" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e" is_pre_election: true
I20240502 01:58:14.041369 13472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9d0001da2643ed8a9d78e79e30fccd" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" is_pre_election: true
I20240502 01:58:14.041366 13071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9d0001da2643ed8a9d78e79e30fccd" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7" is_pre_election: true
I20240502 01:58:14.041472 12936 raft_consensus.cc:2454] T eb9d0001da2643ed8a9d78e79e30fccd P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:14.041478 13472 raft_consensus.cc:2454] T eb9d0001da2643ed8a9d78e79e30fccd P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:14.041515 13071 raft_consensus.cc:2454] T eb9d0001da2643ed8a9d78e79e30fccd P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:14.041703 13340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9d0001da2643ed8a9d78e79e30fccd" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665" is_pre_election: true
I20240502 01:58:14.041831 13340 raft_consensus.cc:2454] T eb9d0001da2643ed8a9d78e79e30fccd P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:14.041826 12741 leader_election.cc:302] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1928367ae8d64ba49a7f5761b2d3dc4a, 27e2acacdad14caa8f66bc81fa8a2f88, 71010353c29d4e988704295c8cd73ef7; no voters:
I20240502 01:58:14.042019 14121 raft_consensus.cc:2781] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:14.042068 14121 raft_consensus.cc:482] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:14.042105 14121 raft_consensus.cc:3037] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:14.086591 14122 raft_consensus.cc:482] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:14.086707 14122 raft_consensus.cc:504] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:14.087184 14122 leader_election.cc:288] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759), 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283), 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825)
I20240502 01:58:14.087566 12936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "773b692c40df457caf7baea5a7b21c27" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e" is_pre_election: true
I20240502 01:58:14.087601 13472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "773b692c40df457caf7baea5a7b21c27" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" is_pre_election: true
I20240502 01:58:14.087643 13207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "773b692c40df457caf7baea5a7b21c27" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149" is_pre_election: true
I20240502 01:58:14.087668 13340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "773b692c40df457caf7baea5a7b21c27" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665" is_pre_election: true
I20240502 01:58:14.087730 12936 raft_consensus.cc:2454] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:14.087739 13472 raft_consensus.cc:2454] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:14.087764 13207 raft_consensus.cc:2454] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:14.087780 13340 raft_consensus.cc:2454] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 0.
I20240502 01:58:14.088151 12740 leader_election.cc:302] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 27e2acacdad14caa8f66bc81fa8a2f88, 3d7bf587aa5a49eb92c3a53d17717149, 42bc78875b454c7ab7fce86d56a28c1e; no voters:
I20240502 01:58:14.088326 14122 raft_consensus.cc:2781] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:14.088387 14122 raft_consensus.cc:482] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:14.088413 14122 raft_consensus.cc:3037] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:14.133364 14121 raft_consensus.cc:504] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } }
I20240502 01:58:14.133901 14121 leader_election.cc:288] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 election: Requested vote from peers 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759), 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143), 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887)
I20240502 01:58:14.134236 13472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9d0001da2643ed8a9d78e79e30fccd" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a"
I20240502 01:58:14.134362 13472 raft_consensus.cc:3037] T eb9d0001da2643ed8a9d78e79e30fccd P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:14.134454 13071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9d0001da2643ed8a9d78e79e30fccd" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7"
I20240502 01:58:14.134464 14122 raft_consensus.cc:504] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:14.134582 13071 raft_consensus.cc:3037] T eb9d0001da2643ed8a9d78e79e30fccd P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:14.135043 14122 leader_election.cc:288] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 election: Requested vote from peers 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759), 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283), 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825)
I20240502 01:58:14.135336 13472 raft_consensus.cc:2454] T eb9d0001da2643ed8a9d78e79e30fccd P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:14.135519 13071 raft_consensus.cc:2454] T eb9d0001da2643ed8a9d78e79e30fccd P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:14.135519 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "773b692c40df457caf7baea5a7b21c27" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a"
I20240502 01:58:14.135635 13473 raft_consensus.cc:3037] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:14.135917 12741 leader_election.cc:302] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1928367ae8d64ba49a7f5761b2d3dc4a, 27e2acacdad14caa8f66bc81fa8a2f88, 71010353c29d4e988704295c8cd73ef7; no voters:
I20240502 01:58:14.136014 13339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "773b692c40df457caf7baea5a7b21c27" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665"
I20240502 01:58:14.136142 13339 raft_consensus.cc:3037] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:14.136188 14122 raft_consensus.cc:2781] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:14.136260 14122 raft_consensus.cc:686] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Becoming Leader. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Running, Role: LEADER
I20240502 01:58:14.136411 14122 consensus_queue.cc:237] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } }
I20240502 01:58:14.136725 13473 raft_consensus.cc:2454] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:14.137171 13339 raft_consensus.cc:2454] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:14.137197 13340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9d0001da2643ed8a9d78e79e30fccd" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b1e63d6b84a440a8864db2d36b57665"
I20240502 01:58:14.137300 13340 raft_consensus.cc:3037] T eb9d0001da2643ed8a9d78e79e30fccd P 6b1e63d6b84a440a8864db2d36b57665 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:14.137421 12936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb9d0001da2643ed8a9d78e79e30fccd" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e"
I20240502 01:58:14.137557 12936 raft_consensus.cc:3037] T eb9d0001da2643ed8a9d78e79e30fccd P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:14.137725 12741 leader_election.cc:302] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1928367ae8d64ba49a7f5761b2d3dc4a, 27e2acacdad14caa8f66bc81fa8a2f88, 6b1e63d6b84a440a8864db2d36b57665; no voters:
I20240502 01:58:14.137939 12937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "773b692c40df457caf7baea5a7b21c27" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e"
I20240502 01:58:14.138056 12937 raft_consensus.cc:3037] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:14.138294 14121 raft_consensus.cc:2781] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:14.138371 14121 raft_consensus.cc:686] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Becoming Leader. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Running, Role: LEADER
I20240502 01:58:14.138469 14121 consensus_queue.cc:237] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:14.138909 13207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "773b692c40df457caf7baea5a7b21c27" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149"
I20240502 01:58:14.139030 13207 raft_consensus.cc:3037] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:14.139837 12661 catalog_manager.cc:5484] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193). New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:14.142911 12661 catalog_manager.cc:5484] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193). New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } }
I20240502 01:58:14.228317 12936 raft_consensus.cc:2454] T eb9d0001da2643ed8a9d78e79e30fccd P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:14.228317 13207 raft_consensus.cc:2454] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:14.228317 13340 raft_consensus.cc:2454] T eb9d0001da2643ed8a9d78e79e30fccd P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:14.228716 12937 raft_consensus.cc:2454] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 1.
I20240502 01:58:14.229890 14141 raft_consensus.cc:482] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:14.230041 14141 raft_consensus.cc:504] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:14.230450 14008 raft_consensus.cc:482] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:14.230533 14008 raft_consensus.cc:504] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:14.231070 14008 leader_election.cc:288] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759), 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825)
I20240502 01:58:14.231595 14141 leader_election.cc:288] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143), 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759), 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825)
I20240502 01:58:14.231786 13472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eef7d25de5541bbbc7576185e097ed1" candidate_uuid: "42bc78875b454c7ab7fce86d56a28c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" is_pre_election: true
I20240502 01:58:14.231921 13472 raft_consensus.cc:2454] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42bc78875b454c7ab7fce86d56a28c1e in term 0.
I20240502 01:58:14.231993 13071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eef7d25de5541bbbc7576185e097ed1" candidate_uuid: "42bc78875b454c7ab7fce86d56a28c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7" is_pre_election: true
I20240502 01:58:14.232101 13071 raft_consensus.cc:2454] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42bc78875b454c7ab7fce86d56a28c1e in term 0.
I20240502 01:58:14.232250 13207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eef7d25de5541bbbc7576185e097ed1" candidate_uuid: "42bc78875b454c7ab7fce86d56a28c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149" is_pre_election: true
I20240502 01:58:14.232380 13207 raft_consensus.cc:2454] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42bc78875b454c7ab7fce86d56a28c1e in term 0.
I20240502 01:58:14.232489 12873 leader_election.cc:302] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1928367ae8d64ba49a7f5761b2d3dc4a, 42bc78875b454c7ab7fce86d56a28c1e, 71010353c29d4e988704295c8cd73ef7; no voters:
I20240502 01:58:14.232692 14008 raft_consensus.cc:2781] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:14.232743 14008 raft_consensus.cc:482] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:14.232792 14008 raft_consensus.cc:3037] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:14.233065 12804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eef7d25de5541bbbc7576185e097ed1" candidate_uuid: "42bc78875b454c7ab7fce86d56a28c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" is_pre_election: true
I20240502 01:58:14.233213 12804 raft_consensus.cc:2454] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42bc78875b454c7ab7fce86d56a28c1e in term 0.
I20240502 01:58:14.236325 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eef7d25de5541bbbc7576185e097ed1" candidate_uuid: "71010353c29d4e988704295c8cd73ef7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" is_pre_election: true
I20240502 01:58:14.236451 13473 raft_consensus.cc:2454] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71010353c29d4e988704295c8cd73ef7 in term 0.
I20240502 01:58:14.236716 12937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eef7d25de5541bbbc7576185e097ed1" candidate_uuid: "71010353c29d4e988704295c8cd73ef7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e" is_pre_election: true
I20240502 01:58:14.254793 12804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eef7d25de5541bbbc7576185e097ed1" candidate_uuid: "71010353c29d4e988704295c8cd73ef7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" is_pre_election: true
I20240502 01:58:14.254804 13207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eef7d25de5541bbbc7576185e097ed1" candidate_uuid: "71010353c29d4e988704295c8cd73ef7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149" is_pre_election: true
I20240502 01:58:14.254946 12804 raft_consensus.cc:2454] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71010353c29d4e988704295c8cd73ef7 in term 0.
I20240502 01:58:14.254946 13207 raft_consensus.cc:2454] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71010353c29d4e988704295c8cd73ef7 in term 0.
I20240502 01:58:14.255256 13005 leader_election.cc:302] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 1928367ae8d64ba49a7f5761b2d3dc4a, 3d7bf587aa5a49eb92c3a53d17717149, 71010353c29d4e988704295c8cd73ef7; no voters:
I20240502 01:58:14.255511 14141 raft_consensus.cc:2781] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:14.255581 14141 raft_consensus.cc:482] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:14.255631 14141 raft_consensus.cc:3037] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:14.324261 14008 raft_consensus.cc:504] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:14.324261 14141 raft_consensus.cc:504] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:14.324653 12937 raft_consensus.cc:2379] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71010353c29d4e988704295c8cd73ef7 in current term 1: Already voted for candidate 42bc78875b454c7ab7fce86d56a28c1e in this term.
I20240502 01:58:14.324803 14008 leader_election.cc:288] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [CANDIDATE]: Term 1 election: Requested vote from peers 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759), 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825)
I20240502 01:58:14.324841 14141 leader_election.cc:288] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [CANDIDATE]: Term 1 election: Requested vote from peers 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143), 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759), 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263), 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825)
I20240502 01:58:14.325290 13207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eef7d25de5541bbbc7576185e097ed1" candidate_uuid: "42bc78875b454c7ab7fce86d56a28c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149"
I20240502 01:58:14.325415 13207 raft_consensus.cc:3037] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:14.325750 13071 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eef7d25de5541bbbc7576185e097ed1" candidate_uuid: "42bc78875b454c7ab7fce86d56a28c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71010353c29d4e988704295c8cd73ef7"
I20240502 01:58:14.325893 13071 raft_consensus.cc:2379] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 42bc78875b454c7ab7fce86d56a28c1e in current term 1: Already voted for candidate 71010353c29d4e988704295c8cd73ef7 in this term.
I20240502 01:58:14.326210 13208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eef7d25de5541bbbc7576185e097ed1" candidate_uuid: "71010353c29d4e988704295c8cd73ef7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149"
I20240502 01:58:14.326431 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eef7d25de5541bbbc7576185e097ed1" candidate_uuid: "42bc78875b454c7ab7fce86d56a28c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a"
I20240502 01:58:14.326550 13207 raft_consensus.cc:2454] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42bc78875b454c7ab7fce86d56a28c1e in term 1.
I20240502 01:58:14.326588 13473 raft_consensus.cc:3037] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:14.327117 12804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eef7d25de5541bbbc7576185e097ed1" candidate_uuid: "71010353c29d4e988704295c8cd73ef7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e2acacdad14caa8f66bc81fa8a2f88"
I20240502 01:58:14.327133 12805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eef7d25de5541bbbc7576185e097ed1" candidate_uuid: "42bc78875b454c7ab7fce86d56a28c1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e2acacdad14caa8f66bc81fa8a2f88"
I20240502 01:58:14.327250 12804 raft_consensus.cc:3037] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:14.327495 13473 raft_consensus.cc:2454] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42bc78875b454c7ab7fce86d56a28c1e in term 1.
I20240502 01:58:14.327787 12873 leader_election.cc:302] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 1928367ae8d64ba49a7f5761b2d3dc4a, 3d7bf587aa5a49eb92c3a53d17717149, 42bc78875b454c7ab7fce86d56a28c1e; no voters: 71010353c29d4e988704295c8cd73ef7
I20240502 01:58:14.327827 13473 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eef7d25de5541bbbc7576185e097ed1" candidate_uuid: "71010353c29d4e988704295c8cd73ef7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a"
I20240502 01:58:14.327963 13473 raft_consensus.cc:2379] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 71010353c29d4e988704295c8cd73ef7 in current term 1: Already voted for candidate 42bc78875b454c7ab7fce86d56a28c1e in this term.
I20240502 01:58:14.328284 14008 raft_consensus.cc:2781] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:14.328361 14008 raft_consensus.cc:686] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 LEADER]: Becoming Leader. State: Replica: 42bc78875b454c7ab7fce86d56a28c1e, State: Running, Role: LEADER
I20240502 01:58:14.328379 12804 raft_consensus.cc:2454] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71010353c29d4e988704295c8cd73ef7 in term 1.
I20240502 01:58:14.328495 14008 consensus_queue.cc:237] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } }
I20240502 01:58:14.329226 12937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eef7d25de5541bbbc7576185e097ed1" candidate_uuid: "71010353c29d4e988704295c8cd73ef7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42bc78875b454c7ab7fce86d56a28c1e"
I20240502 01:58:14.329607 13003 leader_election.cc:302] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: 71010353c29d4e988704295c8cd73ef7; no voters: 1928367ae8d64ba49a7f5761b2d3dc4a, 3d7bf587aa5a49eb92c3a53d17717149, 42bc78875b454c7ab7fce86d56a28c1e
I20240502 01:58:14.329780 14141 raft_consensus.cc:2726] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20240502 01:58:14.330585 12661 catalog_manager.cc:5484] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194). New cstate: current_term: 1 leader_uuid: "42bc78875b454c7ab7fce86d56a28c1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: UNKNOWN } } }
W20240502 01:58:14.474282 14200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:14.474524 14200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:14.478176 14200 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_4'
I20240502 01:58:14.552767 13932 consensus_queue.cc:1035] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:14.554859 13932 consensus_queue.cc:1035] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:14.564661 14122 consensus_queue.cc:1035] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:14.565274 14122 consensus_queue.cc:1035] T eb9d0001da2643ed8a9d78e79e30fccd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:14.565275 13932 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:14.577947 13207 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:14.578755 12804 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:14.578935 13071 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:14.579165 14196 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:14.579578 14196 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:14.580516 13473 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:14.583196 14008 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:14.583820 12937 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:14.584174 14008 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:14.584322 13932 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:14.593365 13473 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:14.593796 13207 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:14.594378 13932 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:14.594516 14121 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:14.644325 14241 mvcc.cc:205] Tried to move back new op lower bound from 7023063427406508032 to 7023063426371428352. Current Snapshot: MvccSnapshot[applied={T|T < 7023063427386589184}]
INSERT report
rows total: 2000
time total: 164.997 ms
time per row: 0.0824984 ms
I20240502 01:58:14.686414 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.199:34821
--local_ip_for_outbound_sockets=127.10.133.199
--tserver_master_addrs=127.10.133.254:41317
--webserver_port=35291
--webserver_interface=127.10.133.199
--builtin_ntp_servers=127.10.133.212:37675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 01:58:14.795737 14285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:14.795965 14285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:14.796033 14285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:14.799085 14285 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:14.799152 14285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:14.799239 14285 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.199
I20240502 01:58:14.802778 14285 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:37675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.199:34821
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--webserver_interface=127.10.133.199
--webserver_port=35291
--tserver_master_addrs=127.10.133.254:41317
--never_fsync=true
--heap_profile_path=/tmp/kudu.14285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.199
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:14.803678 14285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:14.804816 14285 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:14.813110 14291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:14.813419 14293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:14.814164 14290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:14.815526 14285 server_base.cc:1034] running on GCE node
I20240502 01:58:14.815865 14285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:14.816358 14285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:14.817509 14285 hybrid_clock.cc:648] HybridClock initialized: now 1714615094817501 us; error 37 us; skew 500 ppm
I20240502 01:58:14.819339 14285 webserver.cc:460] Webserver started at http://127.10.133.199:35291/ using document root <none> and password file <none>
I20240502 01:58:14.819872 14285 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:14.819936 14285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:14.823143 14285 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20240502 01:58:14.825119 14299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:14.826134 14285 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 01:58:14.826224 14285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
uuid: "1ef9768a03e545fba961cfeee4c1c867"
format_stamp: "Formatted at 2024-05-02 01:58:07 on dist-test-slave-dr9f"
I20240502 01:58:14.826622 14285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:14.838614 14285 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:14.839375 14285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:14.839547 14285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:14.840051 14285 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:14.841271 14306 ts_tablet_manager.cc:516] Loading tablet metadata (0/1 complete)
I20240502 01:58:14.844208 14285 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240502 01:58:14.844270 14285 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20240502 01:58:14.844348 14285 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240502 01:58:14.845728 14285 ts_tablet_manager.cc:590] Registered 1 tablets
I20240502 01:58:14.845777 14285 ts_tablet_manager.cc:569] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:14.846017 14306 tablet_bootstrap.cc:492] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap starting.
I20240502 01:58:14.855921 14285 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.199:34821
I20240502 01:58:14.856220 14414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.199:34821 every 8 connection(s)
I20240502 01:58:14.856920 14285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/info.pb
I20240502 01:58:14.860630 14306 log.cc:824] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:14.861841 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 14285
I20240502 01:58:14.862062 10775 test_util.cc:268] Using random seed: -274210578
I20240502 01:58:14.862329 14306 tablet_bootstrap.cc:492] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:14.862640 14306 tablet_bootstrap.cc:492] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap complete.
I20240502 01:58:14.863807 14306 ts_tablet_manager.cc:1367] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.011s
I20240502 01:58:14.866494 14415 heartbeater.cc:347] Connected to a master server at 127.10.133.254:41317
I20240502 01:58:14.866709 14415 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:14.867022 14306 raft_consensus.cc:348] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:14.867285 14415 heartbeater.cc:511] Master 127.10.133.254:41317 requested a full tablet report, sending...
I20240502 01:58:14.867317 14306 raft_consensus.cc:729] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef9768a03e545fba961cfeee4c1c867, State: Initialized, Role: FOLLOWER
I20240502 01:58:14.867784 14306 consensus_queue.cc:260] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } }
I20240502 01:58:14.868546 14306 ts_tablet_manager.cc:1398] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:58:14.869609 12660 ts_manager.cc:194] Re-registered known tserver with Master: 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199:34821)
I20240502 01:58:14.870400 12660 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.199:42993
I20240502 01:58:14.872440 14415 heartbeater.cc:503] Master 127.10.133.254:41317 was elected leader, sending a full tablet report...
I20240502 01:58:14.875288 10775 test_workload.cc:401] TestWorkload: Skipping table creation because table rebalance_test_table_0 already exists
I20240502 01:58:14.875494 10775 test_util.cc:268] Using random seed: -274197148
I20240502 01:58:14.884847 10775 test_workload.cc:401] TestWorkload: Skipping table creation because table rebalance_test_table_1 already exists
I20240502 01:58:14.884999 10775 test_util.cc:268] Using random seed: -274187642
I20240502 01:58:14.898872 10775 test_workload.cc:401] TestWorkload: Skipping table creation because table rebalance_test_table_2 already exists
I20240502 01:58:14.899034 10775 test_util.cc:268] Using random seed: -274173607
I20240502 01:58:14.914995 10775 test_workload.cc:401] TestWorkload: Skipping table creation because table rebalance_test_table_3 already exists
I20240502 01:58:14.915148 10775 test_util.cc:268] Using random seed: -274157495
I20240502 01:58:14.946494 10775 test_workload.cc:401] TestWorkload: Skipping table creation because table rebalance_test_table_4 already exists
W20240502 01:58:15.180399 14525 log.cc:924] Time spent T 8ec2e7e6494c42749311d109abfdd205 P 71010353c29d4e988704295c8cd73ef7: Append to log took a long time: real 0.106s user 0.000s sys 0.000s
I20240502 01:58:15.634289 13185 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:15.634670 13452 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:15.635478 14349 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:15.672520 13051 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:15.709249 13321 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:15.773135 12784 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 01:58:15.793404 12918 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
W20240502 01:58:15.864351 13276 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.133.195:33887, user_credentials={real_user=slave}} blocked reactor thread for 64162.4us
W20240502 01:58:16.224939 12741 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.133.198:39759, user_credentials={real_user=slave}} blocked reactor thread for 46389.8us
I20240502 01:58:16.675498 13452 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:16.683713 12918 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:16.700726 13051 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:16.756584 13321 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:16.780977 13185 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:16.785406 14349 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:16.884805 12784 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 01:58:17.079224 13473 consensus_queue.cc:237] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 1.31, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:17.081058 13340 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 1 index: 32. (index mismatch)
I20240502 01:58:17.081516 14508 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20240502 01:58:17.083523 13067 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 1 index: 32. (index mismatch)
I20240502 01:58:17.083732 13203 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 1 index: 32. (index mismatch)
I20240502 01:58:17.083959 14508 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20240502 01:58:17.084081 14595 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20240502 01:58:17.088157 14508 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 LEADER]: Committing config change with OpId 1.32: config changed from index -1 to 32, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
W20240502 01:58:17.090713 13408 consensus_peers.cc:485] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a -> Peer 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199:34821): Couldn't send request to peer 1ef9768a03e545fba961cfeee4c1c867. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16195ae890d445e39ed7ecdadde3009c. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:17.091151 12659 catalog_manager.cc:5484] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a reported cstate change: config changed from index -1 to 32, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New cstate: current_term: 1 leader_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" committed_config { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:17.094725 13203 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.32: config changed from index -1 to 32, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.095479 13340 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.32: config changed from index -1 to 32, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.096045 12803 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 1 index: 32. (index mismatch)
I20240502 01:58:17.096845 14595 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20240502 01:58:17.102834 13067 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.32: config changed from index -1 to 32, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.105299 12803 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Committing config change with OpId 1.32: config changed from index -1 to 32, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.209839 12938 consensus_queue.cc:237] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 1.30, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:17.216109 13204 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20240502 01:58:17.216544 14008 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20240502 01:58:17.222949 13468 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20240502 01:58:17.223322 12803 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20240502 01:58:17.225250 13072 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20240502 01:58:17.225442 14008 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20240502 01:58:17.228471 14008 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20240502 01:58:17.229928 14008 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20240502 01:58:17.239416 14594 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 LEADER]: Committing config change with OpId 1.31: config changed from index -1 to 31, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
W20240502 01:58:17.244119 12872 consensus_peers.cc:485] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e -> Peer 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199:34821): Couldn't send request to peer 1ef9768a03e545fba961cfeee4c1c867. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6eef7d25de5541bbbc7576185e097ed1. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:17.244169 13204 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index -1 to 31, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.244231 13473 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index -1 to 31, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.245023 12660 catalog_manager.cc:5484] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e reported cstate change: config changed from index -1 to 31, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New cstate: current_term: 1 leader_uuid: "42bc78875b454c7ab7fce86d56a28c1e" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:17.247655 12802 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index -1 to 31, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.250643 13071 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index -1 to 31, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.293828 12803 consensus_queue.cc:237] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 40, Committed index: 40, Last appended: 1.41, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: true } }
W20240502 01:58:17.297724 12738 consensus_peers.cc:485] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 -> Peer 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143): Couldn't send request to peer 42bc78875b454c7ab7fce86d56a28c1e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 281ea2fa1f9f49cebd4bb3620335168a. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:17.298638 13203 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 41. Preceding OpId from leader: term: 1 index: 42. (index mismatch)
I20240502 01:58:17.299829 14227 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 40, Time since last communication: 0.000s
I20240502 01:58:17.302671 13068 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 41. Preceding OpId from leader: term: 1 index: 42. (index mismatch)
I20240502 01:58:17.305150 13473 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 41. Preceding OpId from leader: term: 1 index: 42. (index mismatch)
I20240502 01:58:17.311553 14590 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 40, Time since last communication: 0.000s
I20240502 01:58:17.311756 13337 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 40. Preceding OpId from leader: term: 1 index: 42. (index mismatch)
I20240502 01:58:17.315608 14122 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 40, Time since last communication: 0.000s
I20240502 01:58:17.316365 14591 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 39, Time since last communication: 0.000s
I20240502 01:58:17.321810 14522 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.42: config changed from index -1 to 42, NON_VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) added. New config: { opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: true } } }
I20240502 01:58:17.327754 13204 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.42: config changed from index -1 to 42, NON_VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) added. New config: { opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: true } } }
I20240502 01:58:17.327797 12657 catalog_manager.cc:5484] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: config changed from index -1 to 42, NON_VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) added. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:17.334434 13472 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.42: config changed from index -1 to 42, NON_VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) added. New config: { opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: true } } }
I20240502 01:58:17.388159 12803 consensus_queue.cc:237] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 36, Committed index: 36, Last appended: 1.36, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:17.388638 13071 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.42: config changed from index -1 to 42, NON_VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) added. New config: { opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: true } } }
I20240502 01:58:17.392060 13208 raft_consensus.cc:1261] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 36. Preceding OpId from leader: term: 1 index: 37. (index mismatch)
I20240502 01:58:17.401170 14591 consensus_queue.cc:1035] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 37, Last known committed idx: 36, Time since last communication: 0.000s
W20240502 01:58:17.408407 12740 consensus_peers.cc:485] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 -> Peer 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199:34821): Couldn't send request to peer 1ef9768a03e545fba961cfeee4c1c867. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5175c37ef65f4f2fb83d64497592a180. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:17.414317 13473 raft_consensus.cc:1261] T 5175c37ef65f4f2fb83d64497592a180 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 36. Preceding OpId from leader: term: 1 index: 37. (index mismatch)
I20240502 01:58:17.418274 13339 raft_consensus.cc:1261] T 5175c37ef65f4f2fb83d64497592a180 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 36. Preceding OpId from leader: term: 1 index: 37. (index mismatch)
I20240502 01:58:17.423162 13068 raft_consensus.cc:1261] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 36. Preceding OpId from leader: term: 1 index: 37. (index mismatch)
I20240502 01:58:17.429263 14590 consensus_queue.cc:1035] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 37, Last known committed idx: 36, Time since last communication: 0.000s
I20240502 01:58:17.431886 13340 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.42: config changed from index -1 to 42, NON_VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) added. New config: { opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: true } } }
I20240502 01:58:17.463599 14590 consensus_queue.cc:1035] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 37, Last known committed idx: 36, Time since last communication: 0.000s
I20240502 01:58:17.485183 14592 raft_consensus.cc:2932] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.37: config changed from index -1 to 37, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.487390 13208 raft_consensus.cc:2932] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.37: config changed from index -1 to 37, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.488718 12657 catalog_manager.cc:5484] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: config changed from index -1 to 37, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:17.491199 14590 consensus_queue.cc:1035] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 37, Last known committed idx: 36, Time since last communication: 0.000s
I20240502 01:58:17.514684 12802 consensus_queue.cc:237] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 1.32, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:17.517279 13204 raft_consensus.cc:1261] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
W20240502 01:58:17.517813 12740 consensus_peers.cc:485] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 -> Peer 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199:34821): Couldn't send request to peer 1ef9768a03e545fba961cfeee4c1c867. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2963f09accd44e3db75d2f2c9b38b6cd. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:17.517922 14590 consensus_queue.cc:1035] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20240502 01:58:17.527194 13473 raft_consensus.cc:2932] T 5175c37ef65f4f2fb83d64497592a180 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.37: config changed from index -1 to 37, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.528280 14699 ts_tablet_manager.cc:902] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867: Initiating tablet copy from peer 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759)
I20240502 01:58:17.529371 14699 tablet_copy_client.cc:308] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.198:39759
I20240502 01:58:17.534631 13067 raft_consensus.cc:2932] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.37: config changed from index -1 to 37, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.541693 12937 raft_consensus.cc:1261] T 2963f09accd44e3db75d2f2c9b38b6cd P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20240502 01:58:17.542294 13340 raft_consensus.cc:1261] T 2963f09accd44e3db75d2f2c9b38b6cd P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20240502 01:58:17.542413 14590 consensus_queue.cc:1035] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20240502 01:58:17.543141 14121 consensus_queue.cc:1035] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20240502 01:58:17.544230 13067 raft_consensus.cc:1261] T 2963f09accd44e3db75d2f2c9b38b6cd P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20240502 01:58:17.553743 13340 raft_consensus.cc:2932] T 5175c37ef65f4f2fb83d64497592a180 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.37: config changed from index -1 to 37, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.559271 13493 tablet_copy_service.cc:140] P 1928367ae8d64ba49a7f5761b2d3dc4a: Received BeginTabletCopySession request for tablet 16195ae890d445e39ed7ecdadde3009c from peer 1ef9768a03e545fba961cfeee4c1c867 ({username='slave'} at 127.10.133.199:60251)
I20240502 01:58:17.559455 13493 tablet_copy_service.cc:161] P 1928367ae8d64ba49a7f5761b2d3dc4a: Beginning new tablet copy session on tablet 16195ae890d445e39ed7ecdadde3009c from peer 1ef9768a03e545fba961cfeee4c1c867 at {username='slave'} at 127.10.133.199:60251: session id = 1ef9768a03e545fba961cfeee4c1c867-16195ae890d445e39ed7ecdadde3009c
I20240502 01:58:17.560803 13493 tablet_copy_source_session.cc:205] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:17.565647 14122 raft_consensus.cc:2932] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.33: config changed from index -1 to 33, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.567118 14122 consensus_queue.cc:1035] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20240502 01:58:17.570616 13203 raft_consensus.cc:2932] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.33: config changed from index -1 to 33, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.575165 12655 catalog_manager.cc:5484] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: config changed from index -1 to 33, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:17.583045 14699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16195ae890d445e39ed7ecdadde3009c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:17.585552 12934 raft_consensus.cc:2932] T 2963f09accd44e3db75d2f2c9b38b6cd P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.33: config changed from index -1 to 33, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.590269 13072 raft_consensus.cc:2932] T 2963f09accd44e3db75d2f2c9b38b6cd P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.33: config changed from index -1 to 33, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.605355 13472 consensus_queue.cc:237] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 43, Committed index: 43, Last appended: 1.43, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 44 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:17.605511 14699 tablet_copy_client.cc:783] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:17.608505 13067 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 43. Preceding OpId from leader: term: 1 index: 44. (index mismatch)
I20240502 01:58:17.608505 13337 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 43. Preceding OpId from leader: term: 1 index: 44. (index mismatch)
W20240502 01:58:17.608777 13408 consensus_peers.cc:485] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a -> Peer 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199:34821): Couldn't send request to peer 1ef9768a03e545fba961cfeee4c1c867. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc637bf633fc4fe58db54a6bc0821417. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:17.608944 14678 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20240502 01:58:17.609141 14595 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20240502 01:58:17.609529 12938 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 43. Preceding OpId from leader: term: 1 index: 44. (index mismatch)
I20240502 01:58:17.609884 14595 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20240502 01:58:17.611793 14595 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 LEADER]: Committing config change with OpId 1.44: config changed from index -1 to 44, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 44 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.613827 13340 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.44: config changed from index -1 to 44, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 44 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.614260 14699 tablet_copy_client.cc:647] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:17.614910 12935 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.44: config changed from index -1 to 44, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 44 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.616443 12657 catalog_manager.cc:5484] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a reported cstate change: config changed from index -1 to 44, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New cstate: current_term: 1 leader_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" committed_config { opid_index: 44 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:17.616806 13072 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.44: config changed from index -1 to 44, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 44 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.625560 13340 raft_consensus.cc:2932] T 2963f09accd44e3db75d2f2c9b38b6cd P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.33: config changed from index -1 to 33, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.627871 14699 tablet_copy_client.cc:523] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:17.646981 14699 tablet_bootstrap.cc:492] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap starting.
I20240502 01:58:17.694734 12805 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 43. Preceding OpId from leader: term: 1 index: 44. (index mismatch)
I20240502 01:58:17.707195 14199 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20240502 01:58:17.754540 12802 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Committing config change with OpId 1.44: config changed from index -1 to 44, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 44 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:17.757053 14699 tablet_bootstrap.cc:492] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap replayed 1/1 log segments. Stats: ops{read=38 overwritten=0 applied=37 ignored=0} inserts{seen=722 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20240502 01:58:17.759982 14699 tablet_bootstrap.cc:492] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap complete.
I20240502 01:58:17.760555 14699 ts_tablet_manager.cc:1367] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867: Time spent bootstrapping tablet: real 0.114s user 0.056s sys 0.007s
I20240502 01:58:17.761634 14699 raft_consensus.cc:348] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:17.763314 14699 raft_consensus.cc:729] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1ef9768a03e545fba961cfeee4c1c867, State: Initialized, Role: LEARNER
I20240502 01:58:17.763511 14699 consensus_queue.cc:260] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 37, Last appended: 1.38, Last appended by leader: 38, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:17.765297 14699 ts_tablet_manager.cc:1398] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:58:17.771158 13493 tablet_copy_service.cc:342] P 1928367ae8d64ba49a7f5761b2d3dc4a: Request end of tablet copy session 1ef9768a03e545fba961cfeee4c1c867-16195ae890d445e39ed7ecdadde3009c received from {username='slave'} at 127.10.133.199:60251
I20240502 01:58:17.771255 13493 tablet_copy_service.cc:433] P 1928367ae8d64ba49a7f5761b2d3dc4a: ending tablet copy session 1ef9768a03e545fba961cfeee4c1c867-16195ae890d445e39ed7ecdadde3009c on tablet 16195ae890d445e39ed7ecdadde3009c with peer 1ef9768a03e545fba961cfeee4c1c867
I20240502 01:58:17.772446 14699 ts_tablet_manager.cc:902] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867: Initiating tablet copy from peer 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143)
I20240502 01:58:17.772890 14699 tablet_copy_client.cc:308] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:40143
I20240502 01:58:17.829926 14716 ts_tablet_manager.cc:902] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e: Initiating tablet copy from peer 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263)
I20240502 01:58:17.831543 14716 tablet_copy_client.cc:308] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:46263
I20240502 01:58:17.833432 12825 tablet_copy_service.cc:140] P 27e2acacdad14caa8f66bc81fa8a2f88: Received BeginTabletCopySession request for tablet 281ea2fa1f9f49cebd4bb3620335168a from peer 42bc78875b454c7ab7fce86d56a28c1e ({username='slave'} at 127.10.133.194:49485)
I20240502 01:58:17.833583 12825 tablet_copy_service.cc:161] P 27e2acacdad14caa8f66bc81fa8a2f88: Beginning new tablet copy session on tablet 281ea2fa1f9f49cebd4bb3620335168a from peer 42bc78875b454c7ab7fce86d56a28c1e at {username='slave'} at 127.10.133.194:49485: session id = 42bc78875b454c7ab7fce86d56a28c1e-281ea2fa1f9f49cebd4bb3620335168a
I20240502 01:58:17.835036 12825 tablet_copy_source_session.cc:205] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:17.839123 14716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281ea2fa1f9f49cebd4bb3620335168a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:17.843372 14716 tablet_copy_client.cc:783] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:17.859699 14716 tablet_copy_client.cc:647] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:17.862165 12959 tablet_copy_service.cc:140] P 42bc78875b454c7ab7fce86d56a28c1e: Received BeginTabletCopySession request for tablet 6eef7d25de5541bbbc7576185e097ed1 from peer 1ef9768a03e545fba961cfeee4c1c867 ({username='slave'} at 127.10.133.199:53897)
I20240502 01:58:17.862304 12959 tablet_copy_service.cc:161] P 42bc78875b454c7ab7fce86d56a28c1e: Beginning new tablet copy session on tablet 6eef7d25de5541bbbc7576185e097ed1 from peer 1ef9768a03e545fba961cfeee4c1c867 at {username='slave'} at 127.10.133.199:53897: session id = 1ef9768a03e545fba961cfeee4c1c867-6eef7d25de5541bbbc7576185e097ed1
I20240502 01:58:17.863654 12959 tablet_copy_source_session.cc:205] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:17.863971 14716 tablet_copy_client.cc:523] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:17.865391 14699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eef7d25de5541bbbc7576185e097ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:17.866134 14716 tablet_bootstrap.cc:492] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e: Bootstrap starting.
I20240502 01:58:17.867698 14699 tablet_copy_client.cc:783] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:17.867828 14699 tablet_copy_client.cc:647] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:17.870111 14699 tablet_copy_client.cc:523] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:17.871237 14699 tablet_bootstrap.cc:492] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap starting.
W20240502 01:58:17.906726 12741 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.133.198:39759, user_credentials={real_user=slave}} blocked reactor thread for 87771.5us
I20240502 01:58:17.955904 14721 ts_tablet_manager.cc:902] T 5175c37ef65f4f2fb83d64497592a180 P 1ef9768a03e545fba961cfeee4c1c867: Initiating tablet copy from peer 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263)
I20240502 01:58:17.956458 14721 tablet_copy_client.cc:308] T 5175c37ef65f4f2fb83d64497592a180 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:46263
I20240502 01:58:17.967955 14699 tablet_bootstrap.cc:492] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap replayed 1/1 log segments. Stats: ops{read=36 overwritten=0 applied=36 ignored=0} inserts{seen=721 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:17.968729 12825 tablet_copy_service.cc:140] P 27e2acacdad14caa8f66bc81fa8a2f88: Received BeginTabletCopySession request for tablet 5175c37ef65f4f2fb83d64497592a180 from peer 1ef9768a03e545fba961cfeee4c1c867 ({username='slave'} at 127.10.133.199:42263)
I20240502 01:58:17.968847 12825 tablet_copy_service.cc:161] P 27e2acacdad14caa8f66bc81fa8a2f88: Beginning new tablet copy session on tablet 5175c37ef65f4f2fb83d64497592a180 from peer 1ef9768a03e545fba961cfeee4c1c867 at {username='slave'} at 127.10.133.199:42263: session id = 1ef9768a03e545fba961cfeee4c1c867-5175c37ef65f4f2fb83d64497592a180
I20240502 01:58:17.969826 12825 tablet_copy_source_session.cc:205] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:17.971113 14721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5175c37ef65f4f2fb83d64497592a180. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:17.971321 14699 tablet_bootstrap.cc:492] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap complete.
I20240502 01:58:17.971521 14699 ts_tablet_manager.cc:1367] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867: Time spent bootstrapping tablet: real 0.100s user 0.050s sys 0.004s
I20240502 01:58:17.971984 14699 raft_consensus.cc:348] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:17.972100 14699 raft_consensus.cc:729] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1ef9768a03e545fba961cfeee4c1c867, State: Initialized, Role: LEARNER
I20240502 01:58:17.972188 14699 consensus_queue.cc:260] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 36, Last appended: 1.36, Last appended by leader: 36, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:17.972470 14699 ts_tablet_manager.cc:1398] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:17.973168 14721 tablet_copy_client.cc:783] T 5175c37ef65f4f2fb83d64497592a180 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:17.973309 14721 tablet_copy_client.cc:647] T 5175c37ef65f4f2fb83d64497592a180 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:17.974090 14369 raft_consensus.cc:1203] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.31->[1.32-1.41] Dedup: 1.38->[1.39-1.41]
I20240502 01:58:17.976147 12959 tablet_copy_service.cc:342] P 42bc78875b454c7ab7fce86d56a28c1e: Request end of tablet copy session 1ef9768a03e545fba961cfeee4c1c867-6eef7d25de5541bbbc7576185e097ed1 received from {username='slave'} at 127.10.133.199:53897
I20240502 01:58:17.976267 12959 tablet_copy_service.cc:433] P 42bc78875b454c7ab7fce86d56a28c1e: ending tablet copy session 1ef9768a03e545fba961cfeee4c1c867-6eef7d25de5541bbbc7576185e097ed1 on tablet 6eef7d25de5541bbbc7576185e097ed1 with peer 1ef9768a03e545fba961cfeee4c1c867
I20240502 01:58:17.992520 14699 ts_tablet_manager.cc:902] T 2963f09accd44e3db75d2f2c9b38b6cd P 1ef9768a03e545fba961cfeee4c1c867: Initiating tablet copy from peer 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263)
I20240502 01:58:17.993083 14699 tablet_copy_client.cc:308] T 2963f09accd44e3db75d2f2c9b38b6cd P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:46263
I20240502 01:58:17.993734 12825 tablet_copy_service.cc:140] P 27e2acacdad14caa8f66bc81fa8a2f88: Received BeginTabletCopySession request for tablet 2963f09accd44e3db75d2f2c9b38b6cd from peer 1ef9768a03e545fba961cfeee4c1c867 ({username='slave'} at 127.10.133.199:42263)
I20240502 01:58:17.993832 12825 tablet_copy_service.cc:161] P 27e2acacdad14caa8f66bc81fa8a2f88: Beginning new tablet copy session on tablet 2963f09accd44e3db75d2f2c9b38b6cd from peer 1ef9768a03e545fba961cfeee4c1c867 at {username='slave'} at 127.10.133.199:42263: session id = 1ef9768a03e545fba961cfeee4c1c867-2963f09accd44e3db75d2f2c9b38b6cd
I20240502 01:58:17.994886 12825 tablet_copy_source_session.cc:205] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:17.996841 14699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2963f09accd44e3db75d2f2c9b38b6cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:17.999905 14699 tablet_copy_client.cc:783] T 2963f09accd44e3db75d2f2c9b38b6cd P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:18.000113 14699 tablet_copy_client.cc:647] T 2963f09accd44e3db75d2f2c9b38b6cd P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:18.004058 14699 tablet_copy_client.cc:523] T 2963f09accd44e3db75d2f2c9b38b6cd P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:18.005929 14699 tablet_bootstrap.cc:492] T 2963f09accd44e3db75d2f2c9b38b6cd P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap starting.
I20240502 01:58:18.025480 14721 tablet_copy_client.cc:523] T 5175c37ef65f4f2fb83d64497592a180 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:18.027058 14721 tablet_bootstrap.cc:492] T 5175c37ef65f4f2fb83d64497592a180 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap starting.
I20240502 01:58:18.078075 14780 ts_tablet_manager.cc:902] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867: Initiating tablet copy from peer 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759)
I20240502 01:58:18.079840 14678 raft_consensus.cc:1050] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a: attempting to promote NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 to VOTER
I20240502 01:58:18.080974 14678 consensus_queue.cc:237] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 42, Committed index: 42, Last appended: 1.42, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } }
I20240502 01:58:18.084914 13071 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 42. Preceding OpId from leader: term: 1 index: 43. (index mismatch)
I20240502 01:58:18.085939 14515 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 41, Time since last communication: 0.001s
I20240502 01:58:18.086616 13340 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 42. Preceding OpId from leader: term: 1 index: 43. (index mismatch)
I20240502 01:58:18.087457 13207 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 42. Preceding OpId from leader: term: 1 index: 43. (index mismatch)
I20240502 01:58:18.089092 14199 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 41, Time since last communication: 0.000s
I20240502 01:58:18.090127 14515 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 41, Time since last communication: 0.000s
I20240502 01:58:18.092540 14515 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 LEADER]: Committing config change with OpId 1.43: config changed from index 32 to 43, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.094595 13339 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.43: config changed from index 32 to 43, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.082743 14368 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 42. Preceding OpId from leader: term: 1 index: 43. (index mismatch)
I20240502 01:58:18.095901 12660 catalog_manager.cc:5484] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a reported cstate change: config changed from index 32 to 43, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" committed_config { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:18.096618 14780 tablet_copy_client.cc:308] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.198:39759
I20240502 01:58:18.100013 14199 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 41, Time since last communication: 0.000s
I20240502 01:58:18.104189 13493 tablet_copy_service.cc:140] P 1928367ae8d64ba49a7f5761b2d3dc4a: Received BeginTabletCopySession request for tablet bc637bf633fc4fe58db54a6bc0821417 from peer 1ef9768a03e545fba961cfeee4c1c867 ({username='slave'} at 127.10.133.199:60251)
I20240502 01:58:18.104283 13493 tablet_copy_service.cc:161] P 1928367ae8d64ba49a7f5761b2d3dc4a: Beginning new tablet copy session on tablet bc637bf633fc4fe58db54a6bc0821417 from peer 1ef9768a03e545fba961cfeee4c1c867 at {username='slave'} at 127.10.133.199:60251: session id = 1ef9768a03e545fba961cfeee4c1c867-bc637bf633fc4fe58db54a6bc0821417
I20240502 01:58:18.105159 13493 tablet_copy_source_session.cc:205] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:18.106417 14369 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.43: config changed from index 32 to 43, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.109148 14780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc637bf633fc4fe58db54a6bc0821417. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:18.112943 13072 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.43: config changed from index 32 to 43, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.114439 14699 tablet_bootstrap.cc:492] T 2963f09accd44e3db75d2f2c9b38b6cd P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap replayed 1/1 log segments. Stats: ops{read=37 overwritten=0 applied=37 ignored=0} inserts{seen=709 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:18.115193 14699 tablet_bootstrap.cc:492] T 2963f09accd44e3db75d2f2c9b38b6cd P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap complete.
I20240502 01:58:18.115442 14699 ts_tablet_manager.cc:1367] T 2963f09accd44e3db75d2f2c9b38b6cd P 1ef9768a03e545fba961cfeee4c1c867: Time spent bootstrapping tablet: real 0.110s user 0.049s sys 0.004s
I20240502 01:58:18.115969 14699 raft_consensus.cc:348] T 2963f09accd44e3db75d2f2c9b38b6cd P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:18.116212 14699 raft_consensus.cc:729] T 2963f09accd44e3db75d2f2c9b38b6cd P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1ef9768a03e545fba961cfeee4c1c867, State: Initialized, Role: LEARNER
I20240502 01:58:18.116390 14699 consensus_queue.cc:260] T 2963f09accd44e3db75d2f2c9b38b6cd P 1ef9768a03e545fba961cfeee4c1c867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 37, Last appended: 1.37, Last appended by leader: 37, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:18.121150 13207 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.43: config changed from index 32 to 43, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.120725 14699 ts_tablet_manager.cc:1398] T 2963f09accd44e3db75d2f2c9b38b6cd P 1ef9768a03e545fba961cfeee4c1c867: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20240502 01:58:18.127476 12802 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 42. Preceding OpId from leader: term: 1 index: 43. (index mismatch)
I20240502 01:58:18.132598 12825 tablet_copy_service.cc:342] P 27e2acacdad14caa8f66bc81fa8a2f88: Request end of tablet copy session 1ef9768a03e545fba961cfeee4c1c867-2963f09accd44e3db75d2f2c9b38b6cd received from {username='slave'} at 127.10.133.199:42263
I20240502 01:58:18.132720 12825 tablet_copy_service.cc:433] P 27e2acacdad14caa8f66bc81fa8a2f88: ending tablet copy session 1ef9768a03e545fba961cfeee4c1c867-2963f09accd44e3db75d2f2c9b38b6cd on tablet 2963f09accd44e3db75d2f2c9b38b6cd with peer 1ef9768a03e545fba961cfeee4c1c867
I20240502 01:58:18.136075 14780 tablet_copy_client.cc:783] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:18.138942 14199 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 41, Time since last communication: 0.000s
I20240502 01:58:18.136433 14780 tablet_copy_client.cc:647] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:18.187506 14780 tablet_copy_client.cc:523] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:18.189209 14780 tablet_bootstrap.cc:492] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap starting.
I20240502 01:58:18.197036 12802 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Committing config change with OpId 1.43: config changed from index 32 to 43, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.292640 13469 consensus_queue.cc:237] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 1.45, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 46 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } }
I20240502 01:58:18.295521 13203 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 44. Preceding OpId from leader: term: 1 index: 46. (index mismatch)
I20240502 01:58:18.296505 14368 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 44. Preceding OpId from leader: term: 1 index: 46. (index mismatch)
I20240502 01:58:18.296738 14732 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 43, Time since last communication: 0.000s
I20240502 01:58:18.299548 14678 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 44, Time since last communication: 0.000s
I20240502 01:58:18.301887 14368 raft_consensus.cc:1203] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.30->[1.31-1.41] Dedup: 1.36->[1.37-1.41]
I20240502 01:58:18.302110 13336 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 45. Preceding OpId from leader: term: 1 index: 46. (index mismatch)
I20240502 01:58:18.302492 14732 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 44, Time since last communication: 0.000s
I20240502 01:58:18.308135 13072 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 45. Preceding OpId from leader: term: 1 index: 46. (index mismatch)
I20240502 01:58:18.308693 14367 raft_consensus.cc:1203] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.44->[1.45-1.46] Dedup: 1.45->[1.46-1.46]
I20240502 01:58:18.310308 14508 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 LEADER]: Committing config change with OpId 1.46: config changed from index 43 to 46, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 46 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.316221 14367 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.46: config changed from index 43 to 46, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 46 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.318956 12655 catalog_manager.cc:5484] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867 reported cstate change: config changed from index 43 to 46, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" committed_config { opid_index: 46 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.325538 12784 tablet_service.cc:1514] Processing DeleteTablet for tablet 16195ae890d445e39ed7ecdadde3009c with delete_type TABLET_DATA_TOMBSTONED (TS 27e2acacdad14caa8f66bc81fa8a2f88 not found in new config with opid_index 46) from {username='slave'} at 127.0.0.1:51568
I20240502 01:58:18.330185 12649 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 16195ae890d445e39ed7ecdadde3009c with cas_config_opid_index 43: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:18.330176 13204 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.46: config changed from index 43 to 46, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 46 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.330539 14800 tablet_replica.cc:330] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88: stopping tablet replica
I20240502 01:58:18.330730 14199 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 44, Time since last communication: 0.000s
I20240502 01:58:18.330860 14800 raft_consensus.cc:2229] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:18.330806 13340 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.46: config changed from index 43 to 46, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 46 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.330996 14800 pending_rounds.cc:62] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88: Trying to abort 1 pending ops.
I20240502 01:58:18.331045 14800 pending_rounds.cc:68] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88: Aborting op as it isn't in flight: id { term: 1 index: 44 } timestamp: 7023063442490363904 op_type: WRITE_OP write_request { tablet_id: "16195ae890d445e39ed7ecdadde3009c" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000S\031%={\236\026\333\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""8b802bae9767a677" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7023063442146299904 authz_token { token_data: "\010\342\350\313\261\006\"3\n\005slave\022*\n e192d1fc91574f419257f076074a1378\020\001\030\001 \001(\001" signature: "<redacted>""\225%\332I\3137\3210\206\250c\013eIf\350\341\271\265\3556\336\377\272B\220I\201\020\250q\202Ixf%/y4\323\360\251\356\233\014J^\004\311\022$&\231\206\227Eh4\033\235\241\241dC" signing_key_seq_num: 0 } } request_id { client_id: "111d9a614a1e44ee966596300324a1a5" seq_no: 119 first_incomplete_seq_no: 119 attempt_no: 0 }
I20240502 01:58:18.331394 14800 raft_consensus.cc:2258] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:18.336850 13071 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.46: config changed from index 43 to 46, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 46 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.340714 14800 ts_tablet_manager.cc:1875] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:18.351771 14800 ts_tablet_manager.cc:1888] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.44
I20240502 01:58:18.359066 14800 log.cc:1196] T 16195ae890d445e39ed7ecdadde3009c P 27e2acacdad14caa8f66bc81fa8a2f88: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/16195ae890d445e39ed7ecdadde3009c
I20240502 01:58:18.359962 12648 catalog_manager.cc:4830] TS 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263): tablet 16195ae890d445e39ed7ecdadde3009c (table rebalance_test_table_3 [id=e192d1fc91574f419257f076074a1378]) successfully deleted
I20240502 01:58:18.407897 14721 tablet_bootstrap.cc:492] T 5175c37ef65f4f2fb83d64497592a180 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap replayed 1/1 log segments. Stats: ops{read=41 overwritten=0 applied=40 ignored=0} inserts{seen=712 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20240502 01:58:18.408385 14721 tablet_bootstrap.cc:492] T 5175c37ef65f4f2fb83d64497592a180 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap complete.
I20240502 01:58:18.408665 14721 ts_tablet_manager.cc:1367] T 5175c37ef65f4f2fb83d64497592a180 P 1ef9768a03e545fba961cfeee4c1c867: Time spent bootstrapping tablet: real 0.382s user 0.055s sys 0.004s
I20240502 01:58:18.409313 14721 raft_consensus.cc:348] T 5175c37ef65f4f2fb83d64497592a180 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:18.410293 14721 raft_consensus.cc:729] T 5175c37ef65f4f2fb83d64497592a180 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1ef9768a03e545fba961cfeee4c1c867, State: Initialized, Role: LEARNER
I20240502 01:58:18.410460 14721 consensus_queue.cc:260] T 5175c37ef65f4f2fb83d64497592a180 P 1ef9768a03e545fba961cfeee4c1c867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 40, Last appended: 1.41, Last appended by leader: 41, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:18.412108 14721 ts_tablet_manager.cc:1398] T 5175c37ef65f4f2fb83d64497592a180 P 1ef9768a03e545fba961cfeee4c1c867: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:58:18.415091 12825 tablet_copy_service.cc:342] P 27e2acacdad14caa8f66bc81fa8a2f88: Request end of tablet copy session 1ef9768a03e545fba961cfeee4c1c867-5175c37ef65f4f2fb83d64497592a180 received from {username='slave'} at 127.10.133.199:42263
I20240502 01:58:18.415179 12825 tablet_copy_service.cc:433] P 27e2acacdad14caa8f66bc81fa8a2f88: ending tablet copy session 1ef9768a03e545fba961cfeee4c1c867-5175c37ef65f4f2fb83d64497592a180 on tablet 5175c37ef65f4f2fb83d64497592a180 with peer 1ef9768a03e545fba961cfeee4c1c867
I20240502 01:58:18.419257 14716 tablet_bootstrap.cc:492] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e: Bootstrap replayed 1/1 log segments. Stats: ops{read=46 overwritten=0 applied=46 ignored=0} inserts{seen=677 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:18.438292 14716 tablet_bootstrap.cc:492] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e: Bootstrap complete.
I20240502 01:58:18.438937 14716 ts_tablet_manager.cc:1367] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e: Time spent bootstrapping tablet: real 0.573s user 0.056s sys 0.007s
I20240502 01:58:18.439419 14716 raft_consensus.cc:348] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: true } }
I20240502 01:58:18.439584 14716 raft_consensus.cc:729] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 42bc78875b454c7ab7fce86d56a28c1e, State: Initialized, Role: LEARNER
I20240502 01:58:18.439983 14716 consensus_queue.cc:260] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 46, Last appended: 1.46, Last appended by leader: 46, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: true } }
I20240502 01:58:18.440507 14716 ts_tablet_manager.cc:1398] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:18.442816 12825 tablet_copy_service.cc:342] P 27e2acacdad14caa8f66bc81fa8a2f88: Request end of tablet copy session 42bc78875b454c7ab7fce86d56a28c1e-281ea2fa1f9f49cebd4bb3620335168a received from {username='slave'} at 127.10.133.194:49485
I20240502 01:58:18.442895 12825 tablet_copy_service.cc:433] P 27e2acacdad14caa8f66bc81fa8a2f88: ending tablet copy session 42bc78875b454c7ab7fce86d56a28c1e-281ea2fa1f9f49cebd4bb3620335168a on tablet 281ea2fa1f9f49cebd4bb3620335168a with peer 42bc78875b454c7ab7fce86d56a28c1e
I20240502 01:58:18.452803 14367 raft_consensus.cc:1203] T 5175c37ef65f4f2fb83d64497592a180 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.36->[1.37-1.45] Dedup: 1.41->[1.42-1.45]
I20240502 01:58:18.466722 14780 tablet_bootstrap.cc:492] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap replayed 1/1 log segments. Stats: ops{read=56 overwritten=0 applied=56 ignored=0} inserts{seen=687 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:18.467123 14780 tablet_bootstrap.cc:492] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap complete.
I20240502 01:58:18.467393 14780 ts_tablet_manager.cc:1367] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867: Time spent bootstrapping tablet: real 0.278s user 0.068s sys 0.005s
I20240502 01:58:18.468171 14780 raft_consensus.cc:348] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 44 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:18.468395 14780 raft_consensus.cc:729] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1ef9768a03e545fba961cfeee4c1c867, State: Initialized, Role: LEARNER
I20240502 01:58:18.468566 14780 consensus_queue.cc:260] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 56, Last appended: 1.56, Last appended by leader: 56, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 44 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:18.470702 14780 ts_tablet_manager.cc:1398] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:58:18.472707 13493 tablet_copy_service.cc:342] P 1928367ae8d64ba49a7f5761b2d3dc4a: Request end of tablet copy session 1ef9768a03e545fba961cfeee4c1c867-bc637bf633fc4fe58db54a6bc0821417 received from {username='slave'} at 127.10.133.199:60251
I20240502 01:58:18.472796 13493 tablet_copy_service.cc:433] P 1928367ae8d64ba49a7f5761b2d3dc4a: ending tablet copy session 1ef9768a03e545fba961cfeee4c1c867-bc637bf633fc4fe58db54a6bc0821417 on tablet bc637bf633fc4fe58db54a6bc0821417 with peer 1ef9768a03e545fba961cfeee4c1c867
I20240502 01:58:18.520567 14367 raft_consensus.cc:1203] T 2963f09accd44e3db75d2f2c9b38b6cd P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.32->[1.33-1.40] Dedup: 1.37->[1.38-1.40]
I20240502 01:58:18.541600 14121 raft_consensus.cc:1050] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88: attempting to promote NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 to VOTER
I20240502 01:58:18.542204 14121 consensus_queue.cc:237] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 1.42, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } }
I20240502 01:58:18.543892 14367 raft_consensus.cc:1261] T 2963f09accd44e3db75d2f2c9b38b6cd P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 42. Preceding OpId from leader: term: 1 index: 43. (index mismatch)
I20240502 01:58:18.543931 13203 raft_consensus.cc:1261] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 42. Preceding OpId from leader: term: 1 index: 43. (index mismatch)
I20240502 01:58:18.544322 13932 consensus_queue.cc:1035] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 41, Time since last communication: 0.000s
I20240502 01:58:18.544587 13932 consensus_queue.cc:1035] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 41, Time since last communication: 0.000s
I20240502 01:58:18.557117 12937 raft_consensus.cc:1261] T 2963f09accd44e3db75d2f2c9b38b6cd P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 41. Preceding OpId from leader: term: 1 index: 43. (index mismatch)
I20240502 01:58:18.565735 13071 raft_consensus.cc:1261] T 2963f09accd44e3db75d2f2c9b38b6cd P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 41. Preceding OpId from leader: term: 1 index: 43. (index mismatch)
I20240502 01:58:18.566337 13336 raft_consensus.cc:1261] T 2963f09accd44e3db75d2f2c9b38b6cd P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 41. Preceding OpId from leader: term: 1 index: 43. (index mismatch)
I20240502 01:58:18.570274 13932 consensus_queue.cc:1035] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 40, Time since last communication: 0.000s
I20240502 01:58:18.571879 14523 consensus_queue.cc:1035] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 40, Time since last communication: 0.000s
I20240502 01:58:18.577553 14497 consensus_queue.cc:1035] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 41, Time since last communication: 0.000s
I20240502 01:58:18.582947 14590 raft_consensus.cc:2932] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.43: config changed from index 33 to 43, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.586215 14367 raft_consensus.cc:2932] T 2963f09accd44e3db75d2f2c9b38b6cd P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.43: config changed from index 33 to 43, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.586414 12660 catalog_manager.cc:5484] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: config changed from index 33 to 43, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:18.591164 13203 raft_consensus.cc:2932] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.43: config changed from index 33 to 43, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.596267 14591 raft_consensus.cc:1050] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88: attempting to promote NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 to VOTER
I20240502 01:58:18.596671 14591 consensus_queue.cc:237] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 1.46, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } }
I20240502 01:58:18.600056 14367 raft_consensus.cc:1261] T 5175c37ef65f4f2fb83d64497592a180 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 46. Preceding OpId from leader: term: 1 index: 47. (index mismatch)
I20240502 01:58:18.600679 13204 raft_consensus.cc:1261] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 46. Preceding OpId from leader: term: 1 index: 47. (index mismatch)
I20240502 01:58:18.609287 12935 raft_consensus.cc:2932] T 2963f09accd44e3db75d2f2c9b38b6cd P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.43: config changed from index 33 to 43, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.612162 14523 consensus_queue.cc:1035] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 45, Time since last communication: 0.000s
I20240502 01:58:18.612289 14522 consensus_queue.cc:1035] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 45, Time since last communication: 0.000s
I20240502 01:58:18.625844 13468 raft_consensus.cc:1261] T 5175c37ef65f4f2fb83d64497592a180 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 46. Preceding OpId from leader: term: 1 index: 47. (index mismatch)
I20240502 01:58:18.626580 13068 raft_consensus.cc:1261] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 46. Preceding OpId from leader: term: 1 index: 47. (index mismatch)
I20240502 01:58:18.632114 13336 raft_consensus.cc:1261] T 5175c37ef65f4f2fb83d64497592a180 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 46. Preceding OpId from leader: term: 1 index: 47. (index mismatch)
I20240502 01:58:18.647032 14590 consensus_queue.cc:1035] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 45, Time since last communication: 0.000s
I20240502 01:58:18.666858 14522 consensus_queue.cc:1035] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 45, Time since last communication: 0.000s
I20240502 01:58:18.669369 13072 raft_consensus.cc:2932] T 2963f09accd44e3db75d2f2c9b38b6cd P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.43: config changed from index 33 to 43, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.670601 14590 consensus_queue.cc:1035] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 45, Time since last communication: 0.000s
I20240502 01:58:18.677525 14594 raft_consensus.cc:1050] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e: attempting to promote NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 to VOTER
I20240502 01:58:18.678051 14594 consensus_queue.cc:237] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 1.42, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } }
I20240502 01:58:18.682382 14368 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 42. Preceding OpId from leader: term: 1 index: 43. (index mismatch)
I20240502 01:58:18.682330 14590 raft_consensus.cc:2932] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.47: config changed from index 37 to 47, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.682799 13203 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 42. Preceding OpId from leader: term: 1 index: 43. (index mismatch)
I20240502 01:58:18.682979 12804 consensus_queue.cc:237] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 43, Committed index: 43, Last appended: 1.44, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 45 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } }
I20240502 01:58:18.687863 14608 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 41, Time since last communication: 0.000s
I20240502 01:58:18.688174 14608 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 41, Time since last communication: 0.000s
I20240502 01:58:18.690542 13068 raft_consensus.cc:2932] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.47: config changed from index 37 to 47, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.693961 12659 catalog_manager.cc:5484] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7 reported cstate change: config changed from index 37 to 47, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.696208 13473 raft_consensus.cc:2932] T 5175c37ef65f4f2fb83d64497592a180 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.47: config changed from index 37 to 47, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.698267 13204 raft_consensus.cc:2932] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.47: config changed from index 37 to 47, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.700582 13336 raft_consensus.cc:2932] T 2963f09accd44e3db75d2f2c9b38b6cd P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.43: config changed from index 33 to 43, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.701838 14368 raft_consensus.cc:2932] T 5175c37ef65f4f2fb83d64497592a180 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.47: config changed from index 37 to 47, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.703477 14367 raft_consensus.cc:1261] T 2963f09accd44e3db75d2f2c9b38b6cd P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 44. Preceding OpId from leader: term: 1 index: 45. (index mismatch)
I20240502 01:58:18.706073 13336 raft_consensus.cc:1261] T 2963f09accd44e3db75d2f2c9b38b6cd P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 43. Preceding OpId from leader: term: 1 index: 45. (index mismatch)
I20240502 01:58:18.708098 14522 consensus_queue.cc:1035] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 43, Time since last communication: 0.000s
I20240502 01:58:18.709010 12804 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 42. Preceding OpId from leader: term: 1 index: 43. (index mismatch)
I20240502 01:58:18.710608 13070 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 42. Preceding OpId from leader: term: 1 index: 43. (index mismatch)
I20240502 01:58:18.713521 14594 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 41, Time since last communication: 0.000s
I20240502 01:58:18.715636 12935 raft_consensus.cc:1261] T 2963f09accd44e3db75d2f2c9b38b6cd P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 44. Preceding OpId from leader: term: 1 index: 45. (index mismatch)
I20240502 01:58:18.716732 13473 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 42. Preceding OpId from leader: term: 1 index: 43. (index mismatch)
I20240502 01:58:18.717108 14608 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 41, Time since last communication: 0.000s
I20240502 01:58:18.717362 14608 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 41, Time since last communication: 0.000s
I20240502 01:58:18.720189 13067 raft_consensus.cc:1261] T 2963f09accd44e3db75d2f2c9b38b6cd P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 43. Preceding OpId from leader: term: 1 index: 45. (index mismatch)
I20240502 01:58:18.721407 14122 consensus_queue.cc:1035] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 43, Time since last communication: 0.000s
I20240502 01:58:18.729455 14243 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 LEADER]: Committing config change with OpId 1.43: config changed from index 31 to 43, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.733973 12659 catalog_manager.cc:5484] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e reported cstate change: config changed from index 31 to 43, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "42bc78875b454c7ab7fce86d56a28c1e" committed_config { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:18.734241 14367 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.43: config changed from index 31 to 43, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.736828 14497 raft_consensus.cc:2932] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.45: config changed from index 43 to 45, VOTER 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196) evicted. New config: { opid_index: 45 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.738633 12802 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Committing config change with OpId 1.43: config changed from index 31 to 43, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.741930 13207 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.43: config changed from index 31 to 43, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.742172 12648 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 2963f09accd44e3db75d2f2c9b38b6cd with cas_config_opid_index 43: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:18.745844 12659 catalog_manager.cc:5484] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: config changed from index 43 to 45, VOTER 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 45 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:18.748026 14367 raft_consensus.cc:2932] T 2963f09accd44e3db75d2f2c9b38b6cd P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.45: config changed from index 43 to 45, VOTER 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196) evicted. New config: { opid_index: 45 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.755306 14590 consensus_queue.cc:1035] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 43, Time since last communication: 0.000s
I20240502 01:58:18.757691 14590 consensus_queue.cc:1035] T 2963f09accd44e3db75d2f2c9b38b6cd P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 43, Time since last communication: 0.000s
I20240502 01:58:18.757910 12802 consensus_queue.cc:237] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 48, Committed index: 48, Last appended: 1.49, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 50 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } }
I20240502 01:58:18.759761 12935 raft_consensus.cc:2932] T 2963f09accd44e3db75d2f2c9b38b6cd P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.45: config changed from index 43 to 45, VOTER 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196) evicted. New config: { opid_index: 45 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
W20240502 01:58:18.761847 13143 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.133.198:39759, user_credentials={real_user=slave}} blocked reactor thread for 44549.8us
I20240502 01:58:18.762850 14367 raft_consensus.cc:1261] T 5175c37ef65f4f2fb83d64497592a180 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 49. Preceding OpId from leader: term: 1 index: 50. (index mismatch)
I20240502 01:58:18.766745 13068 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.43: config changed from index 31 to 43, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.767707 13208 raft_consensus.cc:1261] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 49. Preceding OpId from leader: term: 1 index: 50. (index mismatch)
I20240502 01:58:18.767788 13185 tablet_service.cc:1514] Processing DeleteTablet for tablet 2963f09accd44e3db75d2f2c9b38b6cd with delete_type TABLET_DATA_TOMBSTONED (TS 3d7bf587aa5a49eb92c3a53d17717149 not found in new config with opid_index 45) from {username='slave'} at 127.0.0.1:39126
I20240502 01:58:18.771659 12935 consensus_queue.cc:237] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 1.45, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 46 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } }
I20240502 01:58:18.773324 14367 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 45. Preceding OpId from leader: term: 1 index: 46. (index mismatch)
I20240502 01:58:18.773386 13207 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 45. Preceding OpId from leader: term: 1 index: 46. (index mismatch)
I20240502 01:58:18.773804 14608 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 44, Time since last communication: 0.000s
I20240502 01:58:18.774361 14608 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 44, Time since last communication: 0.000s
I20240502 01:58:18.775691 13068 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 45. Preceding OpId from leader: term: 1 index: 46. (index mismatch)
I20240502 01:58:18.776232 14808 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 44, Time since last communication: 0.000s
I20240502 01:58:18.776490 14196 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 LEADER]: Committing config change with OpId 1.46: config changed from index 43 to 46, VOTER 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198) evicted. New config: { opid_index: 46 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.777707 14522 consensus_queue.cc:1035] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 50, Last known committed idx: 48, Time since last communication: 0.000s
I20240502 01:58:18.778924 12646 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 6eef7d25de5541bbbc7576185e097ed1 with cas_config_opid_index 43: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:18.777408 13068 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.46: config changed from index 43 to 46, VOTER 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198) evicted. New config: { opid_index: 46 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.779311 14522 consensus_queue.cc:1035] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 50, Last known committed idx: 48, Time since last communication: 0.000s
I20240502 01:58:18.779536 12935 raft_consensus.cc:1203] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e [term 1 LEARNER]: Deduplicated request from leader. Original: 1.41->[1.42-1.53] Dedup: 1.46->[1.47-1.53]
I20240502 01:58:18.780066 13469 raft_consensus.cc:1261] T 5175c37ef65f4f2fb83d64497592a180 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 48. Preceding OpId from leader: term: 1 index: 50. (index mismatch)
I20240502 01:58:18.780589 14367 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.46: config changed from index 43 to 46, VOTER 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198) evicted. New config: { opid_index: 46 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.780858 12659 catalog_manager.cc:5484] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e reported cstate change: config changed from index 43 to 46, VOTER 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198) evicted. New cstate: current_term: 1 leader_uuid: "42bc78875b454c7ab7fce86d56a28c1e" committed_config { opid_index: 46 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:18.781801 13203 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.46: config changed from index 43 to 46, VOTER 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198) evicted. New config: { opid_index: 46 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.783351 12804 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 45. Preceding OpId from leader: term: 1 index: 46. (index mismatch)
I20240502 01:58:18.787196 13336 raft_consensus.cc:2932] T 5175c37ef65f4f2fb83d64497592a180 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.47: config changed from index 37 to 47, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 47 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.792479 14809 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 44, Time since last communication: 0.000s
I20240502 01:58:18.794873 13336 raft_consensus.cc:2932] T 2963f09accd44e3db75d2f2c9b38b6cd P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.45: config changed from index 43 to 45, VOTER 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196) evicted. New config: { opid_index: 45 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.795004 14497 raft_consensus.cc:2932] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.50: config changed from index 47 to 50, VOTER 71010353c29d4e988704295c8cd73ef7 (127.10.133.195) evicted. New config: { opid_index: 50 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.797699 12648 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 5175c37ef65f4f2fb83d64497592a180 with cas_config_opid_index 47: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:18.798743 14497 consensus_queue.cc:1035] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 50, Last known committed idx: 48, Time since last communication: 0.000s
I20240502 01:58:18.798950 13452 tablet_service.cc:1514] Processing DeleteTablet for tablet 6eef7d25de5541bbbc7576185e097ed1 with delete_type TABLET_DATA_TOMBSTONED (TS 1928367ae8d64ba49a7f5761b2d3dc4a not found in new config with opid_index 46) from {username='slave'} at 127.0.0.1:44176
I20240502 01:58:18.800884 13336 raft_consensus.cc:1261] T 5175c37ef65f4f2fb83d64497592a180 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 49. Preceding OpId from leader: term: 1 index: 50. (index mismatch)
I20240502 01:58:18.801936 14367 raft_consensus.cc:2932] T 5175c37ef65f4f2fb83d64497592a180 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.50: config changed from index 47 to 50, VOTER 71010353c29d4e988704295c8cd73ef7 (127.10.133.195) evicted. New config: { opid_index: 50 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.802487 13207 raft_consensus.cc:2932] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.50: config changed from index 47 to 50, VOTER 71010353c29d4e988704295c8cd73ef7 (127.10.133.195) evicted. New config: { opid_index: 50 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.805874 12659 catalog_manager.cc:5484] T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149 reported cstate change: config changed from index 47 to 50, VOTER 71010353c29d4e988704295c8cd73ef7 (127.10.133.195) evicted. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 50 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.811599 14814 tablet_replica.cc:330] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a: stopping tablet replica
I20240502 01:58:18.812340 14814 raft_consensus.cc:2229] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:18.812690 14814 pending_rounds.cc:62] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a: Trying to abort 2 pending ops.
I20240502 01:58:18.812814 14814 pending_rounds.cc:68] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a: Aborting op as it isn't in flight: id { term: 1 index: 43 } timestamp: 7023063444184096768 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "6eef7d25de5541bbbc7576185e097ed1" old_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } } new_config { opid_index: 43 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } } }
I20240502 01:58:18.813442 14814 raft_consensus.cc:2894] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Aborting config change with OpId 1.43: Aborted: Op aborted
I20240502 01:58:18.813576 14814 raft_consensus.cc:2866] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20240502 01:58:18.813664 14814 pending_rounds.cc:68] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a: Aborting op as it isn't in flight: id { term: 1 index: 42 } timestamp: 7023063444167671808 op_type: WRITE_OP write_request { tablet_id: "6eef7d25de5541bbbc7576185e097ed1" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\217\026>B\277C\320A\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""5f5d9de376516456" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7023063443772035072 authz_token { token_data: "\010\342\350\313\261\006\"3\n\005slave\022*\n 8471dbb0ba2d474da8ff5cbfa12790d9\020\001\030\001 \001(\001" signature: "<redacted>""\315\373~{\230j\230K{mXy\345\271\206E\337\r\236?%\264\336\nK\\K\025\177\030\331nA\231g\262\204\037<\317`;\030d1\345C+\334\342w\177\372\371\241S\275\220\366\\x\341!Q" signing_key_seq_num: 0 } } request_id { client_id: "1703709eae4947e4b75bd9a12c30a6a0" seq_no: 118 first_incomplete_seq_no: 118 attempt_no: 0 }
I20240502 01:58:18.814415 14814 raft_consensus.cc:2258] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:18.817716 13469 raft_consensus.cc:2932] T 5175c37ef65f4f2fb83d64497592a180 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.50: config changed from index 47 to 50, VOTER 71010353c29d4e988704295c8cd73ef7 (127.10.133.195) evicted. New config: { opid_index: 50 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.809804 13051 tablet_service.cc:1514] Processing DeleteTablet for tablet 5175c37ef65f4f2fb83d64497592a180 with delete_type TABLET_DATA_TOMBSTONED (TS 71010353c29d4e988704295c8cd73ef7 not found in new config with opid_index 50) from {username='slave'} at 127.0.0.1:57476
I20240502 01:58:18.821127 13072 raft_consensus.cc:2932] T 2963f09accd44e3db75d2f2c9b38b6cd P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.45: config changed from index 43 to 45, VOTER 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196) evicted. New config: { opid_index: 45 OBSOLETE_local: false peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.837903 12804 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Committing config change with OpId 1.46: config changed from index 43 to 46, VOTER 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198) evicted. New config: { opid_index: 46 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.841029 14814 ts_tablet_manager.cc:1875] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:18.844126 14814 ts_tablet_manager.cc:1888] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.43
I20240502 01:58:18.844367 14814 log.cc:1196] T 6eef7d25de5541bbbc7576185e097ed1 P 1928367ae8d64ba49a7f5761b2d3dc4a: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal/wals/6eef7d25de5541bbbc7576185e097ed1
I20240502 01:58:18.852921 12649 catalog_manager.cc:4830] TS 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759): tablet 6eef7d25de5541bbbc7576185e097ed1 (table rebalance_test_table_4 [id=8471dbb0ba2d474da8ff5cbfa12790d9]) successfully deleted
I20240502 01:58:18.855587 14590 consensus_queue.cc:1035] T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 50, Last known committed idx: 48, Time since last communication: 0.000s
I20240502 01:58:18.871923 14816 tablet_replica.cc:330] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7: stopping tablet replica
I20240502 01:58:18.872263 14816 raft_consensus.cc:2229] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:18.876217 14227 raft_consensus.cc:1050] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88: attempting to promote NON_VOTER 42bc78875b454c7ab7fce86d56a28c1e to VOTER
I20240502 01:58:18.876655 14227 consensus_queue.cc:237] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 1.53, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 54 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } }
I20240502 01:58:18.878706 12935 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e [term 1 LEARNER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 53. Preceding OpId from leader: term: 1 index: 54. (index mismatch)
I20240502 01:58:18.879148 14522 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20240502 01:58:18.887158 13207 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 53. Preceding OpId from leader: term: 1 index: 54. (index mismatch)
I20240502 01:58:18.892783 14816 pending_rounds.cc:62] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7: Trying to abort 1 pending ops.
I20240502 01:58:18.894260 14522 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20240502 01:58:18.895658 13470 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 53. Preceding OpId from leader: term: 1 index: 54. (index mismatch)
I20240502 01:58:18.893819 14816 pending_rounds.cc:68] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7: Aborting op as it isn't in flight: id { term: 1 index: 49 } timestamp: 7023063444416299008 op_type: WRITE_OP write_request { tablet_id: "5175c37ef65f4f2fb83d64497592a180" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000<\362=Q\275Y\n\315\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""5e99c47602625d58" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7023063444294197248 authz_token { token_data: "\010\342\350\313\261\006\"3\n\005slave\022*\n 87bf6032f2ab4ef8a4f1c2692004f94c\020\001\030\001 \001(\001" signature: "<redacted>""\027\031\200j\007n\233>\3422\332\253m\251\201\237\343ji?\340\245T\203\023)\013L\313_V\006\310+\304:\000\314\263c\202\022\363{\200E\266Z\320\311}\222\372\020\251\203V> UI(:\244" signing_key_seq_num: 0 } } request_id { client_id: "2dfee9ac99a543b0a2c7779866b58d07" seq_no: 122 first_incomplete_seq_no: 122 attempt_no: 0 }
I20240502 01:58:18.898689 14367 raft_consensus.cc:1203] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.43->[1.44-1.70] Dedup: 1.56->[1.57-1.70]
I20240502 01:58:18.900434 13072 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 53. Preceding OpId from leader: term: 1 index: 54. (index mismatch)
I20240502 01:58:18.895992 14816 raft_consensus.cc:2258] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:18.919881 14816 ts_tablet_manager.cc:1875] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:18.922618 14812 tablet_replica.cc:330] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149: stopping tablet replica
I20240502 01:58:18.923014 14812 raft_consensus.cc:2229] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:18.923347 14812 pending_rounds.cc:62] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149: Trying to abort 1 pending ops.
I20240502 01:58:18.923472 14812 pending_rounds.cc:68] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149: Aborting op as it isn't in flight: id { term: 1 index: 44 } timestamp: 7023063444176240640 op_type: WRITE_OP write_request { tablet_id: "2963f09accd44e3db75d2f2c9b38b6cd" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\371#\223d8\000\0144\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""3680c0637dad7f12" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7023063444143370240 authz_token { token_data: "\010\342\350\313\261\006\"3\n\005slave\022*\n e192d1fc91574f419257f076074a1378\020\001\030\001 \001(\001" signature: "<redacted>""\225%\332I\3137\3210\206\250c\013eIf\350\341\271\265\3556\336\377\272B\220I\201\020\250q\202Ixf%/y4\323\360\251\356\233\014J^\004\311\022$&\231\206\227Eh4\033\235\241\241dC" signing_key_seq_num: 0 } } request_id { client_id: "111d9a614a1e44ee966596300324a1a5" seq_no: 132 first_incomplete_seq_no: 132 attempt_no: 0 }
I20240502 01:58:18.924018 14812 raft_consensus.cc:2258] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:18.923974 14122 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20240502 01:58:18.924676 14122 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20240502 01:58:18.932118 13339 raft_consensus.cc:2932] T 5175c37ef65f4f2fb83d64497592a180 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.50: config changed from index 47 to 50, VOTER 71010353c29d4e988704295c8cd73ef7 (127.10.133.195) evicted. New config: { opid_index: 50 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:18.935725 14122 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.54: config changed from index 42 to 54, 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) changed from NON_VOTER to VOTER. New config: { opid_index: 54 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } }
I20240502 01:58:18.937932 12937 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.54: config changed from index 42 to 54, 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) changed from NON_VOTER to VOTER. New config: { opid_index: 54 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } }
I20240502 01:58:18.941803 13339 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 53. Preceding OpId from leader: term: 1 index: 54. (index mismatch)
I20240502 01:58:18.946437 12659 catalog_manager.cc:5484] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e reported cstate change: config changed from index 42 to 54, 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 54 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } }
I20240502 01:58:18.949239 13205 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.54: config changed from index 42 to 54, 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) changed from NON_VOTER to VOTER. New config: { opid_index: 54 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } }
I20240502 01:58:18.953447 14816 ts_tablet_manager.cc:1888] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.49
I20240502 01:58:18.953548 14816 log.cc:1196] T 5175c37ef65f4f2fb83d64497592a180 P 71010353c29d4e988704295c8cd73ef7: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/wals/5175c37ef65f4f2fb83d64497592a180
I20240502 01:58:18.957751 12649 catalog_manager.cc:4830] TS 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887): tablet 5175c37ef65f4f2fb83d64497592a180 (table rebalance_test_table_0 [id=87bf6032f2ab4ef8a4f1c2692004f94c]) successfully deleted
I20240502 01:58:18.971154 14812 ts_tablet_manager.cc:1875] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:18.975837 12804 consensus_queue.cc:237] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 54, Committed index: 54, Last appended: 1.55, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 56 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } }
I20240502 01:58:18.976449 13067 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.54: config changed from index 42 to 54, 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) changed from NON_VOTER to VOTER. New config: { opid_index: 54 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } }
I20240502 01:58:18.978582 12937 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 55. Preceding OpId from leader: term: 1 index: 56. (index mismatch)
I20240502 01:58:18.979013 14590 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 54, Time since last communication: 0.000s
I20240502 01:58:18.982643 13469 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.54: config changed from index 42 to 54, 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) changed from NON_VOTER to VOTER. New config: { opid_index: 54 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } }
I20240502 01:58:18.983457 13207 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 55. Preceding OpId from leader: term: 1 index: 56. (index mismatch)
I20240502 01:58:18.989655 14812 ts_tablet_manager.cc:1888] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.44
I20240502 01:58:18.990130 14590 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 54, Time since last communication: 0.000s
I20240502 01:58:18.998150 14812 log.cc:1196] T 2963f09accd44e3db75d2f2c9b38b6cd P 3d7bf587aa5a49eb92c3a53d17717149: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/2963f09accd44e3db75d2f2c9b38b6cd
I20240502 01:58:18.999750 12648 catalog_manager.cc:4830] TS 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825): tablet 2963f09accd44e3db75d2f2c9b38b6cd (table rebalance_test_table_3 [id=e192d1fc91574f419257f076074a1378]) successfully deleted
I20240502 01:58:18.999975 14121 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.56: config changed from index 54 to 56, VOTER 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197) evicted. New config: { opid_index: 56 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } }
I20240502 01:58:19.003917 12659 catalog_manager.cc:5484] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: config changed from index 54 to 56, VOTER 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197) evicted. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 56 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:19.005622 13473 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 55. Preceding OpId from leader: term: 1 index: 56. (index mismatch)
I20240502 01:58:19.005923 12648 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 281ea2fa1f9f49cebd4bb3620335168a with cas_config_opid_index 54: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:19.006567 13205 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.56: config changed from index 54 to 56, VOTER 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197) evicted. New config: { opid_index: 56 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } }
I20240502 01:58:19.006896 13067 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 54. Preceding OpId from leader: term: 1 index: 56. (index mismatch)
I20240502 01:58:19.009253 12937 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.56: config changed from index 54 to 56, VOTER 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197) evicted. New config: { opid_index: 56 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } }
I20240502 01:58:19.010383 14652 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 54, Time since last communication: 0.000s
I20240502 01:58:19.029337 13321 tablet_service.cc:1514] Processing DeleteTablet for tablet 281ea2fa1f9f49cebd4bb3620335168a with delete_type TABLET_DATA_TOMBSTONED (TS 6b1e63d6b84a440a8864db2d36b57665 not found in new config with opid_index 56) from {username='slave'} at 127.0.0.1:48890
I20240502 01:58:19.029882 14823 tablet_replica.cc:330] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665: stopping tablet replica
I20240502 01:58:19.030267 14823 raft_consensus.cc:2229] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:19.030732 14823 raft_consensus.cc:2258] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:19.032356 14823 ts_tablet_manager.cc:1875] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:19.034942 14823 ts_tablet_manager.cc:1888] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.53
I20240502 01:58:19.035086 14823 log.cc:1196] T 281ea2fa1f9f49cebd4bb3620335168a P 6b1e63d6b84a440a8864db2d36b57665: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal/wals/281ea2fa1f9f49cebd4bb3620335168a
I20240502 01:58:19.040177 12649 catalog_manager.cc:4830] TS 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283): tablet 281ea2fa1f9f49cebd4bb3620335168a (table rebalance_test_table_3 [id=e192d1fc91574f419257f076074a1378]) successfully deleted
I20240502 01:58:19.044632 14522 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 54, Time since last communication: 0.000s
I20240502 01:58:19.046905 13467 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.56: config changed from index 54 to 56, VOTER 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197) evicted. New config: { opid_index: 56 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } }
I20240502 01:58:19.102850 13067 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.56: config changed from index 54 to 56, VOTER 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197) evicted. New config: { opid_index: 56 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } }
I20240502 01:58:19.151674 14199 raft_consensus.cc:1050] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a: attempting to promote NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 to VOTER
I20240502 01:58:19.157933 14199 consensus_queue.cc:237] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 70, Committed index: 70, Last appended: 1.71, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 72 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } }
I20240502 01:58:19.159446 12934 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 70. Preceding OpId from leader: term: 1 index: 72. (index mismatch)
I20240502 01:58:19.159912 13069 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 70. Preceding OpId from leader: term: 1 index: 72. (index mismatch)
I20240502 01:58:19.160012 14732 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 72, Last known committed idx: 70, Time since last communication: 0.000s
I20240502 01:58:19.160745 14732 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 72, Last known committed idx: 70, Time since last communication: 0.000s
I20240502 01:58:19.161968 13337 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 71. Preceding OpId from leader: term: 1 index: 72. (index mismatch)
I20240502 01:58:19.162603 14515 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 72, Last known committed idx: 70, Time since last communication: 0.000s
I20240502 01:58:19.163057 14368 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 71. Preceding OpId from leader: term: 1 index: 72. (index mismatch)
I20240502 01:58:19.164271 14515 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 72, Last known committed idx: 70, Time since last communication: 0.000s
I20240502 01:58:19.165377 14732 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 LEADER]: Committing config change with OpId 1.72: config changed from index 44 to 72, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 72 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:19.165897 12937 raft_consensus.cc:1203] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.70->[1.71-1.71] Dedup: 1.71->[]
I20240502 01:58:19.167848 13069 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.72: config changed from index 44 to 72, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 72 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:19.167848 13337 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.72: config changed from index 44 to 72, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 72 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:19.168090 12937 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.72: config changed from index 44 to 72, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 72 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:19.170958 12660 catalog_manager.cc:5484] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 reported cstate change: config changed from index 44 to 72, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" committed_config { opid_index: 72 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:19.171664 14368 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.72: config changed from index 44 to 72, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 72 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:19.186430 13067 raft_consensus.cc:1203] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.70->[1.71-1.71] Dedup: 1.71->[]
I20240502 01:58:19.187531 13473 consensus_queue.cc:237] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 72, Committed index: 72, Last appended: 1.72, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 73 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } }
I20240502 01:58:19.190542 14367 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 72. Preceding OpId from leader: term: 1 index: 73. (index mismatch)
I20240502 01:58:19.190989 14732 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20240502 01:58:19.191269 13336 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 72. Preceding OpId from leader: term: 1 index: 73. (index mismatch)
I20240502 01:58:19.191375 12935 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 72. Preceding OpId from leader: term: 1 index: 73. (index mismatch)
I20240502 01:58:19.192407 14199 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20240502 01:58:19.192533 14732 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20240502 01:58:19.194964 14732 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 LEADER]: Committing config change with OpId 1.73: config changed from index 72 to 73, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 73 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:19.199324 14367 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.73: config changed from index 72 to 73, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 73 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:19.201558 12649 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet bc637bf633fc4fe58db54a6bc0821417 with cas_config_opid_index 72: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:19.202644 12660 catalog_manager.cc:5484] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867 reported cstate change: config changed from index 72 to 73, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" committed_config { opid_index: 73 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:19.204018 13069 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 72. Preceding OpId from leader: term: 1 index: 73. (index mismatch)
I20240502 01:58:19.204542 14199 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 73, Last known committed idx: 70, Time since last communication: 0.000s
I20240502 01:58:19.205694 12937 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.73: config changed from index 72 to 73, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 73 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:19.206413 13068 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.73: config changed from index 72 to 73, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 73 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:19.212239 13336 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.73: config changed from index 72 to 73, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 73 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:19.214267 12784 tablet_service.cc:1514] Processing DeleteTablet for tablet bc637bf633fc4fe58db54a6bc0821417 with delete_type TABLET_DATA_TOMBSTONED (TS 27e2acacdad14caa8f66bc81fa8a2f88 not found in new config with opid_index 73) from {username='slave'} at 127.0.0.1:51568
I20240502 01:58:19.219647 12802 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 71. Preceding OpId from leader: term: 1 index: 72. (index mismatch)
I20240502 01:58:19.223788 14839 tablet_replica.cc:330] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88: stopping tablet replica
I20240502 01:58:19.224069 14839 raft_consensus.cc:2229] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:19.224637 14839 pending_rounds.cc:62] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88: Trying to abort 1 pending ops.
I20240502 01:58:19.224727 14839 pending_rounds.cc:68] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88: Aborting op as it isn't in flight: id { term: 1 index: 71 } timestamp: 7023063446078509056 op_type: WRITE_OP write_request { tablet_id: "bc637bf633fc4fe58db54a6bc0821417" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\263\316\225g\201<\036|\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""b32ad95a8447bd90" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7023063446004826112 authz_token { token_data: "\010\342\350\313\261\006\"3\n\005slave\022*\n 41727fe31ec64883ac850e582b40cb0b\020\001\030\001 \001(\001" signature: "<redacted>""\326t\203\371\"\017N\263!\211\221,\256w\354:\336\207Y\360SV\256H\337\240\376\346Y\003\332\314\262\223\010\357G\033\n\227p\320\030\341\234e\271a\201*\344+\355\n \242T\344S\304\000\nn\331" signing_key_seq_num: 0 } } request_id { client_id: "d94af5f5e746499994c8fbacc933bb3f" seq_no: 224 first_incomplete_seq_no: 224 attempt_no: 0 }
I20240502 01:58:19.227371 14839 raft_consensus.cc:2258] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:19.228222 14839 ts_tablet_manager.cc:1875] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:19.233422 14839 ts_tablet_manager.cc:1888] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.71
I20240502 01:58:19.233544 14839 log.cc:1196] T bc637bf633fc4fe58db54a6bc0821417 P 27e2acacdad14caa8f66bc81fa8a2f88: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/bc637bf633fc4fe58db54a6bc0821417
I20240502 01:58:19.234156 12648 catalog_manager.cc:4830] TS 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263): tablet bc637bf633fc4fe58db54a6bc0821417 (table rebalance_test_table_2 [id=41727fe31ec64883ac850e582b40cb0b]) successfully deleted
W20240502 01:58:19.272212 12740 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.133.199:34821, user_credentials={real_user=slave}} blocked reactor thread for 59093.8us
I20240502 01:58:19.404309 13205 consensus_queue.cc:237] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 1.87, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 88 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:19.406544 12937 raft_consensus.cc:1261] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 87. Preceding OpId from leader: term: 1 index: 88. (index mismatch)
I20240502 01:58:19.407016 14498 consensus_queue.cc:1035] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20240502 01:58:19.407879 13339 raft_consensus.cc:1261] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 87. Preceding OpId from leader: term: 1 index: 88. (index mismatch)
I20240502 01:58:19.408197 13469 raft_consensus.cc:1261] T 6b4405ed71824af7bde2e54f5f592d10 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 87. Preceding OpId from leader: term: 1 index: 88. (index mismatch)
I20240502 01:58:19.408509 13072 raft_consensus.cc:1261] T 6b4405ed71824af7bde2e54f5f592d10 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 87. Preceding OpId from leader: term: 1 index: 88. (index mismatch)
I20240502 01:58:19.410131 14790 consensus_queue.cc:1035] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20240502 01:58:19.415289 14498 consensus_queue.cc:1035] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20240502 01:58:19.417158 14604 consensus_queue.cc:1035] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
W20240502 01:58:19.423303 13142 consensus_peers.cc:485] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 -> Peer 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199:34821): Couldn't send request to peer 1ef9768a03e545fba961cfeee4c1c867. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b4405ed71824af7bde2e54f5f592d10. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:19.431627 14790 raft_consensus.cc:2932] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 LEADER]: Committing config change with OpId 1.88: config changed from index -1 to 88, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 88 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:19.442523 12937 raft_consensus.cc:2932] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.88: config changed from index -1 to 88, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 88 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:19.444228 12659 catalog_manager.cc:5484] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 reported cstate change: config changed from index -1 to 88, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New cstate: current_term: 1 leader_uuid: "3d7bf587aa5a49eb92c3a53d17717149" committed_config { opid_index: 88 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:19.446714 13339 raft_consensus.cc:2932] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.88: config changed from index -1 to 88, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 88 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:19.453215 13072 raft_consensus.cc:2932] T 6b4405ed71824af7bde2e54f5f592d10 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.88: config changed from index -1 to 88, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 88 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:19.464697 13473 raft_consensus.cc:2932] T 6b4405ed71824af7bde2e54f5f592d10 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.88: config changed from index -1 to 88, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 88 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:19.578377 13207 consensus_queue.cc:237] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 104, Committed index: 104, Last appended: 1.104, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
W20240502 01:58:19.582834 13142 consensus_peers.cc:485] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 -> Peer 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199:34821): Couldn't send request to peer 1ef9768a03e545fba961cfeee4c1c867. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eeb77a056e494d5ab85138d8ecc52db9. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:19.586647 12938 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 104. Preceding OpId from leader: term: 1 index: 105. (index mismatch)
I20240502 01:58:19.590009 14790 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 104, Time since last communication: 0.000s
I20240502 01:58:19.599979 13069 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 104. Preceding OpId from leader: term: 1 index: 105. (index mismatch)
I20240502 01:58:19.600632 14604 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 104, Time since last communication: 0.000s
I20240502 01:58:19.603065 13467 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 104. Preceding OpId from leader: term: 1 index: 105. (index mismatch)
I20240502 01:58:19.612558 13336 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 104. Preceding OpId from leader: term: 1 index: 105. (index mismatch)
I20240502 01:58:19.629370 14790 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 104, Time since last communication: 0.000s
I20240502 01:58:19.635821 14478 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 104, Time since last communication: 0.000s
I20240502 01:58:19.640592 14790 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 LEADER]: Committing config change with OpId 1.105: config changed from index -1 to 105, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:19.643030 12934 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.105: config changed from index -1 to 105, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:19.645195 12655 catalog_manager.cc:5484] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 reported cstate change: config changed from index -1 to 105, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New cstate: current_term: 1 leader_uuid: "3d7bf587aa5a49eb92c3a53d17717149" committed_config { opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:19.649891 13069 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.105: config changed from index -1 to 105, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:19.650192 13473 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.105: config changed from index -1 to 105, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:19.661288 13336 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.105: config changed from index -1 to 105, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:19.988567 14899 ts_tablet_manager.cc:902] T 6b4405ed71824af7bde2e54f5f592d10 P 1ef9768a03e545fba961cfeee4c1c867: Initiating tablet copy from peer 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825)
I20240502 01:58:19.989110 14899 tablet_copy_client.cc:308] T 6b4405ed71824af7bde2e54f5f592d10 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.196:32825
I20240502 01:58:20.144146 14912 ts_tablet_manager.cc:902] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867: Initiating tablet copy from peer 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825)
I20240502 01:58:20.147320 13229 tablet_copy_service.cc:140] P 3d7bf587aa5a49eb92c3a53d17717149: Received BeginTabletCopySession request for tablet 6b4405ed71824af7bde2e54f5f592d10 from peer 1ef9768a03e545fba961cfeee4c1c867 ({username='slave'} at 127.10.133.199:59449)
I20240502 01:58:20.147461 13229 tablet_copy_service.cc:161] P 3d7bf587aa5a49eb92c3a53d17717149: Beginning new tablet copy session on tablet 6b4405ed71824af7bde2e54f5f592d10 from peer 1ef9768a03e545fba961cfeee4c1c867 at {username='slave'} at 127.10.133.199:59449: session id = 1ef9768a03e545fba961cfeee4c1c867-6b4405ed71824af7bde2e54f5f592d10
I20240502 01:58:20.149015 13229 tablet_copy_source_session.cc:205] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:20.150965 14899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b4405ed71824af7bde2e54f5f592d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:20.153538 14899 tablet_copy_client.cc:783] T 6b4405ed71824af7bde2e54f5f592d10 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:20.153692 14899 tablet_copy_client.cc:647] T 6b4405ed71824af7bde2e54f5f592d10 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:20.156057 14899 tablet_copy_client.cc:523] T 6b4405ed71824af7bde2e54f5f592d10 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:20.158762 12805 consensus_queue.cc:237] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 112, Committed index: 112, Last appended: 1.112, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 113 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:20.168368 14912 tablet_copy_client.cc:308] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.196:32825
I20240502 01:58:20.170246 13207 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 112. Preceding OpId from leader: term: 1 index: 113. (index mismatch)
W20240502 01:58:20.170732 12740 consensus_peers.cc:485] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 -> Peer 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199:34821): Couldn't send request to peer 1ef9768a03e545fba961cfeee4c1c867. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a8e8a2483ab8452f9b798930ebc069ac. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:20.170761 13229 tablet_copy_service.cc:140] P 3d7bf587aa5a49eb92c3a53d17717149: Received BeginTabletCopySession request for tablet eeb77a056e494d5ab85138d8ecc52db9 from peer 1ef9768a03e545fba961cfeee4c1c867 ({username='slave'} at 127.10.133.199:59449)
I20240502 01:58:20.170850 13229 tablet_copy_service.cc:161] P 3d7bf587aa5a49eb92c3a53d17717149: Beginning new tablet copy session on tablet eeb77a056e494d5ab85138d8ecc52db9 from peer 1ef9768a03e545fba961cfeee4c1c867 at {username='slave'} at 127.10.133.199:59449: session id = 1ef9768a03e545fba961cfeee4c1c867-eeb77a056e494d5ab85138d8ecc52db9
I20240502 01:58:20.170884 14652 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20240502 01:58:20.171907 13229 tablet_copy_source_session.cc:205] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:20.181740 12938 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 112. Preceding OpId from leader: term: 1 index: 113. (index mismatch)
I20240502 01:58:20.183283 14860 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20240502 01:58:20.186710 14899 tablet_bootstrap.cc:492] T 6b4405ed71824af7bde2e54f5f592d10 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap starting.
I20240502 01:58:20.191082 13336 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 112. Preceding OpId from leader: term: 1 index: 113. (index mismatch)
I20240502 01:58:20.192826 14912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeb77a056e494d5ab85138d8ecc52db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:20.195950 14912 tablet_copy_client.cc:783] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:20.196264 14912 tablet_copy_client.cc:647] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:20.199940 13468 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 112. Preceding OpId from leader: term: 1 index: 113. (index mismatch)
I20240502 01:58:20.200917 14227 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.113: config changed from index -1 to 113, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 113 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:20.201923 12937 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.113: config changed from index -1 to 113, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 113 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:20.216636 14860 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20240502 01:58:20.221586 14912 tablet_copy_client.cc:523] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:20.239920 14523 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20240502 01:58:20.248988 13468 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.113: config changed from index -1 to 113, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 113 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:20.258661 13335 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.113: config changed from index -1 to 113, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 113 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:20.293860 14912 tablet_bootstrap.cc:492] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap starting.
I20240502 01:58:20.294859 13204 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.113: config changed from index -1 to 113, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 113 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:20.301802 12660 catalog_manager.cc:5484] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: config changed from index -1 to 113, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 113 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20240502 01:58:20.506819 12741 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.133.198:39759, user_credentials={real_user=slave}} blocked reactor thread for 58767.6us
I20240502 01:58:20.558300 13339 consensus_queue.cc:237] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 74, Committed index: 74, Last appended: 1.74, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 75 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:20.561950 13207 raft_consensus.cc:1261] T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 74. Preceding OpId from leader: term: 1 index: 75. (index mismatch)
I20240502 01:58:20.562579 12938 raft_consensus.cc:1261] T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 74. Preceding OpId from leader: term: 1 index: 75. (index mismatch)
I20240502 01:58:20.562557 14837 consensus_queue.cc:1035] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 75, Last known committed idx: 74, Time since last communication: 0.000s
I20240502 01:58:20.563910 14837 consensus_queue.cc:1035] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 75, Last known committed idx: 74, Time since last communication: 0.000s
I20240502 01:58:20.566061 14837 raft_consensus.cc:2932] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [term 1 LEADER]: Committing config change with OpId 1.75: config changed from index -1 to 75, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 75 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:20.568665 13207 raft_consensus.cc:2932] T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.75: config changed from index -1 to 75, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 75 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:20.579195 13071 raft_consensus.cc:1261] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 72. Preceding OpId from leader: term: 1 index: 75. (index mismatch)
W20240502 01:58:20.582077 13275 consensus_peers.cc:485] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 -> Peer 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199:34821): Couldn't send request to peer 1ef9768a03e545fba961cfeee4c1c867. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 24d91cbbc7cb4be7a0034613b96ac1cd. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:20.583796 14917 consensus_queue.cc:1035] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 75, Last known committed idx: 72, Time since last communication: 0.000s
I20240502 01:58:20.593081 13071 raft_consensus.cc:2932] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.75: config changed from index -1 to 75, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 75 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:20.598807 12938 raft_consensus.cc:2932] T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.75: config changed from index -1 to 75, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 75 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:20.603312 12656 catalog_manager.cc:5484] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 reported cstate change: config changed from index -1 to 75, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New cstate: current_term: 1 leader_uuid: "6b1e63d6b84a440a8864db2d36b57665" committed_config { opid_index: 75 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:20.666278 14899 tablet_bootstrap.cc:492] T 6b4405ed71824af7bde2e54f5f592d10 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap replayed 1/1 log segments. Stats: ops{read=104 overwritten=0 applied=103 ignored=0} inserts{seen=788 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20240502 01:58:20.666651 14899 tablet_bootstrap.cc:492] T 6b4405ed71824af7bde2e54f5f592d10 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap complete.
I20240502 01:58:20.666865 14899 ts_tablet_manager.cc:1367] T 6b4405ed71824af7bde2e54f5f592d10 P 1ef9768a03e545fba961cfeee4c1c867: Time spent bootstrapping tablet: real 0.480s user 0.109s sys 0.000s
I20240502 01:58:20.667420 14899 raft_consensus.cc:348] T 6b4405ed71824af7bde2e54f5f592d10 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 88 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:20.667771 14899 raft_consensus.cc:729] T 6b4405ed71824af7bde2e54f5f592d10 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1ef9768a03e545fba961cfeee4c1c867, State: Initialized, Role: LEARNER
I20240502 01:58:20.667888 14899 consensus_queue.cc:260] T 6b4405ed71824af7bde2e54f5f592d10 P 1ef9768a03e545fba961cfeee4c1c867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 103, Last appended: 1.104, Last appended by leader: 104, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 88 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:20.668228 14899 ts_tablet_manager.cc:1398] T 6b4405ed71824af7bde2e54f5f592d10 P 1ef9768a03e545fba961cfeee4c1c867: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 01:58:20.669952 13229 tablet_copy_service.cc:342] P 3d7bf587aa5a49eb92c3a53d17717149: Request end of tablet copy session 1ef9768a03e545fba961cfeee4c1c867-6b4405ed71824af7bde2e54f5f592d10 received from {username='slave'} at 127.10.133.199:59449
I20240502 01:58:20.670203 13229 tablet_copy_service.cc:433] P 3d7bf587aa5a49eb92c3a53d17717149: ending tablet copy session 1ef9768a03e545fba961cfeee4c1c867-6b4405ed71824af7bde2e54f5f592d10 on tablet 6b4405ed71824af7bde2e54f5f592d10 with peer 1ef9768a03e545fba961cfeee4c1c867
I20240502 01:58:20.673108 14899 ts_tablet_manager.cc:902] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867: Initiating tablet copy from peer 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263)
I20240502 01:58:20.673516 14899 tablet_copy_client.cc:308] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:46263
I20240502 01:58:20.673926 12825 tablet_copy_service.cc:140] P 27e2acacdad14caa8f66bc81fa8a2f88: Received BeginTabletCopySession request for tablet a8e8a2483ab8452f9b798930ebc069ac from peer 1ef9768a03e545fba961cfeee4c1c867 ({username='slave'} at 127.10.133.199:42263)
I20240502 01:58:20.674050 12825 tablet_copy_service.cc:161] P 27e2acacdad14caa8f66bc81fa8a2f88: Beginning new tablet copy session on tablet a8e8a2483ab8452f9b798930ebc069ac from peer 1ef9768a03e545fba961cfeee4c1c867 at {username='slave'} at 127.10.133.199:42263: session id = 1ef9768a03e545fba961cfeee4c1c867-a8e8a2483ab8452f9b798930ebc069ac
I20240502 01:58:20.675009 12825 tablet_copy_source_session.cc:205] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:20.678934 14899 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8e8a2483ab8452f9b798930ebc069ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:20.680876 14899 tablet_copy_client.cc:783] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:20.681012 14899 tablet_copy_client.cc:647] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:20.691709 14899 tablet_copy_client.cc:523] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:20.696132 12802 consensus_queue.cc:237] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 64, Committed index: 64, Last appended: 1.64, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:20.706302 13204 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 64. Preceding OpId from leader: term: 1 index: 65. (index mismatch)
I20240502 01:58:20.708290 14523 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20240502 01:58:20.710546 12935 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 64. Preceding OpId from leader: term: 1 index: 65. (index mismatch)
I20240502 01:58:20.711673 14859 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20240502 01:58:20.717554 13068 raft_consensus.cc:1203] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.72->[1.73-1.73] Dedup: 1.73->[]
W20240502 01:58:20.722546 12740 consensus_peers.cc:485] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 -> Peer 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199:34821): Couldn't send request to peer 1ef9768a03e545fba961cfeee4c1c867. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 773b692c40df457caf7baea5a7b21c27. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:20.730600 13471 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 64. Preceding OpId from leader: term: 1 index: 65. (index mismatch)
I20240502 01:58:20.730584 13335 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 64. Preceding OpId from leader: term: 1 index: 65. (index mismatch)
I20240502 01:58:20.730800 12802 raft_consensus.cc:1261] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 70. Preceding OpId from leader: term: 1 index: 75. (index mismatch)
I20240502 01:58:20.732494 14523 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 63, Time since last communication: 0.000s
I20240502 01:58:20.733095 14438 consensus_queue.cc:1035] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 75, Last known committed idx: 70, Time since last communication: 0.000s
I20240502 01:58:20.740432 14523 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 63, Time since last communication: 0.000s
W20240502 01:58:20.782553 14529 log.cc:924] Time spent T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88: Append to log took a long time: real 0.068s user 0.000s sys 0.000s
W20240502 01:58:20.782553 14511 log.cc:924] Time spent T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e: Append to log took a long time: real 0.068s user 0.000s sys 0.000s
W20240502 01:58:20.795957 14533 log.cc:924] Time spent T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149: Append to log took a long time: real 0.074s user 0.000s sys 0.000s
W20240502 01:58:20.796511 14813 log.cc:924] Time spent T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e: Append to log took a long time: real 0.082s user 0.000s sys 0.000s
I20240502 01:58:20.796643 14899 tablet_bootstrap.cc:492] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap starting.
W20240502 01:58:20.796906 14805 log.cc:924] Time spent T 5175c37ef65f4f2fb83d64497592a180 P 1ef9768a03e545fba961cfeee4c1c867: Append to log took a long time: real 0.073s user 0.000s sys 0.000s
W20240502 01:58:20.797438 14224 log.cc:924] Time spent T eb9d0001da2643ed8a9d78e79e30fccd P 6b1e63d6b84a440a8864db2d36b57665: Append to log took a long time: real 0.066s user 0.000s sys 0.000s
W20240502 01:58:20.797698 14435 log.cc:924] Time spent T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665: Append to log took a long time: real 0.072s user 0.000s sys 0.000s
W20240502 01:58:20.797938 14225 log.cc:924] Time spent T eb9d0001da2643ed8a9d78e79e30fccd P 71010353c29d4e988704295c8cd73ef7: Append to log took a long time: real 0.075s user 0.000s sys 0.000s
W20240502 01:58:20.798275 14235 log.cc:924] Time spent T eb9d0001da2643ed8a9d78e79e30fccd P 1928367ae8d64ba49a7f5761b2d3dc4a: Append to log took a long time: real 0.063s user 0.000s sys 0.000s
W20240502 01:58:20.798763 14466 log.cc:924] Time spent T 5175c37ef65f4f2fb83d64497592a180 P 6b1e63d6b84a440a8864db2d36b57665: Append to log took a long time: real 0.067s user 0.000s sys 0.000s
W20240502 01:58:20.799255 14482 log.cc:924] Time spent T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665: Append to log took a long time: real 0.084s user 0.000s sys 0.000s
W20240502 01:58:20.799460 14481 log.cc:924] Time spent T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7: Append to log took a long time: real 0.083s user 0.000s sys 0.000s
W20240502 01:58:20.799818 14139 log.cc:924] Time spent T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
W20240502 01:58:20.800052 14143 log.cc:924] Time spent T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7: Append to log took a long time: real 0.059s user 0.000s sys 0.000s
W20240502 01:58:20.801118 14530 log.cc:924] Time spent T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e: Append to log took a long time: real 0.083s user 0.000s sys 0.000s
W20240502 01:58:20.801184 14448 log.cc:924] Time spent T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e: Append to log took a long time: real 0.074s user 0.000s sys 0.000s
W20240502 01:58:20.801402 14445 log.cc:924] Time spent T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7: Append to log took a long time: real 0.074s user 0.000s sys 0.000s
W20240502 01:58:20.801498 14495 log.cc:924] Time spent T 400199df936243f2b49a4b556f29c575 P 71010353c29d4e988704295c8cd73ef7: Append to log took a long time: real 0.081s user 0.000s sys 0.000s
W20240502 01:58:20.802038 14488 log.cc:924] Time spent T 2963f09accd44e3db75d2f2c9b38b6cd P 71010353c29d4e988704295c8cd73ef7: Append to log took a long time: real 0.082s user 0.000s sys 0.000s
W20240502 01:58:20.802371 14234 log.cc:924] Time spent T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665: Append to log took a long time: real 0.059s user 0.000s sys 0.000s
W20240502 01:58:20.802654 14451 log.cc:924] Time spent T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7: Append to log took a long time: real 0.087s user 0.000s sys 0.000s
W20240502 01:58:20.803154 14260 log.cc:924] Time spent T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149: Append to log took a long time: real 0.083s user 0.000s sys 0.000s
W20240502 01:58:20.803382 14460 log.cc:924] Time spent T 5175c37ef65f4f2fb83d64497592a180 P 27e2acacdad14caa8f66bc81fa8a2f88: Append to log took a long time: real 0.080s user 0.000s sys 0.000s
W20240502 01:58:20.795971 14137 log.cc:924] Time spent T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149: Append to log took a long time: real 0.075s user 0.000s sys 0.000s
W20240502 01:58:20.800639 14483 log.cc:924] Time spent T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a: Append to log took a long time: real 0.084s user 0.000s sys 0.000s
W20240502 01:58:20.804291 14111 log.cc:924] Time spent T 2963f09accd44e3db75d2f2c9b38b6cd P 6b1e63d6b84a440a8864db2d36b57665: Append to log took a long time: real 0.066s user 0.000s sys 0.000s
W20240502 01:58:20.801020 14462 log.cc:924] Time spent T 5175c37ef65f4f2fb83d64497592a180 P 1928367ae8d64ba49a7f5761b2d3dc4a: Append to log took a long time: real 0.082s user 0.000s sys 0.000s
W20240502 01:58:20.796883 14443 log.cc:924] Time spent T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149: Append to log took a long time: real 0.070s user 0.000s sys 0.000s
W20240502 01:58:20.798579 14464 log.cc:924] Time spent T 5175c37ef65f4f2fb83d64497592a180 P 3d7bf587aa5a49eb92c3a53d17717149: Append to log took a long time: real 0.073s user 0.000s sys 0.000s
W20240502 01:58:20.803524 14255 log.cc:924] Time spent T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a: Append to log took a long time: real 0.067s user 0.000s sys 0.000s
W20240502 01:58:20.803601 14531 log.cc:924] Time spent T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a: Append to log took a long time: real 0.069s user 0.000s sys 0.000s
I20240502 01:58:20.806157 14227 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.65: config changed from index -1 to 65, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
W20240502 01:58:20.803663 14496 log.cc:924] Time spent T 400199df936243f2b49a4b556f29c575 P 1928367ae8d64ba49a7f5761b2d3dc4a: Append to log took a long time: real 0.071s user 0.000s sys 0.000s
W20240502 01:58:20.808676 14912 log.cc:924] Time spent T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867: Append to log took a long time: real 0.094s user 0.000s sys 0.000s
I20240502 01:58:20.808734 13204 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.65: config changed from index -1 to 65, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:20.823385 12802 raft_consensus.cc:2932] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Committing config change with OpId 1.75: config changed from index -1 to 75, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 75 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:20.829664 14912 tablet_bootstrap.cc:492] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap replayed 1/1 log segments. Stats: ops{read=117 overwritten=0 applied=117 ignored=0} inserts{seen=748 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:20.830034 14912 tablet_bootstrap.cc:492] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap complete.
I20240502 01:58:20.830282 14912 ts_tablet_manager.cc:1367] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867: Time spent bootstrapping tablet: real 0.536s user 0.107s sys 0.011s
I20240502 01:58:20.830828 13468 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.65: config changed from index -1 to 65, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:20.831348 14912 raft_consensus.cc:348] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:20.831475 14912 raft_consensus.cc:729] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1ef9768a03e545fba961cfeee4c1c867, State: Initialized, Role: LEARNER
I20240502 01:58:20.831609 14912 consensus_queue.cc:260] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 117, Last appended: 1.117, Last appended by leader: 117, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 105 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:20.831915 14912 ts_tablet_manager.cc:1398] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:20.834208 13229 tablet_copy_service.cc:342] P 3d7bf587aa5a49eb92c3a53d17717149: Request end of tablet copy session 1ef9768a03e545fba961cfeee4c1c867-eeb77a056e494d5ab85138d8ecc52db9 received from {username='slave'} at 127.10.133.199:59449
I20240502 01:58:20.834293 13229 tablet_copy_service.cc:433] P 3d7bf587aa5a49eb92c3a53d17717149: ending tablet copy session 1ef9768a03e545fba961cfeee4c1c867-eeb77a056e494d5ab85138d8ecc52db9 on tablet eeb77a056e494d5ab85138d8ecc52db9 with peer 1ef9768a03e545fba961cfeee4c1c867
I20240502 01:58:20.849239 13337 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.65: config changed from index -1 to 65, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:20.904278 12659 catalog_manager.cc:5484] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a reported cstate change: config changed from index -1 to 65, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:20.919600 12937 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.65: config changed from index -1 to 65, NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) added. New config: { opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } } }
I20240502 01:58:20.946763 14368 raft_consensus.cc:1203] T 6b4405ed71824af7bde2e54f5f592d10 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.87->[1.88-1.118] Dedup: 1.104->[1.105-1.118]
I20240502 01:58:20.975487 14912 ts_tablet_manager.cc:902] T 24d91cbbc7cb4be7a0034613b96ac1cd P 1ef9768a03e545fba961cfeee4c1c867: Initiating tablet copy from peer 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283)
I20240502 01:58:20.976050 14912 tablet_copy_client.cc:308] T 24d91cbbc7cb4be7a0034613b96ac1cd P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.197:42283
W20240502 01:58:21.026654 12741 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.133.197:42283, user_credentials={real_user=slave}} blocked reactor thread for 116865us
I20240502 01:58:21.049111 14498 raft_consensus.cc:1050] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149: attempting to promote NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 to VOTER
I20240502 01:58:21.049639 14498 consensus_queue.cc:237] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 119, Committed index: 119, Last appended: 1.119, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 120 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } }
I20240502 01:58:21.051678 14369 raft_consensus.cc:1261] T 6b4405ed71824af7bde2e54f5f592d10 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 119. Preceding OpId from leader: term: 1 index: 120. (index mismatch)
I20240502 01:58:21.051805 12938 raft_consensus.cc:1261] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 119. Preceding OpId from leader: term: 1 index: 120. (index mismatch)
I20240502 01:58:21.052366 14478 consensus_queue.cc:1035] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20240502 01:58:21.052659 14478 consensus_queue.cc:1035] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20240502 01:58:21.053874 13468 raft_consensus.cc:1261] T 6b4405ed71824af7bde2e54f5f592d10 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 119. Preceding OpId from leader: term: 1 index: 120. (index mismatch)
I20240502 01:58:21.054721 13337 raft_consensus.cc:1261] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 119. Preceding OpId from leader: term: 1 index: 120. (index mismatch)
I20240502 01:58:21.055003 13072 raft_consensus.cc:1261] T 6b4405ed71824af7bde2e54f5f592d10 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 119. Preceding OpId from leader: term: 1 index: 120. (index mismatch)
I20240502 01:58:21.055939 14498 consensus_queue.cc:1035] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20240502 01:58:21.056165 14603 consensus_queue.cc:1035] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20240502 01:58:21.056293 14498 consensus_queue.cc:1035] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20240502 01:58:21.061079 14368 raft_consensus.cc:1203] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.104->[1.105-1.136] Dedup: 1.117->[1.118-1.136]
I20240502 01:58:21.061498 14790 raft_consensus.cc:2932] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 LEADER]: Committing config change with OpId 1.120: config changed from index 88 to 120, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 120 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.062615 14369 raft_consensus.cc:2932] T 6b4405ed71824af7bde2e54f5f592d10 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.120: config changed from index 88 to 120, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 120 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.081267 13472 raft_consensus.cc:2932] T 6b4405ed71824af7bde2e54f5f592d10 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.120: config changed from index 88 to 120, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 120 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.089478 12937 raft_consensus.cc:2932] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.120: config changed from index 88 to 120, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 120 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.090718 13066 raft_consensus.cc:2932] T 6b4405ed71824af7bde2e54f5f592d10 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.120: config changed from index 88 to 120, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 120 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.095194 12656 catalog_manager.cc:5484] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e reported cstate change: config changed from index 88 to 120, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d7bf587aa5a49eb92c3a53d17717149" committed_config { opid_index: 120 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.106225 13208 consensus_queue.cc:237] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 120, Committed index: 120, Last appended: 1.121, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 122 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } }
I20240502 01:58:21.108423 13472 raft_consensus.cc:1261] T 6b4405ed71824af7bde2e54f5f592d10 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 121. Preceding OpId from leader: term: 1 index: 122. (index mismatch)
I20240502 01:58:21.109429 14604 consensus_queue.cc:1035] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 122, Last known committed idx: 120, Time since last communication: 0.000s
I20240502 01:58:21.112268 12938 raft_consensus.cc:1261] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 121. Preceding OpId from leader: term: 1 index: 122. (index mismatch)
I20240502 01:58:21.112959 13340 raft_consensus.cc:2932] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.120: config changed from index 88 to 120, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 120 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.114774 14603 consensus_queue.cc:1035] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 122, Last known committed idx: 120, Time since last communication: 0.000s
I20240502 01:58:21.116917 14367 raft_consensus.cc:1261] T 6b4405ed71824af7bde2e54f5f592d10 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 121. Preceding OpId from leader: term: 1 index: 122. (index mismatch)
I20240502 01:58:21.123737 12937 raft_consensus.cc:2932] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.122: config changed from index 120 to 122, VOTER 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197) evicted. New config: { opid_index: 122 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.123322 14604 raft_consensus.cc:2932] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 LEADER]: Committing config change with OpId 1.122: config changed from index 120 to 122, VOTER 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197) evicted. New config: { opid_index: 122 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.125878 14603 consensus_queue.cc:1035] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 122, Last known committed idx: 120, Time since last communication: 0.000s
I20240502 01:58:21.134459 14369 raft_consensus.cc:2932] T 6b4405ed71824af7bde2e54f5f592d10 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.122: config changed from index 120 to 122, VOTER 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197) evicted. New config: { opid_index: 122 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.144280 14478 raft_consensus.cc:1050] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149: attempting to promote NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 to VOTER
I20240502 01:58:21.145011 14478 consensus_queue.cc:237] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 138, Committed index: 138, Last appended: 1.138, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 139 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } }
I20240502 01:58:21.147298 14366 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 138. Preceding OpId from leader: term: 1 index: 139. (index mismatch)
I20240502 01:58:21.147678 14498 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 139, Last known committed idx: 138, Time since last communication: 0.000s
I20240502 01:58:21.149845 12935 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 138. Preceding OpId from leader: term: 1 index: 139. (index mismatch)
I20240502 01:58:21.150260 14498 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 139, Last known committed idx: 138, Time since last communication: 0.000s
I20240502 01:58:21.150848 13473 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 138. Preceding OpId from leader: term: 1 index: 139. (index mismatch)
I20240502 01:58:21.152602 14498 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 139, Last known committed idx: 138, Time since last communication: 0.000s
I20240502 01:58:21.157522 14790 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 LEADER]: Committing config change with OpId 1.139: config changed from index 105 to 139, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 139 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.158191 13335 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 138. Preceding OpId from leader: term: 1 index: 139. (index mismatch)
I20240502 01:58:21.158605 14498 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 139, Last known committed idx: 138, Time since last communication: 0.000s
I20240502 01:58:21.158742 13469 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.139: config changed from index 105 to 139, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 139 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.164757 13071 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 138. Preceding OpId from leader: term: 1 index: 139. (index mismatch)
I20240502 01:58:21.165309 14498 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 139, Last known committed idx: 138, Time since last communication: 0.000s
I20240502 01:58:21.165683 13335 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.139: config changed from index 105 to 139, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 139 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.167929 14986 ts_tablet_manager.cc:902] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867: Initiating tablet copy from peer 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263)
I20240502 01:58:21.168552 14986 tablet_copy_client.cc:308] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:46263
I20240502 01:58:21.169265 12825 tablet_copy_service.cc:140] P 27e2acacdad14caa8f66bc81fa8a2f88: Received BeginTabletCopySession request for tablet 773b692c40df457caf7baea5a7b21c27 from peer 1ef9768a03e545fba961cfeee4c1c867 ({username='slave'} at 127.10.133.199:42263)
I20240502 01:58:21.169382 12825 tablet_copy_service.cc:161] P 27e2acacdad14caa8f66bc81fa8a2f88: Beginning new tablet copy session on tablet 773b692c40df457caf7baea5a7b21c27 from peer 1ef9768a03e545fba961cfeee4c1c867 at {username='slave'} at 127.10.133.199:42263: session id = 1ef9768a03e545fba961cfeee4c1c867-773b692c40df457caf7baea5a7b21c27
I20240502 01:58:21.170367 12825 tablet_copy_source_session.cc:205] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:21.170817 13071 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.139: config changed from index 105 to 139, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 139 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.191249 13072 raft_consensus.cc:1261] T 6b4405ed71824af7bde2e54f5f592d10 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 120. Preceding OpId from leader: term: 1 index: 122. (index mismatch)
I20240502 01:58:21.191329 12659 catalog_manager.cc:5484] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 reported cstate change: config changed from index 105 to 139, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d7bf587aa5a49eb92c3a53d17717149" committed_config { opid_index: 139 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.191936 14983 consensus_queue.cc:1035] T 6b4405ed71824af7bde2e54f5f592d10 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 122, Last known committed idx: 120, Time since last communication: 0.000s
I20240502 01:58:21.194766 13072 raft_consensus.cc:2932] T 6b4405ed71824af7bde2e54f5f592d10 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.122: config changed from index 120 to 122, VOTER 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197) evicted. New config: { opid_index: 122 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.199280 12657 catalog_manager.cc:5484] T 6b4405ed71824af7bde2e54f5f592d10 P 42bc78875b454c7ab7fce86d56a28c1e reported cstate change: config changed from index 120 to 122, VOTER 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197) evicted. New cstate: current_term: 1 leader_uuid: "3d7bf587aa5a49eb92c3a53d17717149" committed_config { opid_index: 122 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.200215 12648 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 6b4405ed71824af7bde2e54f5f592d10 with cas_config_opid_index 120: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:21.200850 13470 raft_consensus.cc:2932] T 6b4405ed71824af7bde2e54f5f592d10 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.122: config changed from index 120 to 122, VOTER 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197) evicted. New config: { opid_index: 122 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.204099 13321 tablet_service.cc:1514] Processing DeleteTablet for tablet 6b4405ed71824af7bde2e54f5f592d10 with delete_type TABLET_DATA_TOMBSTONED (TS 6b1e63d6b84a440a8864db2d36b57665 not found in new config with opid_index 122) from {username='slave'} at 127.0.0.1:48890
I20240502 01:58:21.249161 14986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 773b692c40df457caf7baea5a7b21c27. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:21.256747 14899 tablet_bootstrap.cc:492] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap replayed 1/1 log segments. Stats: ops{read=119 overwritten=0 applied=119 ignored=0} inserts{seen=791 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:21.257179 14899 tablet_bootstrap.cc:492] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap complete.
I20240502 01:58:21.257704 14899 ts_tablet_manager.cc:1367] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867: Time spent bootstrapping tablet: real 0.461s user 0.094s sys 0.021s
I20240502 01:58:21.258364 14899 raft_consensus.cc:348] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 113 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:21.258630 14899 raft_consensus.cc:729] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1ef9768a03e545fba961cfeee4c1c867, State: Initialized, Role: LEARNER
I20240502 01:58:21.258788 14899 consensus_queue.cc:260] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 119, Last appended: 1.119, Last appended by leader: 119, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 113 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:21.259193 14899 ts_tablet_manager.cc:1398] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:21.260074 12825 tablet_copy_service.cc:342] P 27e2acacdad14caa8f66bc81fa8a2f88: Request end of tablet copy session 1ef9768a03e545fba961cfeee4c1c867-a8e8a2483ab8452f9b798930ebc069ac received from {username='slave'} at 127.10.133.199:42263
I20240502 01:58:21.260151 12825 tablet_copy_service.cc:433] P 27e2acacdad14caa8f66bc81fa8a2f88: ending tablet copy session 1ef9768a03e545fba961cfeee4c1c867-a8e8a2483ab8452f9b798930ebc069ac on tablet a8e8a2483ab8452f9b798930ebc069ac with peer 1ef9768a03e545fba961cfeee4c1c867
W20240502 01:58:21.262262 12741 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.133.198:39759, user_credentials={real_user=slave}} blocked reactor thread for 64993.5us
I20240502 01:58:21.271589 12937 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.139: config changed from index 105 to 139, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 139 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.277714 13361 tablet_copy_service.cc:140] P 6b1e63d6b84a440a8864db2d36b57665: Received BeginTabletCopySession request for tablet 24d91cbbc7cb4be7a0034613b96ac1cd from peer 1ef9768a03e545fba961cfeee4c1c867 ({username='slave'} at 127.10.133.199:44473)
I20240502 01:58:21.277848 13361 tablet_copy_service.cc:161] P 6b1e63d6b84a440a8864db2d36b57665: Beginning new tablet copy session on tablet 24d91cbbc7cb4be7a0034613b96ac1cd from peer 1ef9768a03e545fba961cfeee4c1c867 at {username='slave'} at 127.10.133.199:44473: session id = 1ef9768a03e545fba961cfeee4c1c867-24d91cbbc7cb4be7a0034613b96ac1cd
I20240502 01:58:21.279799 13361 tablet_copy_source_session.cc:205] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:21.286062 14986 tablet_copy_client.cc:783] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:21.286355 14986 tablet_copy_client.cc:647] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:21.287688 14986 tablet_copy_client.cc:523] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:21.293633 14997 tablet_replica.cc:330] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665: stopping tablet replica
I20240502 01:58:21.295120 14369 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.139: config changed from index 105 to 139, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 139 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.295588 14997 raft_consensus.cc:2229] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:21.298949 14997 raft_consensus.cc:2258] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:21.312594 13208 consensus_queue.cc:237] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 140, Committed index: 140, Last appended: 1.140, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 141 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } }
I20240502 01:58:21.315544 14997 ts_tablet_manager.cc:1875] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:21.319977 13072 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 140. Preceding OpId from leader: term: 1 index: 141. (index mismatch)
I20240502 01:58:21.320482 13472 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 140. Preceding OpId from leader: term: 1 index: 141. (index mismatch)
I20240502 01:58:21.321727 14478 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 141, Last known committed idx: 140, Time since last communication: 0.000s
I20240502 01:58:21.322068 14478 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 141, Last known committed idx: 139, Time since last communication: 0.000s
I20240502 01:58:21.325418 14604 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 LEADER]: Committing config change with OpId 1.141: config changed from index 139 to 141, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New config: { opid_index: 141 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.327219 13072 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.141: config changed from index 139 to 141, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New config: { opid_index: 141 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.328711 13335 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 140. Preceding OpId from leader: term: 1 index: 141. (index mismatch)
I20240502 01:58:21.329107 14478 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 141, Last known committed idx: 140, Time since last communication: 0.000s
I20240502 01:58:21.331518 13335 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.141: config changed from index 139 to 141, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New config: { opid_index: 141 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.364112 14368 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 139. Preceding OpId from leader: term: 1 index: 141. (index mismatch)
I20240502 01:58:21.369683 12648 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet eeb77a056e494d5ab85138d8ecc52db9 with cas_config_opid_index 139: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:21.370824 14603 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 141, Last known committed idx: 139, Time since last communication: 0.000s
I20240502 01:58:21.371335 12657 catalog_manager.cc:5484] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 reported cstate change: config changed from index 139 to 141, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New cstate: current_term: 1 leader_uuid: "3d7bf587aa5a49eb92c3a53d17717149" committed_config { opid_index: 141 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:21.376145 14369 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.141: config changed from index 139 to 141, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New config: { opid_index: 141 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.384820 13468 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.141: config changed from index 139 to 141, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New config: { opid_index: 141 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.386718 12918 tablet_service.cc:1514] Processing DeleteTablet for tablet eeb77a056e494d5ab85138d8ecc52db9 with delete_type TABLET_DATA_TOMBSTONED (TS 42bc78875b454c7ab7fce86d56a28c1e not found in new config with opid_index 141) from {username='slave'} at 127.0.0.1:60860
I20240502 01:58:21.393743 14912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24d91cbbc7cb4be7a0034613b96ac1cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:21.396240 14912 tablet_copy_client.cc:783] T 24d91cbbc7cb4be7a0034613b96ac1cd P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:21.396381 14912 tablet_copy_client.cc:647] T 24d91cbbc7cb4be7a0034613b96ac1cd P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:21.401743 14986 tablet_bootstrap.cc:492] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap starting.
I20240502 01:58:21.422142 14912 tablet_copy_client.cc:523] T 24d91cbbc7cb4be7a0034613b96ac1cd P 1ef9768a03e545fba961cfeee4c1c867: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:21.423607 14912 tablet_bootstrap.cc:492] T 24d91cbbc7cb4be7a0034613b96ac1cd P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap starting.
I20240502 01:58:21.443460 14997 ts_tablet_manager.cc:1888] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.120
I20240502 01:58:21.443562 14997 log.cc:1196] T 6b4405ed71824af7bde2e54f5f592d10 P 6b1e63d6b84a440a8864db2d36b57665: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal/wals/6b4405ed71824af7bde2e54f5f592d10
I20240502 01:58:21.444387 12649 catalog_manager.cc:4830] TS 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283): tablet 6b4405ed71824af7bde2e54f5f592d10 (table rebalance_test_table_1 [id=744919a455134d42b3ec60abe824250b]) successfully deleted
I20240502 01:58:21.479039 15017 tablet_replica.cc:330] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e: stopping tablet replica
I20240502 01:58:21.480051 15017 raft_consensus.cc:2229] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:21.481104 15017 pending_rounds.cc:62] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e: Trying to abort 1 pending ops.
I20240502 01:58:21.482023 15017 pending_rounds.cc:68] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e: Aborting op as it isn't in flight: id { term: 1 index: 140 } timestamp: 7023063454666838016 op_type: WRITE_OP write_request { tablet_id: "eeb77a056e494d5ab85138d8ecc52db9" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\222X\253\025\366$E\345\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""69b6d53844d0c9da" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7023063454624067584 authz_token { token_data: "\010\342\350\313\261\006\"3\n\005slave\022*\n 744919a455134d42b3ec60abe824250b\020\001\030\001 \001(\001" signature: "<redacted>""\002\267\206\210\030\"\354\242\r\027\227\207se7x\334S\331>\262=\246\210<\263i\236\355M)^9\232%\233\242\272-\332\225\022\230\200Ze\240\221\267\303\"\206\"\017[\336\244\354\205`\031\237\224\211" signing_key_seq_num: 0 } } request_id { client_id: "089b9f7ab77b4cffa72ac1866c54682e" seq_no: 399 first_incomplete_seq_no: 399 attempt_no: 0 }
I20240502 01:58:21.482568 15017 raft_consensus.cc:2258] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:21.484933 15017 ts_tablet_manager.cc:1875] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:21.491891 15017 ts_tablet_manager.cc:1888] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.140
I20240502 01:58:21.492043 15017 log.cc:1196] T eeb77a056e494d5ab85138d8ecc52db9 P 42bc78875b454c7ab7fce86d56a28c1e: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/eeb77a056e494d5ab85138d8ecc52db9
I20240502 01:58:21.496698 12646 catalog_manager.cc:4830] TS 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143): tablet eeb77a056e494d5ab85138d8ecc52db9 (table rebalance_test_table_1 [id=744919a455134d42b3ec60abe824250b]) successfully deleted
I20240502 01:58:21.619731 14912 tablet_bootstrap.cc:492] T 24d91cbbc7cb4be7a0034613b96ac1cd P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap replayed 1/1 log segments. Stats: ops{read=88 overwritten=0 applied=87 ignored=0} inserts{seen=772 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20240502 01:58:21.650200 14912 tablet_bootstrap.cc:492] T 24d91cbbc7cb4be7a0034613b96ac1cd P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap complete.
I20240502 01:58:21.650430 14912 ts_tablet_manager.cc:1367] T 24d91cbbc7cb4be7a0034613b96ac1cd P 1ef9768a03e545fba961cfeee4c1c867: Time spent bootstrapping tablet: real 0.227s user 0.085s sys 0.004s
I20240502 01:58:21.650894 14912 raft_consensus.cc:348] T 24d91cbbc7cb4be7a0034613b96ac1cd P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 75 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:21.651211 14912 raft_consensus.cc:729] T 24d91cbbc7cb4be7a0034613b96ac1cd P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1ef9768a03e545fba961cfeee4c1c867, State: Initialized, Role: LEARNER
I20240502 01:58:21.651355 14912 consensus_queue.cc:260] T 24d91cbbc7cb4be7a0034613b96ac1cd P 1ef9768a03e545fba961cfeee4c1c867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 87, Last appended: 1.88, Last appended by leader: 88, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 75 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:21.651670 14912 ts_tablet_manager.cc:1398] T 24d91cbbc7cb4be7a0034613b96ac1cd P 1ef9768a03e545fba961cfeee4c1c867: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:21.654815 13361 tablet_copy_service.cc:342] P 6b1e63d6b84a440a8864db2d36b57665: Request end of tablet copy session 1ef9768a03e545fba961cfeee4c1c867-24d91cbbc7cb4be7a0034613b96ac1cd received from {username='slave'} at 127.10.133.199:44473
I20240502 01:58:21.654917 13361 tablet_copy_service.cc:433] P 6b1e63d6b84a440a8864db2d36b57665: ending tablet copy session 1ef9768a03e545fba961cfeee4c1c867-24d91cbbc7cb4be7a0034613b96ac1cd on tablet 24d91cbbc7cb4be7a0034613b96ac1cd with peer 1ef9768a03e545fba961cfeee4c1c867
W20240502 01:58:21.726567 12738 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.133.194:40143, user_credentials={real_user=slave}} blocked reactor thread for 65422.9us
I20240502 01:58:21.731963 14367 raft_consensus.cc:1203] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.112->[1.113-1.142] Dedup: 1.119->[1.120-1.142]
I20240502 01:58:21.757797 14367 raft_consensus.cc:1203] T 24d91cbbc7cb4be7a0034613b96ac1cd P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.74->[1.75-1.95] Dedup: 1.88->[1.89-1.95]
I20240502 01:58:21.775269 14522 raft_consensus.cc:1050] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88: attempting to promote NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 to VOTER
I20240502 01:58:21.775674 14522 consensus_queue.cc:237] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 142, Committed index: 142, Last appended: 1.142, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 143 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } }
I20240502 01:58:21.779408 14369 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 142. Preceding OpId from leader: term: 1 index: 143. (index mismatch)
I20240502 01:58:21.779742 14522 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 143, Last known committed idx: 142, Time since last communication: 0.000s
I20240502 01:58:21.779762 13206 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 142. Preceding OpId from leader: term: 1 index: 143. (index mismatch)
I20240502 01:58:21.780170 14522 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 143, Last known committed idx: 142, Time since last communication: 0.000s
I20240502 01:58:21.784351 13470 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 142. Preceding OpId from leader: term: 1 index: 143. (index mismatch)
I20240502 01:58:21.789125 14986 tablet_bootstrap.cc:492] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap replayed 1/1 log segments. Stats: ops{read=65 overwritten=0 applied=65 ignored=0} inserts{seen=737 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:21.789465 13338 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 142. Preceding OpId from leader: term: 1 index: 143. (index mismatch)
I20240502 01:58:21.790141 14986 tablet_bootstrap.cc:492] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867: Bootstrap complete.
I20240502 01:58:21.790351 14986 ts_tablet_manager.cc:1367] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867: Time spent bootstrapping tablet: real 0.389s user 0.067s sys 0.008s
I20240502 01:58:21.791788 14958 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 143, Last known committed idx: 141, Time since last communication: 0.000s
I20240502 01:58:21.792451 14960 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 143, Last known committed idx: 142, Time since last communication: 0.000s
I20240502 01:58:21.792783 14986 raft_consensus.cc:348] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:21.792918 14986 raft_consensus.cc:729] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1ef9768a03e545fba961cfeee4c1c867, State: Initialized, Role: LEARNER
I20240502 01:58:21.793041 14986 consensus_queue.cc:260] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 65, Last appended: 1.65, Last appended by leader: 65, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 65 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: true } }
I20240502 01:58:21.794085 14986 ts_tablet_manager.cc:1398] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240502 01:58:21.798617 14957 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.143: config changed from index 113 to 143, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 143 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
W20240502 01:58:21.800734 12738 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.133.194:40143, user_credentials={real_user=slave}} blocked reactor thread for 57606.8us
I20240502 01:58:21.801620 12825 tablet_copy_service.cc:342] P 27e2acacdad14caa8f66bc81fa8a2f88: Request end of tablet copy session 1ef9768a03e545fba961cfeee4c1c867-773b692c40df457caf7baea5a7b21c27 received from {username='slave'} at 127.10.133.199:42263
I20240502 01:58:21.801683 12825 tablet_copy_service.cc:433] P 27e2acacdad14caa8f66bc81fa8a2f88: ending tablet copy session 1ef9768a03e545fba961cfeee4c1c867-773b692c40df457caf7baea5a7b21c27 on tablet 773b692c40df457caf7baea5a7b21c27 with peer 1ef9768a03e545fba961cfeee4c1c867
I20240502 01:58:21.804772 13206 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.143: config changed from index 113 to 143, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 143 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.802894 14369 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.143: config changed from index 113 to 143, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 143 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.809918 13335 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.143: config changed from index 113 to 143, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 143 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.810241 12655 catalog_manager.cc:5484] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867 reported cstate change: config changed from index 113 to 143, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 143 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.812470 13470 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.143: config changed from index 113 to 143, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 143 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.813705 14837 raft_consensus.cc:1050] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665: attempting to promote NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 to VOTER
I20240502 01:58:21.814980 14837 consensus_queue.cc:237] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 95, Committed index: 95, Last appended: 1.96, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 97 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } }
I20240502 01:58:21.818310 13207 raft_consensus.cc:1261] T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 96. Preceding OpId from leader: term: 1 index: 97. (index mismatch)
I20240502 01:58:21.818449 14367 raft_consensus.cc:1261] T 24d91cbbc7cb4be7a0034613b96ac1cd P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 96. Preceding OpId from leader: term: 1 index: 97. (index mismatch)
I20240502 01:58:21.818887 14975 consensus_queue.cc:1035] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 97, Last known committed idx: 95, Time since last communication: 0.000s
I20240502 01:58:21.819185 14975 consensus_queue.cc:1035] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 97, Last known committed idx: 95, Time since last communication: 0.000s
I20240502 01:58:21.824378 13067 raft_consensus.cc:1261] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 96. Preceding OpId from leader: term: 1 index: 97. (index mismatch)
I20240502 01:58:21.827040 12802 raft_consensus.cc:1261] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 96. Preceding OpId from leader: term: 1 index: 97. (index mismatch)
I20240502 01:58:21.837051 14437 consensus_queue.cc:1035] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20240502 01:58:21.837337 14917 consensus_queue.cc:1035] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 97, Last known committed idx: 95, Time since last communication: 0.000s
I20240502 01:58:21.839655 12934 raft_consensus.cc:1261] T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 95. Preceding OpId from leader: term: 1 index: 97. (index mismatch)
I20240502 01:58:21.840077 14917 raft_consensus.cc:2932] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [term 1 LEADER]: Committing config change with OpId 1.97: config changed from index 75 to 97, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 97 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.840966 12934 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 142. Preceding OpId from leader: term: 1 index: 143. (index mismatch)
I20240502 01:58:21.844547 14917 consensus_queue.cc:1035] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 97, Last known committed idx: 95, Time since last communication: 0.000s
I20240502 01:58:21.844067 12656 catalog_manager.cc:5484] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 reported cstate change: config changed from index 75 to 97, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6b1e63d6b84a440a8864db2d36b57665" committed_config { opid_index: 97 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:21.845188 14367 raft_consensus.cc:2932] T 24d91cbbc7cb4be7a0034613b96ac1cd P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.97: config changed from index 75 to 97, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 97 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.846985 12802 raft_consensus.cc:2932] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Committing config change with OpId 1.97: config changed from index 75 to 97, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 97 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.848567 13206 raft_consensus.cc:2932] T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.97: config changed from index 75 to 97, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 97 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.850752 14957 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 143, Last known committed idx: 142, Time since last communication: 0.000s
I20240502 01:58:21.854343 12938 raft_consensus.cc:1203] T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.95->[1.96-1.97] Dedup: 1.96->[1.97-1.97]
I20240502 01:58:21.854736 12938 raft_consensus.cc:2932] T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.97: config changed from index 75 to 97, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 97 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.856639 12937 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.143: config changed from index 113 to 143, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 143 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.870565 13069 raft_consensus.cc:2932] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.97: config changed from index 75 to 97, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 97 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.939098 12802 consensus_queue.cc:237] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 145, Committed index: 145, Last appended: 1.145, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 146 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } }
I20240502 01:58:21.950400 14366 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 145. Preceding OpId from leader: term: 1 index: 146. (index mismatch)
I20240502 01:58:21.950809 14957 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 146, Last known committed idx: 145, Time since last communication: 0.000s
I20240502 01:58:21.951864 12934 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 145. Preceding OpId from leader: term: 1 index: 146. (index mismatch)
I20240502 01:58:21.953976 14122 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 146, Last known committed idx: 145, Time since last communication: 0.000s
I20240502 01:58:21.954386 13206 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 145. Preceding OpId from leader: term: 1 index: 146. (index mismatch)
I20240502 01:58:21.956821 14122 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 146, Last known committed idx: 145, Time since last communication: 0.000s
I20240502 01:58:21.957291 14122 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.146: config changed from index 143 to 146, VOTER 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198) evicted. New config: { opid_index: 146 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.957724 12934 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.146: config changed from index 143 to 146, VOTER 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198) evicted. New config: { opid_index: 146 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.959522 12648 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet a8e8a2483ab8452f9b798930ebc069ac with cas_config_opid_index 143: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:21.961701 12655 catalog_manager.cc:5484] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: config changed from index 143 to 146, VOTER 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198) evicted. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 146 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:21.965062 14367 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.146: config changed from index 143 to 146, VOTER 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198) evicted. New config: { opid_index: 146 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.965366 13452 tablet_service.cc:1514] Processing DeleteTablet for tablet a8e8a2483ab8452f9b798930ebc069ac with delete_type TABLET_DATA_TOMBSTONED (TS 1928367ae8d64ba49a7f5761b2d3dc4a not found in new config with opid_index 146) from {username='slave'} at 127.0.0.1:44176
I20240502 01:58:21.973372 15060 tablet_replica.cc:330] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a: stopping tablet replica
I20240502 01:58:21.973727 15060 raft_consensus.cc:2229] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:21.974320 15060 raft_consensus.cc:2258] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:21.974184 13207 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.146: config changed from index 143 to 146, VOTER 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198) evicted. New config: { opid_index: 146 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:21.979452 15060 ts_tablet_manager.cc:1875] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:21.980365 13338 consensus_queue.cc:237] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 98, Committed index: 98, Last appended: 1.98, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 99 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } }
I20240502 01:58:21.983063 13336 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 145. Preceding OpId from leader: term: 1 index: 146. (index mismatch)
I20240502 01:58:21.983752 14368 raft_consensus.cc:1261] T 24d91cbbc7cb4be7a0034613b96ac1cd P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 98. Preceding OpId from leader: term: 1 index: 99. (index mismatch)
I20240502 01:58:21.984350 14437 consensus_queue.cc:1035] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20240502 01:58:21.984107 13206 raft_consensus.cc:1261] T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 98. Preceding OpId from leader: term: 1 index: 99. (index mismatch)
I20240502 01:58:21.986263 14437 consensus_queue.cc:1035] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20240502 01:58:21.987030 14523 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 146, Last known committed idx: 144, Time since last communication: 0.000s
I20240502 01:58:21.999516 15060 ts_tablet_manager.cc:1888] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.144
I20240502 01:58:21.999708 15060 log.cc:1196] T a8e8a2483ab8452f9b798930ebc069ac P 1928367ae8d64ba49a7f5761b2d3dc4a: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal/wals/a8e8a2483ab8452f9b798930ebc069ac
I20240502 01:58:22.001991 12649 catalog_manager.cc:4830] TS 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759): tablet a8e8a2483ab8452f9b798930ebc069ac (table rebalance_test_table_2 [id=41727fe31ec64883ac850e582b40cb0b]) successfully deleted
I20240502 01:58:22.008404 14437 raft_consensus.cc:2932] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [term 1 LEADER]: Committing config change with OpId 1.99: config changed from index 97 to 99, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 99 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:22.011687 12937 raft_consensus.cc:1261] T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 98. Preceding OpId from leader: term: 1 index: 99. (index mismatch)
I20240502 01:58:22.012051 15053 consensus_queue.cc:1035] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20240502 01:58:22.011986 14368 raft_consensus.cc:2932] T 24d91cbbc7cb4be7a0034613b96ac1cd P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.99: config changed from index 97 to 99, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 99 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:22.012655 12656 catalog_manager.cc:5484] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 reported cstate change: config changed from index 97 to 99, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "6b1e63d6b84a440a8864db2d36b57665" committed_config { opid_index: 99 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:22.013443 12936 raft_consensus.cc:2932] T 24d91cbbc7cb4be7a0034613b96ac1cd P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.99: config changed from index 97 to 99, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 99 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:22.019114 12784 tablet_service.cc:1514] Processing DeleteTablet for tablet 24d91cbbc7cb4be7a0034613b96ac1cd with delete_type TABLET_DATA_TOMBSTONED (TS 27e2acacdad14caa8f66bc81fa8a2f88 not found in new config with opid_index 99) from {username='slave'} at 127.0.0.1:51568
I20240502 01:58:22.019418 12649 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 24d91cbbc7cb4be7a0034613b96ac1cd with cas_config_opid_index 97: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:22.022779 13071 raft_consensus.cc:1261] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 98. Preceding OpId from leader: term: 1 index: 99. (index mismatch)
I20240502 01:58:22.025236 14917 consensus_queue.cc:1035] T 24d91cbbc7cb4be7a0034613b96ac1cd P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 99, Last known committed idx: 97, Time since last communication: 0.000s
I20240502 01:58:22.035714 13207 raft_consensus.cc:2932] T 24d91cbbc7cb4be7a0034613b96ac1cd P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.99: config changed from index 97 to 99, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 99 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:22.038049 15063 tablet_replica.cc:330] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88: stopping tablet replica
I20240502 01:58:22.038230 15063 raft_consensus.cc:2229] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:22.038380 15063 pending_rounds.cc:62] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88: Trying to abort 1 pending ops.
I20240502 01:58:22.038730 15063 pending_rounds.cc:68] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88: Aborting op as it isn't in flight: id { term: 1 index: 98 } timestamp: 7023063457669955584 op_type: WRITE_OP write_request { tablet_id: "24d91cbbc7cb4be7a0034613b96ac1cd" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\3578\n~>\371\343\020\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""649139b8f4c92539" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7023063457427521536 authz_token { token_data: "\010\342\350\313\261\006\"3\n\005slave\022*\n 87bf6032f2ab4ef8a4f1c2692004f94c\020\001\030\001 \001(\001" signature: "<redacted>""\027\031\200j\007n\233>\3422\332\253m\251\201\237\343ji?\340\245T\203\023)\013L\313_V\006\310+\304:\000\314\263c\202\022\363{\200E\266Z\320\311}\222\372\020\251\203V> UI(:\244" signing_key_seq_num: 0 } } request_id { client_id: "2dfee9ac99a543b0a2c7779866b58d07" seq_no: 262 first_incomplete_seq_no: 262 attempt_no: 0 }
I20240502 01:58:22.043170 15063 raft_consensus.cc:2258] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:22.047870 15063 ts_tablet_manager.cc:1875] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:22.055359 15063 ts_tablet_manager.cc:1888] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.98
I20240502 01:58:22.055506 15063 log.cc:1196] T 24d91cbbc7cb4be7a0034613b96ac1cd P 27e2acacdad14caa8f66bc81fa8a2f88: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/24d91cbbc7cb4be7a0034613b96ac1cd
I20240502 01:58:22.075825 12648 catalog_manager.cc:4830] TS 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263): tablet 24d91cbbc7cb4be7a0034613b96ac1cd (table rebalance_test_table_0 [id=87bf6032f2ab4ef8a4f1c2692004f94c]) successfully deleted
I20240502 01:58:22.084021 13338 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.146: config changed from index 143 to 146, VOTER 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198) evicted. New config: { opid_index: 146 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:22.092926 13069 raft_consensus.cc:2932] T 24d91cbbc7cb4be7a0034613b96ac1cd P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.99: config changed from index 97 to 99, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 99 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:22.212281 14367 raft_consensus.cc:1203] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.64->[1.65-1.74] Dedup: 1.65->[1.66-1.74]
I20240502 01:58:22.389406 14523 raft_consensus.cc:1050] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88: attempting to promote NON_VOTER 1ef9768a03e545fba961cfeee4c1c867 to VOTER
I20240502 01:58:22.409121 14523 consensus_queue.cc:237] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 75, Committed index: 75, Last appended: 1.75, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 76 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } }
I20240502 01:58:22.412995 13469 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 75. Preceding OpId from leader: term: 1 index: 76. (index mismatch)
I20240502 01:58:22.413615 13336 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 75. Preceding OpId from leader: term: 1 index: 76. (index mismatch)
I20240502 01:58:22.415657 14122 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 76, Last known committed idx: 75, Time since last communication: 0.000s
I20240502 01:58:22.416163 14122 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 76, Last known committed idx: 75, Time since last communication: 0.000s
I20240502 01:58:22.423314 12934 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 75. Preceding OpId from leader: term: 1 index: 76. (index mismatch)
I20240502 01:58:22.426685 14367 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 LEARNER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 75. Preceding OpId from leader: term: 1 index: 76. (index mismatch)
I20240502 01:58:22.429047 13208 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 75. Preceding OpId from leader: term: 1 index: 76. (index mismatch)
I20240502 01:58:22.436445 14957 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 76, Last known committed idx: 75, Time since last communication: 0.000s
I20240502 01:58:22.438105 14523 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 76, Last known committed idx: 75, Time since last communication: 0.000s
I20240502 01:58:22.456501 14523 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 76, Last known committed idx: 75, Time since last communication: 0.000s
I20240502 01:58:22.461017 14122 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.76: config changed from index 65 to 76, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 76 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:22.467432 13473 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.76: config changed from index 65 to 76, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 76 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:22.471091 12656 catalog_manager.cc:5484] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a reported cstate change: config changed from index 65 to 76, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 76 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:22.472314 12935 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.76: config changed from index 65 to 76, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 76 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:22.478102 14366 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.76: config changed from index 65 to 76, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 76 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:22.487424 13338 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.76: config changed from index 65 to 76, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 76 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:22.519331 13206 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.76: config changed from index 65 to 76, 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 76 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:22.587124 12805 consensus_queue.cc:237] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 76, Committed index: 76, Last appended: 1.76, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 77 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } }
I20240502 01:58:22.597386 13338 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 76. Preceding OpId from leader: term: 1 index: 78. (index mismatch)
I20240502 01:58:22.598976 13469 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 76. Preceding OpId from leader: term: 1 index: 78. (index mismatch)
I20240502 01:58:22.600277 14365 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 76. Preceding OpId from leader: term: 1 index: 78. (index mismatch)
I20240502 01:58:22.600878 13205 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 76. Preceding OpId from leader: term: 1 index: 78. (index mismatch)
I20240502 01:58:22.608412 14122 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20240502 01:58:22.609508 14122 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 77, Last known committed idx: 76, Time since last communication: 0.001s
I20240502 01:58:22.611094 15061 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20240502 01:58:22.621184 14122 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20240502 01:58:22.649082 14122 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.77: config changed from index 76 to 77, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New config: { opid_index: 77 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:22.654590 12648 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 773b692c40df457caf7baea5a7b21c27 with cas_config_opid_index 76: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:22.654454 13338 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.77: config changed from index 76 to 77, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New config: { opid_index: 77 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:22.657825 12656 catalog_manager.cc:5484] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665 reported cstate change: config changed from index 76 to 77, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 77 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:22.660601 14366 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.77: config changed from index 76 to 77, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New config: { opid_index: 77 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:22.666963 13202 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.77: config changed from index 76 to 77, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New config: { opid_index: 77 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:22.669608 12918 tablet_service.cc:1514] Processing DeleteTablet for tablet 773b692c40df457caf7baea5a7b21c27 with delete_type TABLET_DATA_TOMBSTONED (TS 42bc78875b454c7ab7fce86d56a28c1e not found in new config with opid_index 77) from {username='slave'} at 127.0.0.1:60860
I20240502 01:58:22.677647 13469 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.77: config changed from index 76 to 77, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New config: { opid_index: 77 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } }
I20240502 01:58:22.683802 15091 tablet_replica.cc:330] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e: stopping tablet replica
I20240502 01:58:22.683979 15091 raft_consensus.cc:2229] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:22.684209 15091 raft_consensus.cc:2258] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:22.687314 15091 ts_tablet_manager.cc:1875] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:22.707653 15091 ts_tablet_manager.cc:1888] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.76
I20240502 01:58:22.707765 15091 log.cc:1196] T 773b692c40df457caf7baea5a7b21c27 P 42bc78875b454c7ab7fce86d56a28c1e: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/773b692c40df457caf7baea5a7b21c27
I20240502 01:58:22.710937 12646 catalog_manager.cc:4830] TS 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143): tablet 773b692c40df457caf7baea5a7b21c27 (table rebalance_test_table_4 [id=8471dbb0ba2d474da8ff5cbfa12790d9]) successfully deleted
W20240502 01:58:22.806643 12738 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.133.194:40143, user_credentials={real_user=slave}} blocked reactor thread for 52893.3us
W20240502 01:58:23.135864 12873 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.133.195:33887, user_credentials={real_user=slave}} blocked reactor thread for 60356.5us
I20240502 01:58:23.643426 13452 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:23.777244 14349 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:23.793000 13321 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:23.801328 12918 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:23.816669 13185 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:23.849025 13051 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:23.874055 12784 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 01:58:24.220667 13208 consensus_queue.cc:237] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 206, Committed index: 206, Last appended: 1.206, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: NON_VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: true } }
I20240502 01:58:24.222714 13336 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 206. Preceding OpId from leader: term: 1 index: 207. (index mismatch)
I20240502 01:58:24.223174 14790 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 207, Last known committed idx: 206, Time since last communication: 0.000s
I20240502 01:58:24.223677 13072 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 206. Preceding OpId from leader: term: 1 index: 207. (index mismatch)
I20240502 01:58:24.223716 13473 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 206. Preceding OpId from leader: term: 1 index: 207. (index mismatch)
I20240502 01:58:24.224167 14790 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 207, Last known committed idx: 206, Time since last communication: 0.000s
I20240502 01:58:24.224505 14790 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 207, Last known committed idx: 206, Time since last communication: 0.000s
I20240502 01:58:24.226645 14366 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 206. Preceding OpId from leader: term: 1 index: 207. (index mismatch)
I20240502 01:58:24.226811 15071 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 LEADER]: Committing config change with OpId 1.207: config changed from index 141 to 207, NON_VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) added. New config: { opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: NON_VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: true } } }
I20240502 01:58:24.227421 13069 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.207: config changed from index 141 to 207, NON_VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) added. New config: { opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: NON_VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: true } } }
I20240502 01:58:24.227509 13469 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.207: config changed from index 141 to 207, NON_VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) added. New config: { opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: NON_VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: true } } }
I20240502 01:58:24.230840 12655 catalog_manager.cc:5484] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a reported cstate change: config changed from index 141 to 207, NON_VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) added. New cstate: current_term: 1 leader_uuid: "3d7bf587aa5a49eb92c3a53d17717149" committed_config { opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: NON_VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: true } } }
I20240502 01:58:24.230954 13336 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.207: config changed from index 141 to 207, NON_VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) added. New config: { opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: NON_VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: true } } }
I20240502 01:58:24.231360 15152 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 207, Last known committed idx: 206, Time since last communication: 0.000s
W20240502 01:58:24.237612 13142 consensus_peers.cc:485] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 -> Peer 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263): Couldn't send request to peer 27e2acacdad14caa8f66bc81fa8a2f88. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eeb77a056e494d5ab85138d8ecc52db9. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:24.263564 14366 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.207: config changed from index 141 to 207, NON_VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) added. New config: { opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: NON_VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: true } } }
W20240502 01:58:24.423715 13143 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.133.198:39759, user_credentials={real_user=slave}} blocked reactor thread for 44871.8us
I20240502 01:58:24.801762 15182 ts_tablet_manager.cc:902] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88: Initiating tablet copy from peer 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825)
I20240502 01:58:24.802800 15182 tablet_copy_client.cc:308] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.196:32825
I20240502 01:58:24.805649 13229 tablet_copy_service.cc:140] P 3d7bf587aa5a49eb92c3a53d17717149: Received BeginTabletCopySession request for tablet eeb77a056e494d5ab85138d8ecc52db9 from peer 27e2acacdad14caa8f66bc81fa8a2f88 ({username='slave'} at 127.10.133.193:56955)
I20240502 01:58:24.805778 13229 tablet_copy_service.cc:161] P 3d7bf587aa5a49eb92c3a53d17717149: Beginning new tablet copy session on tablet eeb77a056e494d5ab85138d8ecc52db9 from peer 27e2acacdad14caa8f66bc81fa8a2f88 at {username='slave'} at 127.10.133.193:56955: session id = 27e2acacdad14caa8f66bc81fa8a2f88-eeb77a056e494d5ab85138d8ecc52db9
I20240502 01:58:24.807060 13229 tablet_copy_source_session.cc:205] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:24.817010 15182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeb77a056e494d5ab85138d8ecc52db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:24.823504 15182 tablet_copy_client.cc:783] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:24.823781 15182 tablet_copy_client.cc:647] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88: tablet copy: Starting download of 1 WAL segments...
W20240502 01:58:24.902395 13143 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.133.197:42283, user_credentials={real_user=slave}} blocked reactor thread for 69712.1us
I20240502 01:58:24.940289 15182 tablet_copy_client.cc:523] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:24.942335 15182 tablet_bootstrap.cc:492] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88: Bootstrap starting.
I20240502 01:58:25.386090 15182 tablet_bootstrap.cc:492] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88: Bootstrap replayed 1/1 log segments. Stats: ops{read=222 overwritten=0 applied=221 ignored=0} inserts{seen=849 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20240502 01:58:25.386683 15182 tablet_bootstrap.cc:492] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88: Bootstrap complete.
I20240502 01:58:25.386991 15182 ts_tablet_manager.cc:1367] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent bootstrapping tablet: real 0.445s user 0.160s sys 0.031s
I20240502 01:58:25.390625 15182 raft_consensus.cc:348] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEARNER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: NON_VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: true } }
I20240502 01:58:25.393399 15182 raft_consensus.cc:729] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Initialized, Role: LEARNER
I20240502 01:58:25.393595 15182 consensus_queue.cc:260] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 221, Last appended: 1.222, Last appended by leader: 222, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 207 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: NON_VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: true } }
I20240502 01:58:25.395758 15182 ts_tablet_manager.cc:1398] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20240502 01:58:25.413293 13229 tablet_copy_service.cc:342] P 3d7bf587aa5a49eb92c3a53d17717149: Request end of tablet copy session 27e2acacdad14caa8f66bc81fa8a2f88-eeb77a056e494d5ab85138d8ecc52db9 received from {username='slave'} at 127.10.133.193:56955
I20240502 01:58:25.413395 13229 tablet_copy_service.cc:433] P 3d7bf587aa5a49eb92c3a53d17717149: ending tablet copy session 27e2acacdad14caa8f66bc81fa8a2f88-eeb77a056e494d5ab85138d8ecc52db9 on tablet eeb77a056e494d5ab85138d8ecc52db9 with peer 27e2acacdad14caa8f66bc81fa8a2f88
I20240502 01:58:25.611910 12804 raft_consensus.cc:1203] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.206->[1.207-1.244] Dedup: 1.222->[1.223-1.244]
I20240502 01:58:25.699366 14478 raft_consensus.cc:1050] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149: attempting to promote NON_VOTER 27e2acacdad14caa8f66bc81fa8a2f88 to VOTER
I20240502 01:58:25.699841 14478 consensus_queue.cc:237] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 246, Committed index: 246, Last appended: 1.246, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 247 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } }
I20240502 01:58:25.703065 12804 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEARNER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 245. Preceding OpId from leader: term: 1 index: 247. (index mismatch)
I20240502 01:58:25.703542 14364 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 246. Preceding OpId from leader: term: 1 index: 247. (index mismatch)
I20240502 01:58:25.705206 13470 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 246. Preceding OpId from leader: term: 1 index: 247. (index mismatch)
I20240502 01:58:25.705261 13069 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 246. Preceding OpId from leader: term: 1 index: 247. (index mismatch)
I20240502 01:58:25.705622 14604 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 247, Last known committed idx: 246, Time since last communication: 0.000s
I20240502 01:58:25.705900 14604 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 247, Last known committed idx: 246, Time since last communication: 0.000s
I20240502 01:58:25.710894 13336 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 3d7bf587aa5a49eb92c3a53d17717149: Log matching property violated. Preceding OpId in replica: term: 1 index: 245. Preceding OpId from leader: term: 1 index: 247. (index mismatch)
I20240502 01:58:25.711362 15071 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 247, Last known committed idx: 245, Time since last communication: 0.000s
I20240502 01:58:25.712484 14604 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 247, Last known committed idx: 246, Time since last communication: 0.000s
I20240502 01:58:25.712765 14604 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 247, Last known committed idx: 244, Time since last communication: 0.000s
I20240502 01:58:25.713447 14604 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 LEADER]: Committing config change with OpId 1.247: config changed from index 207 to 247, 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) changed from NON_VOTER to VOTER. New config: { opid_index: 247 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } }
I20240502 01:58:25.716476 13069 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.247: config changed from index 207 to 247, 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) changed from NON_VOTER to VOTER. New config: { opid_index: 247 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } }
I20240502 01:58:25.717835 12804 raft_consensus.cc:1203] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.245->[1.246-1.247] Dedup: 1.246->[1.247-1.247]
I20240502 01:58:25.718791 12659 catalog_manager.cc:5484] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 reported cstate change: config changed from index 207 to 247, 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3d7bf587aa5a49eb92c3a53d17717149" committed_config { opid_index: 247 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:25.718869 13336 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.247: config changed from index 207 to 247, 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) changed from NON_VOTER to VOTER. New config: { opid_index: 247 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } }
I20240502 01:58:25.719550 14364 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.247: config changed from index 207 to 247, 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) changed from NON_VOTER to VOTER. New config: { opid_index: 247 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } }
I20240502 01:58:25.722268 13470 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.247: config changed from index 207 to 247, 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) changed from NON_VOTER to VOTER. New config: { opid_index: 247 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } }
I20240502 01:58:25.736423 12804 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Committing config change with OpId 1.247: config changed from index 207 to 247, 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) changed from NON_VOTER to VOTER. New config: { opid_index: 247 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } }
I20240502 01:58:25.976467 13205 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "eeb77a056e494d5ab85138d8ecc52db9"
dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:57044
I20240502 01:58:25.976908 13205 raft_consensus.cc:595] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 LEADER]: Received request to transfer leadership
W20240502 01:58:25.998860 13167 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:39152: Service unavailable: leader transfer in progress
W20240502 01:58:26.004210 13167 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:39152: Service unavailable: leader transfer in progress
I20240502 01:58:26.010018 14790 raft_consensus.cc:979] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149: : Instructing follower 27e2acacdad14caa8f66bc81fa8a2f88 to start an election
I20240502 01:58:26.010124 14790 raft_consensus.cc:1067] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 LEADER]: Signalling peer 27e2acacdad14caa8f66bc81fa8a2f88 to start an election
I20240502 01:58:26.012555 12805 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "eeb77a056e494d5ab85138d8ecc52db9"
dest_uuid: "27e2acacdad14caa8f66bc81fa8a2f88"
from {username='slave'} at 127.10.133.196:54327
I20240502 01:58:26.012729 12805 raft_consensus.cc:482] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:58:26.012784 12805 raft_consensus.cc:3037] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Advancing to term 2
W20240502 01:58:26.012761 13167 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:39152: Service unavailable: leader transfer in progress
I20240502 01:58:26.014039 12805 raft_consensus.cc:504] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 247 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } }
I20240502 01:58:26.014747 12805 leader_election.cc:288] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 2 election: Requested vote from peers 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825), 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887), 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759), 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283), 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199:34821)
I20240502 01:58:26.016077 14364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb77a056e494d5ab85138d8ecc52db9" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 2 candidate_status { last_received { term: 1 index: 253 } } ignore_live_leader: true dest_uuid: "1ef9768a03e545fba961cfeee4c1c867"
I20240502 01:58:26.016321 14364 raft_consensus.cc:3037] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:58:26.017611 13202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb77a056e494d5ab85138d8ecc52db9" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 2 candidate_status { last_received { term: 1 index: 253 } } ignore_live_leader: true dest_uuid: "3d7bf587aa5a49eb92c3a53d17717149"
I20240502 01:58:26.017735 13202 raft_consensus.cc:3032] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:58:26.017796 13202 raft_consensus.cc:729] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3d7bf587aa5a49eb92c3a53d17717149, State: Running, Role: LEADER
I20240502 01:58:26.017964 13202 consensus_queue.cc:260] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 253, Committed index: 253, Last appended: 1.253, Last appended by leader: 253, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 247 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } }
I20240502 01:58:26.018234 13202 raft_consensus.cc:3037] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:58:26.019376 13202 raft_consensus.cc:2454] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 2.
I20240502 01:58:26.020108 14364 raft_consensus.cc:2454] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 2.
W20240502 01:58:26.021940 13167 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:39152: Illegal state: replica 3d7bf587aa5a49eb92c3a53d17717149 is not leader of this config: current role FOLLOWER
I20240502 01:58:26.027684 13068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb77a056e494d5ab85138d8ecc52db9" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 2 candidate_status { last_received { term: 1 index: 253 } } ignore_live_leader: true dest_uuid: "71010353c29d4e988704295c8cd73ef7"
I20240502 01:58:26.027833 13068 raft_consensus.cc:3037] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:58:26.028981 13068 raft_consensus.cc:2454] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 2.
I20240502 01:58:26.029537 13470 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb77a056e494d5ab85138d8ecc52db9" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 2 candidate_status { last_received { term: 1 index: 253 } } ignore_live_leader: true dest_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a"
I20240502 01:58:26.029673 13470 raft_consensus.cc:3037] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:58:26.030848 13470 raft_consensus.cc:2454] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 2.
I20240502 01:58:26.033422 13336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb77a056e494d5ab85138d8ecc52db9" candidate_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" candidate_term: 2 candidate_status { last_received { term: 1 index: 253 } } ignore_live_leader: true dest_uuid: "6b1e63d6b84a440a8864db2d36b57665"
I20240502 01:58:26.033583 13336 raft_consensus.cc:3037] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:58:26.034698 13336 raft_consensus.cc:2454] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e2acacdad14caa8f66bc81fa8a2f88 in term 2.
I20240502 01:58:26.057240 12741 leader_election.cc:302] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 6 voters: 4 yes votes; 0 no votes. yes voters: 1ef9768a03e545fba961cfeee4c1c867, 27e2acacdad14caa8f66bc81fa8a2f88, 3d7bf587aa5a49eb92c3a53d17717149, 71010353c29d4e988704295c8cd73ef7; no voters:
I20240502 01:58:26.057420 14958 raft_consensus.cc:2781] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:58:26.057502 14958 raft_consensus.cc:686] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 2 LEADER]: Becoming Leader. State: Replica: 27e2acacdad14caa8f66bc81fa8a2f88, State: Running, Role: LEADER
I20240502 01:58:26.057642 14958 consensus_queue.cc:237] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 253, Committed index: 253, Last appended: 1.253, Last appended by leader: 253, Current term: 2, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 247 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } }
I20240502 01:58:26.197654 12656 catalog_manager.cc:5484] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: term changed from 1 to 2, leader changed from 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196) to 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193). New cstate: current_term: 2 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 247 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:26.291469 13336 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 253. Preceding OpId from leader: term: 2 index: 255. (index mismatch)
I20240502 01:58:26.292021 13068 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 253. Preceding OpId from leader: term: 2 index: 255. (index mismatch)
I20240502 01:58:26.292500 13470 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 253. Preceding OpId from leader: term: 2 index: 255. (index mismatch)
I20240502 01:58:26.295917 15223 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 254, Last known committed idx: 253, Time since last communication: 0.000s
I20240502 01:58:26.296018 13205 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 253. Preceding OpId from leader: term: 2 index: 255. (index mismatch)
I20240502 01:58:26.297029 14364 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 253. Preceding OpId from leader: term: 2 index: 255. (index mismatch)
I20240502 01:58:26.306278 15223 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 254, Last known committed idx: 253, Time since last communication: 0.000s
I20240502 01:58:26.308404 14958 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 254, Last known committed idx: 253, Time since last communication: 0.000s
I20240502 01:58:26.308682 15171 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 254, Last known committed idx: 253, Time since last communication: 0.000s
I20240502 01:58:26.317312 15227 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 254, Last known committed idx: 253, Time since last communication: 0.000s
I20240502 01:58:26.320211 15151 mvcc.cc:205] Tried to move back new op lower bound from 7023063475337887744 to 7023063474415112192. Current Snapshot: MvccSnapshot[applied={T|T < 7023063475337887744}]
I20240502 01:58:26.324153 14566 mvcc.cc:205] Tried to move back new op lower bound from 7023063475337887744 to 7023063474415112192. Current Snapshot: MvccSnapshot[applied={T|T < 7023063475337887744 or (T in {7023063475337887744})}]
I20240502 01:58:26.325325 15194 mvcc.cc:205] Tried to move back new op lower bound from 7023063475337887744 to 7023063474415112192. Current Snapshot: MvccSnapshot[applied={T|T < 7023063475337887744 or (T in {7023063475337887744})}]
I20240502 01:58:26.340624 15200 mvcc.cc:205] Tried to move back new op lower bound from 7023063475337887744 to 7023063474415112192. Current Snapshot: MvccSnapshot[applied={T|T < 7023063475337887744}]
I20240502 01:58:26.342590 12805 consensus_queue.cc:237] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 255, Committed index: 255, Last appended: 2.256, Last appended by leader: 253, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 257 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } }
I20240502 01:58:26.345733 14367 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 2 index: 256. Preceding OpId from leader: term: 2 index: 257. (index mismatch)
I20240502 01:58:26.346197 15088 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 257, Last known committed idx: 255, Time since last communication: 0.000s
I20240502 01:58:26.348030 13335 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 2 index: 256. Preceding OpId from leader: term: 2 index: 257. (index mismatch)
I20240502 01:58:26.348426 13470 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 2 index: 256. Preceding OpId from leader: term: 2 index: 257. (index mismatch)
I20240502 01:58:26.349452 15088 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 257, Last known committed idx: 255, Time since last communication: 0.000s
I20240502 01:58:26.380723 13068 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 2 index: 256. Preceding OpId from leader: term: 2 index: 257. (index mismatch)
I20240502 01:58:26.415807 14958 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 257, Last known committed idx: 255, Time since last communication: 0.000s
I20240502 01:58:26.434237 15171 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 2 LEADER]: Committing config change with OpId 2.257: config changed from index 247 to 257, VOTER 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196) evicted. New config: { opid_index: 257 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } }
I20240502 01:58:26.441033 15171 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 257, Last known committed idx: 255, Time since last communication: 0.000s
I20240502 01:58:26.442925 12648 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet eeb77a056e494d5ab85138d8ecc52db9 with cas_config_opid_index 247: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:26.444937 12661 catalog_manager.cc:5484] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: config changed from index 247 to 257, VOTER 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196) evicted. New cstate: current_term: 2 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 257 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:26.446091 14367 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 2 FOLLOWER]: Committing config change with OpId 2.257: config changed from index 247 to 257, VOTER 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196) evicted. New config: { opid_index: 257 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } }
I20240502 01:58:26.454696 13472 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 2 FOLLOWER]: Committing config change with OpId 2.257: config changed from index 247 to 257, VOTER 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196) evicted. New config: { opid_index: 257 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } }
I20240502 01:58:26.457708 13185 tablet_service.cc:1514] Processing DeleteTablet for tablet eeb77a056e494d5ab85138d8ecc52db9 with delete_type TABLET_DATA_TOMBSTONED (TS 3d7bf587aa5a49eb92c3a53d17717149 not found in new config with opid_index 257) from {username='slave'} at 127.0.0.1:39126
I20240502 01:58:26.458052 15273 tablet_replica.cc:330] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149: stopping tablet replica
I20240502 01:58:26.458868 15273 raft_consensus.cc:2229] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:26.459568 15273 pending_rounds.cc:62] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149: Trying to abort 1 pending ops.
I20240502 01:58:26.459663 15273 pending_rounds.cc:68] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149: Aborting op as it isn't in flight: id { term: 2 index: 256 } timestamp: 7023063475506892800 op_type: WRITE_OP write_request { tablet_id: "eeb77a056e494d5ab85138d8ecc52db9" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\277\023f\n\271\006\232]\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""1f3e13cec90cd477" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7023063475337887744 authz_token { token_data: "\010\342\350\313\261\006\"3\n\005slave\022*\n 744919a455134d42b3ec60abe824250b\020\001\030\001 \001(\001" signature: "<redacted>""\002\267\206\210\030\"\354\242\r\027\227\207se7x\334S\331>\262=\246\210<\263i\236\355M)^9\232%\233\242\272-\332\225\022\230\200Ze\240\221\267\303\"\206\"\017[\336\244\354\205`\031\237\224\211" signing_key_seq_num: 0 } } request_id { client_id: "089b9f7ab77b4cffa72ac1866c54682e" seq_no: 717 first_incomplete_seq_no: 717 attempt_no: 0 }
I20240502 01:58:26.460811 15273 raft_consensus.cc:2258] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:26.479014 15273 ts_tablet_manager.cc:1875] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:26.481256 15273 ts_tablet_manager.cc:1888] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.256
I20240502 01:58:26.482412 13336 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 2 FOLLOWER]: Committing config change with OpId 2.257: config changed from index 247 to 257, VOTER 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196) evicted. New config: { opid_index: 257 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } }
I20240502 01:58:26.498126 15273 log.cc:1196] T eeb77a056e494d5ab85138d8ecc52db9 P 3d7bf587aa5a49eb92c3a53d17717149: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/eeb77a056e494d5ab85138d8ecc52db9
I20240502 01:58:26.499747 12648 catalog_manager.cc:4830] TS 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825): tablet eeb77a056e494d5ab85138d8ecc52db9 (table rebalance_test_table_1 [id=744919a455134d42b3ec60abe824250b]) successfully deleted
I20240502 01:58:26.535043 13071 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 2 FOLLOWER]: Committing config change with OpId 2.257: config changed from index 247 to 257, VOTER 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196) evicted. New config: { opid_index: 257 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } }
I20240502 01:58:26.845379 13452 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:26.852070 14349 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:26.923775 12918 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:26.938485 13321 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:26.948416 13185 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:58:26.952250 12784 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:26.954324 13051 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:27.835022 14349 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:27.850836 13452 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:27.926685 12784 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:27.928520 13185 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:58:27.969101 13321 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
W20240502 01:58:27.982153 12873 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.133.195:33887, user_credentials={real_user=slave}} blocked reactor thread for 45052.4us
I20240502 01:58:28.103380 13051 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:28.151671 12918 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
W20240502 01:58:28.505638 13409 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.10.133.197:42283, user_credentials={real_user=slave}} blocked reactor thread for 63117.6us
I20240502 01:58:29.506327 14349 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:29.519776 13452 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:29.560182 12918 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:29.568605 13051 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:29.603695 13185 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:58:29.640544 12784 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:29.652272 13321 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:30.123405 13185 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:58:30.184141 12918 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:30.193465 13321 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:30.195808 14349 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:30.228407 13452 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:30.263198 13051 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:30.272660 12784 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:30.725590 13452 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:30.726115 12784 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:30.727284 13185 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:58:30.733712 12918 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:30.740188 14349 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:30.741714 13321 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:30.751113 13051 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
cbd2873c124c4aadb8dc3e7d69935b04 | 127.10.133.254:41317 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
allow_unsafe_replication_factor | true | runtime,unsafe | all 1 server(s) checked
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
raft_prepare_replacement_before_eviction | true | experimental,advanced | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.133.212:37675 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
1928367ae8d64ba49a7f5761b2d3dc4a | 127.10.133.198:39759 | HEALTHY | <none> | 2 | 0
1ef9768a03e545fba961cfeee4c1c867 | 127.10.133.199:34821 | HEALTHY | <none> | 0 | 0
27e2acacdad14caa8f66bc81fa8a2f88 | 127.10.133.193:46263 | HEALTHY | <none> | 9 | 0
3d7bf587aa5a49eb92c3a53d17717149 | 127.10.133.196:32825 | HEALTHY | <none> | 1 | 0
42bc78875b454c7ab7fce86d56a28c1e | 127.10.133.194:40143 | HEALTHY | <none> | 2 | 0
6b1e63d6b84a440a8864db2d36b57665 | 127.10.133.197:42283 | HEALTHY | <none> | 2 | 0
71010353c29d4e988704295c8cd73ef7 | 127.10.133.195:33887 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 7
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
ipki_server_key_size | 768 | experimental | all 7 server(s) checked
local_ip_for_outbound_sockets | 127.10.133.193 | experimental | 127.10.133.193:46263
local_ip_for_outbound_sockets | 127.10.133.194 | experimental | 127.10.133.194:40143
local_ip_for_outbound_sockets | 127.10.133.195 | experimental | 127.10.133.195:33887
local_ip_for_outbound_sockets | 127.10.133.196 | experimental | 127.10.133.196:32825
local_ip_for_outbound_sockets | 127.10.133.197 | experimental | 127.10.133.197:42283
local_ip_for_outbound_sockets | 127.10.133.198 | experimental | 127.10.133.198:39759
local_ip_for_outbound_sockets | 127.10.133.199 | experimental | 127.10.133.199:34821
never_fsync | true | unsafe,advanced | all 7 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 7 server(s) checked
raft_prepare_replacement_before_eviction | true | experimental,advanced | all 7 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 7 server(s) checked
server_dump_info_format | pb | hidden | all 7 server(s) checked
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.10.133.193:46263
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.10.133.194:40143
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.10.133.195:33887
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb | hidden | 127.10.133.196:32825
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/info.pb | hidden | 127.10.133.197:42283
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/info.pb | hidden | 127.10.133.198:39759
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/info.pb | hidden | 127.10.133.199:34821
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.133.212:37675 | all 7 server(s) checked
time_source | builtin | all 7 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 8 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
------------------------+----+---------+---------------+---------+------------+------------------+-------------
TestTable | 5 | HEALTHY | 1 | 1 | 0 | 0 | 0
rebalance_test_table_0 | 5 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_1 | 5 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_2 | 5 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_3 | 5 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_4 | 5 | HEALTHY | 3 | 3 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 11
First Quartile | 11
Median | 11
Third Quartile | 12
Maximum | 12
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 7
Tables | 6
Tablets | 16
Replicas | 80
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20240502 01:58:30.804620 10775 log_verifier.cc:126] Checking tablet 16195ae890d445e39ed7ecdadde3009c
I20240502 01:58:30.930298 10775 log_verifier.cc:177] Verified matching terms for 194 ops in tablet 16195ae890d445e39ed7ecdadde3009c
I20240502 01:58:30.930539 10775 log_verifier.cc:126] Checking tablet 24d91cbbc7cb4be7a0034613b96ac1cd
I20240502 01:58:31.057909 10775 log_verifier.cc:177] Verified matching terms for 232 ops in tablet 24d91cbbc7cb4be7a0034613b96ac1cd
I20240502 01:58:31.058125 10775 log_verifier.cc:126] Checking tablet 281ea2fa1f9f49cebd4bb3620335168a
I20240502 01:58:31.174734 10775 log_verifier.cc:177] Verified matching terms for 188 ops in tablet 281ea2fa1f9f49cebd4bb3620335168a
I20240502 01:58:31.174897 10775 log_verifier.cc:126] Checking tablet 2963f09accd44e3db75d2f2c9b38b6cd
I20240502 01:58:31.313355 10775 log_verifier.cc:177] Verified matching terms for 224 ops in tablet 2963f09accd44e3db75d2f2c9b38b6cd
I20240502 01:58:31.313540 10775 log_verifier.cc:126] Checking tablet 400199df936243f2b49a4b556f29c575
I20240502 01:58:31.436888 10775 log_verifier.cc:177] Verified matching terms for 208 ops in tablet 400199df936243f2b49a4b556f29c575
I20240502 01:58:31.437062 10775 log_verifier.cc:126] Checking tablet 5175c37ef65f4f2fb83d64497592a180
I20240502 01:58:31.559840 10775 log_verifier.cc:177] Verified matching terms for 197 ops in tablet 5175c37ef65f4f2fb83d64497592a180
I20240502 01:58:31.560001 10775 log_verifier.cc:126] Checking tablet 52775623e580480b83a6148e0b453ae5
I20240502 01:58:31.605926 10775 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 52775623e580480b83a6148e0b453ae5
I20240502 01:58:31.606024 10775 log_verifier.cc:126] Checking tablet 6b4405ed71824af7bde2e54f5f592d10
I20240502 01:58:31.756592 10775 log_verifier.cc:177] Verified matching terms for 277 ops in tablet 6b4405ed71824af7bde2e54f5f592d10
I20240502 01:58:31.756798 10775 log_verifier.cc:126] Checking tablet 6eef7d25de5541bbbc7576185e097ed1
I20240502 01:58:31.857672 10775 log_verifier.cc:177] Verified matching terms for 151 ops in tablet 6eef7d25de5541bbbc7576185e097ed1
I20240502 01:58:31.857831 10775 log_verifier.cc:126] Checking tablet 773b692c40df457caf7baea5a7b21c27
I20240502 01:58:31.960431 10775 log_verifier.cc:177] Verified matching terms for 155 ops in tablet 773b692c40df457caf7baea5a7b21c27
I20240502 01:58:31.960584 10775 log_verifier.cc:126] Checking tablet 8ec2e7e6494c42749311d109abfdd205
I20240502 01:58:32.118605 10775 log_verifier.cc:177] Verified matching terms for 304 ops in tablet 8ec2e7e6494c42749311d109abfdd205
I20240502 01:58:32.118831 10775 log_verifier.cc:126] Checking tablet a8e8a2483ab8452f9b798930ebc069ac
I20240502 01:58:32.286705 10775 log_verifier.cc:177] Verified matching terms for 336 ops in tablet a8e8a2483ab8452f9b798930ebc069ac
I20240502 01:58:32.286914 10775 log_verifier.cc:126] Checking tablet bc637bf633fc4fe58db54a6bc0821417
I20240502 01:58:32.461639 10775 log_verifier.cc:177] Verified matching terms for 344 ops in tablet bc637bf633fc4fe58db54a6bc0821417
I20240502 01:58:32.461848 10775 log_verifier.cc:126] Checking tablet eb9d0001da2643ed8a9d78e79e30fccd
I20240502 01:58:32.565052 10775 log_verifier.cc:177] Verified matching terms for 155 ops in tablet eb9d0001da2643ed8a9d78e79e30fccd
I20240502 01:58:32.565172 10775 log_verifier.cc:126] Checking tablet eeb77a056e494d5ab85138d8ecc52db9
I20240502 01:58:32.731552 10775 log_verifier.cc:177] Verified matching terms for 308 ops in tablet eeb77a056e494d5ab85138d8ecc52db9
I20240502 01:58:32.731765 10775 log_verifier.cc:126] Checking tablet f1e0f3e6a85b4998bdaaf83117af6f20
I20240502 01:58:32.896849 10775 log_verifier.cc:177] Verified matching terms for 325 ops in tablet f1e0f3e6a85b4998bdaaf83117af6f20
I20240502 01:58:32.899011 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.200:0
--local_ip_for_outbound_sockets=127.10.133.200
--webserver_interface=127.10.133.200
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41317
--builtin_ntp_servers=127.10.133.212:37675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 01:58:33.016363 15569 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:33.016646 15569 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:33.016702 15569 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:33.020390 15569 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:33.020467 15569 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:33.020570 15569 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.200
I20240502 01:58:33.024544 15569 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:37675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.200:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--webserver_interface=127.10.133.200
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41317
--never_fsync=true
--heap_profile_path=/tmp/kudu.15569
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.200
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:33.025449 15569 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:33.026624 15569 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:33.036123 15574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:33.036597 15577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:33.037477 15575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:33.038430 15569 server_base.cc:1034] running on GCE node
I20240502 01:58:33.038933 15569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:33.039641 15569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:33.040805 15569 hybrid_clock.cc:648] HybridClock initialized: now 1714615113040781 us; error 44 us; skew 500 ppm
I20240502 01:58:33.042744 15569 webserver.cc:460] Webserver started at http://127.10.133.200:39715/ using document root <none> and password file <none>
I20240502 01:58:33.043315 15569 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:33.043375 15569 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:33.043568 15569 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:33.045290 15569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/instance:
uuid: "6414b27f8e3f4f66ba81b2e9598caf27"
format_stamp: "Formatted at 2024-05-02 01:58:33 on dist-test-slave-dr9f"
I20240502 01:58:33.045782 15569 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal/instance:
uuid: "6414b27f8e3f4f66ba81b2e9598caf27"
format_stamp: "Formatted at 2024-05-02 01:58:33 on dist-test-slave-dr9f"
I20240502 01:58:33.049253 15569 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20240502 01:58:33.051654 15583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:33.052845 15569 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:33.053011 15569 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
uuid: "6414b27f8e3f4f66ba81b2e9598caf27"
format_stamp: "Formatted at 2024-05-02 01:58:33 on dist-test-slave-dr9f"
I20240502 01:58:33.053138 15569 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:33.086263 15569 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:33.087003 15569 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:33.087152 15569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:33.087707 15569 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:33.088670 15569 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:33.088724 15569 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:33.088768 15569 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:33.088788 15569 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:33.098260 15569 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.200:46103
I20240502 01:58:33.098294 15698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.200:46103 every 8 connection(s)
I20240502 01:58:33.099218 15569 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/info.pb
I20240502 01:58:33.107762 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 15569
I20240502 01:58:33.107903 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal/instance
I20240502 01:58:33.108330 15699 heartbeater.cc:347] Connected to a master server at 127.10.133.254:41317
I20240502 01:58:33.108548 15699 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:33.109081 15699 heartbeater.cc:511] Master 127.10.133.254:41317 requested a full tablet report, sending...
I20240502 01:58:33.110175 12657 ts_manager.cc:194] Registered new tserver with Master: 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200:46103)
I20240502 01:58:33.111033 12657 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.200:52609
I20240502 01:58:33.315480 13452 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:33.315483 12918 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:33.325742 12784 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:33.326174 14349 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:33.329201 15632 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:33.335642 13185 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:58:33.341590 13321 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:33.360927 13051 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:33.449281 14349 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:33.453610 13185 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:58:33.453826 13452 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:33.457583 13321 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:33.459465 15632 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:33.466159 12784 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:33.482856 12918 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:33.484185 13051 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:33.532917 12804 consensus_queue.cc:237] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 188, Committed index: 188, Last appended: 1.188, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 189 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:33.534878 13205 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 188. Preceding OpId from leader: term: 1 index: 189. (index mismatch)
I20240502 01:58:33.535270 15398 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 189, Last known committed idx: 188, Time since last communication: 0.000s
I20240502 01:58:33.535405 13473 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 188. Preceding OpId from leader: term: 1 index: 189. (index mismatch)
I20240502 01:58:33.535403 12935 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 188. Preceding OpId from leader: term: 1 index: 189. (index mismatch)
I20240502 01:58:33.535790 15398 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 189, Last known committed idx: 188, Time since last communication: 0.000s
I20240502 01:58:33.535941 13073 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 188. Preceding OpId from leader: term: 1 index: 189. (index mismatch)
I20240502 01:58:33.536742 15398 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 189, Last known committed idx: 188, Time since last communication: 0.000s
I20240502 01:58:33.536899 15794 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 189, Last known committed idx: 188, Time since last communication: 0.000s
I20240502 01:58:33.538950 15398 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.189: config changed from index 56 to 189, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 189 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.539270 13073 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.189: config changed from index 56 to 189, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 189 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.539728 12935 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.189: config changed from index 56 to 189, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 189 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
W20240502 01:58:33.540648 12738 consensus_peers.cc:485] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 -> Peer 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200:46103): Couldn't send request to peer 6414b27f8e3f4f66ba81b2e9598caf27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 281ea2fa1f9f49cebd4bb3620335168a. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:33.541291 13205 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.189: config changed from index 56 to 189, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 189 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.542459 12655 catalog_manager.cc:5484] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e reported cstate change: config changed from index 56 to 189, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 189 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.543226 13473 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.189: config changed from index 56 to 189, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 189 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.553421 12935 consensus_queue.cc:237] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 151, Committed index: 151, Last appended: 1.151, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 152 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:33.555433 13073 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 151. Preceding OpId from leader: term: 1 index: 152. (index mismatch)
I20240502 01:58:33.555433 14363 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 151. Preceding OpId from leader: term: 1 index: 152. (index mismatch)
I20240502 01:58:33.555493 13205 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 151. Preceding OpId from leader: term: 1 index: 152. (index mismatch)
I20240502 01:58:33.555871 15814 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 152, Last known committed idx: 151, Time since last communication: 0.000s
I20240502 01:58:33.556105 15409 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 152, Last known committed idx: 151, Time since last communication: 0.000s
I20240502 01:58:33.556460 15409 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 152, Last known committed idx: 151, Time since last communication: 0.000s
I20240502 01:58:33.556614 12804 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 151. Preceding OpId from leader: term: 1 index: 152. (index mismatch)
I20240502 01:58:33.557816 15409 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 152, Last known committed idx: 151, Time since last communication: 0.000s
I20240502 01:58:33.558847 15409 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 LEADER]: Committing config change with OpId 1.152: config changed from index 46 to 152, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 152 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.559238 13205 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.152: config changed from index 46 to 152, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 152 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
W20240502 01:58:33.560242 12870 consensus_peers.cc:485] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e -> Peer 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200:46103): Couldn't send request to peer 6414b27f8e3f4f66ba81b2e9598caf27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6eef7d25de5541bbbc7576185e097ed1. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:33.561017 13073 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.152: config changed from index 46 to 152, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 152 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.561790 14365 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.152: config changed from index 46 to 152, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 152 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.563038 12659 catalog_manager.cc:5484] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 reported cstate change: config changed from index 46 to 152, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "42bc78875b454c7ab7fce86d56a28c1e" committed_config { opid_index: 152 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.564927 12804 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Committing config change with OpId 1.152: config changed from index 46 to 152, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 152 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.573184 12804 consensus_queue.cc:237] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 336, Committed index: 336, Last appended: 1.336, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 337 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:33.574996 13205 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 336. Preceding OpId from leader: term: 1 index: 337. (index mismatch)
I20240502 01:58:33.575101 12935 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 336. Preceding OpId from leader: term: 1 index: 337. (index mismatch)
W20240502 01:58:33.575196 12738 consensus_peers.cc:485] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 -> Peer 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200:46103): Couldn't send request to peer 6414b27f8e3f4f66ba81b2e9598caf27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a8e8a2483ab8452f9b798930ebc069ac. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:33.575239 13336 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 336. Preceding OpId from leader: term: 1 index: 337. (index mismatch)
I20240502 01:58:33.575349 14365 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 336. Preceding OpId from leader: term: 1 index: 337. (index mismatch)
I20240502 01:58:33.575469 15794 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 337, Last known committed idx: 336, Time since last communication: 0.000s
I20240502 01:58:33.575671 15568 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 337, Last known committed idx: 336, Time since last communication: 0.000s
I20240502 01:58:33.575866 15795 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 337, Last known committed idx: 336, Time since last communication: 0.000s
I20240502 01:58:33.576023 15793 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 337, Last known committed idx: 336, Time since last communication: 0.000s
I20240502 01:58:33.577759 15795 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.337: config changed from index 146 to 337, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 337 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.578131 13205 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.337: config changed from index 146 to 337, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 337 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.578347 14365 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.337: config changed from index 146 to 337, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 337 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.580245 13336 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.337: config changed from index 146 to 337, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 337 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.580637 12935 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.337: config changed from index 146 to 337, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 337 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.581214 12656 catalog_manager.cc:5484] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867 reported cstate change: config changed from index 146 to 337, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 337 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.591392 12804 consensus_queue.cc:237] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 208, Committed index: 208, Last appended: 1.208, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:33.592808 13205 raft_consensus.cc:1261] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 208. Preceding OpId from leader: term: 1 index: 209. (index mismatch)
I20240502 01:58:33.592917 13073 raft_consensus.cc:1261] T 400199df936243f2b49a4b556f29c575 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 208. Preceding OpId from leader: term: 1 index: 209. (index mismatch)
I20240502 01:58:33.592933 13473 raft_consensus.cc:1261] T 400199df936243f2b49a4b556f29c575 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 208. Preceding OpId from leader: term: 1 index: 209. (index mismatch)
I20240502 01:58:33.593230 15568 consensus_queue.cc:1035] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 209, Last known committed idx: 208, Time since last communication: 0.000s
I20240502 01:58:33.593400 15398 consensus_queue.cc:1035] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 209, Last known committed idx: 208, Time since last communication: 0.000s
W20240502 01:58:33.593688 12738 consensus_peers.cc:485] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 -> Peer 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200:46103): Couldn't send request to peer 6414b27f8e3f4f66ba81b2e9598caf27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 400199df936243f2b49a4b556f29c575. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:33.594092 12935 raft_consensus.cc:1261] T 400199df936243f2b49a4b556f29c575 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 208. Preceding OpId from leader: term: 1 index: 209. (index mismatch)
I20240502 01:58:33.594169 15568 consensus_queue.cc:1035] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 209, Last known committed idx: 208, Time since last communication: 0.000s
I20240502 01:58:33.594470 15398 consensus_queue.cc:1035] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 209, Last known committed idx: 208, Time since last communication: 0.000s
I20240502 01:58:33.596321 15793 raft_consensus.cc:2932] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.209: config changed from index -1 to 209, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.596742 12935 raft_consensus.cc:2932] T 400199df936243f2b49a4b556f29c575 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.209: config changed from index -1 to 209, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.598644 13205 raft_consensus.cc:2932] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.209: config changed from index -1 to 209, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.598825 13073 raft_consensus.cc:2932] T 400199df936243f2b49a4b556f29c575 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.209: config changed from index -1 to 209, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.599032 12661 catalog_manager.cc:5484] T 400199df936243f2b49a4b556f29c575 P 42bc78875b454c7ab7fce86d56a28c1e reported cstate change: config changed from index -1 to 209, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.602473 13473 raft_consensus.cc:2932] T 400199df936243f2b49a4b556f29c575 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.209: config changed from index -1 to 209, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.609539 13473 consensus_queue.cc:237] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 194, Committed index: 194, Last appended: 1.194, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 195 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:33.611418 14365 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 194. Preceding OpId from leader: term: 1 index: 195. (index mismatch)
I20240502 01:58:33.611449 13205 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 194. Preceding OpId from leader: term: 1 index: 195. (index mismatch)
I20240502 01:58:33.611878 13336 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 194. Preceding OpId from leader: term: 1 index: 195. (index mismatch)
I20240502 01:58:33.612054 13073 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 194. Preceding OpId from leader: term: 1 index: 195. (index mismatch)
I20240502 01:58:33.612021 15850 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 195, Last known committed idx: 194, Time since last communication: 0.000s
I20240502 01:58:33.612428 15852 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 195, Last known committed idx: 194, Time since last communication: 0.000s
I20240502 01:58:33.612668 14199 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 195, Last known committed idx: 194, Time since last communication: 0.000s
I20240502 01:58:33.612803 15849 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 195, Last known committed idx: 194, Time since last communication: 0.000s
I20240502 01:58:33.615171 15850 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 LEADER]: Committing config change with OpId 1.195: config changed from index 46 to 195, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 195 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.615657 13073 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.195: config changed from index 46 to 195, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 195 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.615811 13336 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.195: config changed from index 46 to 195, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 195 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
W20240502 01:58:33.617102 13406 consensus_peers.cc:485] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a -> Peer 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200:46103): Couldn't send request to peer 6414b27f8e3f4f66ba81b2e9598caf27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16195ae890d445e39ed7ecdadde3009c. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:33.618247 13205 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.195: config changed from index 46 to 195, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 195 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.618515 12659 catalog_manager.cc:5484] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 reported cstate change: config changed from index 46 to 195, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" committed_config { opid_index: 195 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:33.620887 14365 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.195: config changed from index 46 to 195, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 195 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:34.030483 15909 ts_tablet_manager.cc:902] T a8e8a2483ab8452f9b798930ebc069ac P 6414b27f8e3f4f66ba81b2e9598caf27: Initiating tablet copy from peer 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263)
I20240502 01:58:34.031387 15909 tablet_copy_client.cc:308] T a8e8a2483ab8452f9b798930ebc069ac P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:46263
I20240502 01:58:34.036818 12825 tablet_copy_service.cc:140] P 27e2acacdad14caa8f66bc81fa8a2f88: Received BeginTabletCopySession request for tablet a8e8a2483ab8452f9b798930ebc069ac from peer 6414b27f8e3f4f66ba81b2e9598caf27 ({username='slave'} at 127.10.133.200:44847)
I20240502 01:58:34.036913 12825 tablet_copy_service.cc:161] P 27e2acacdad14caa8f66bc81fa8a2f88: Beginning new tablet copy session on tablet a8e8a2483ab8452f9b798930ebc069ac from peer 6414b27f8e3f4f66ba81b2e9598caf27 at {username='slave'} at 127.10.133.200:44847: session id = 6414b27f8e3f4f66ba81b2e9598caf27-a8e8a2483ab8452f9b798930ebc069ac
I20240502 01:58:34.037629 12825 tablet_copy_source_session.cc:205] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:34.041646 15909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8e8a2483ab8452f9b798930ebc069ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:34.049026 15909 tablet_copy_client.cc:783] T a8e8a2483ab8452f9b798930ebc069ac P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:34.049280 15909 tablet_copy_client.cc:647] T a8e8a2483ab8452f9b798930ebc069ac P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:34.052603 15909 tablet_copy_client.cc:523] T a8e8a2483ab8452f9b798930ebc069ac P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:34.054589 15909 tablet_bootstrap.cc:492] T a8e8a2483ab8452f9b798930ebc069ac P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap starting.
I20240502 01:58:34.079145 15909 log.cc:824] T a8e8a2483ab8452f9b798930ebc069ac P 6414b27f8e3f4f66ba81b2e9598caf27: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:34.112959 15699 heartbeater.cc:503] Master 127.10.133.254:41317 was elected leader, sending a full tablet report...
I20240502 01:58:34.130414 15936 ts_tablet_manager.cc:902] T 281ea2fa1f9f49cebd4bb3620335168a P 6414b27f8e3f4f66ba81b2e9598caf27: Initiating tablet copy from peer 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263)
I20240502 01:58:34.131584 15936 tablet_copy_client.cc:308] T 281ea2fa1f9f49cebd4bb3620335168a P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:46263
I20240502 01:58:34.132074 12825 tablet_copy_service.cc:140] P 27e2acacdad14caa8f66bc81fa8a2f88: Received BeginTabletCopySession request for tablet 281ea2fa1f9f49cebd4bb3620335168a from peer 6414b27f8e3f4f66ba81b2e9598caf27 ({username='slave'} at 127.10.133.200:44847)
I20240502 01:58:34.132189 12825 tablet_copy_service.cc:161] P 27e2acacdad14caa8f66bc81fa8a2f88: Beginning new tablet copy session on tablet 281ea2fa1f9f49cebd4bb3620335168a from peer 6414b27f8e3f4f66ba81b2e9598caf27 at {username='slave'} at 127.10.133.200:44847: session id = 6414b27f8e3f4f66ba81b2e9598caf27-281ea2fa1f9f49cebd4bb3620335168a
I20240502 01:58:34.133323 12825 tablet_copy_source_session.cc:205] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:34.138451 15936 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281ea2fa1f9f49cebd4bb3620335168a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:34.141305 15936 tablet_copy_client.cc:783] T 281ea2fa1f9f49cebd4bb3620335168a P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:34.141506 15936 tablet_copy_client.cc:647] T 281ea2fa1f9f49cebd4bb3620335168a P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:34.142097 15946 ts_tablet_manager.cc:902] T 16195ae890d445e39ed7ecdadde3009c P 6414b27f8e3f4f66ba81b2e9598caf27: Initiating tablet copy from peer 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759)
I20240502 01:58:34.142645 15946 tablet_copy_client.cc:308] T 16195ae890d445e39ed7ecdadde3009c P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.198:39759
I20240502 01:58:34.143788 15936 tablet_copy_client.cc:523] T 281ea2fa1f9f49cebd4bb3620335168a P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:34.148139 13493 tablet_copy_service.cc:140] P 1928367ae8d64ba49a7f5761b2d3dc4a: Received BeginTabletCopySession request for tablet 16195ae890d445e39ed7ecdadde3009c from peer 6414b27f8e3f4f66ba81b2e9598caf27 ({username='slave'} at 127.10.133.200:40057)
I20240502 01:58:34.148272 13493 tablet_copy_service.cc:161] P 1928367ae8d64ba49a7f5761b2d3dc4a: Beginning new tablet copy session on tablet 16195ae890d445e39ed7ecdadde3009c from peer 6414b27f8e3f4f66ba81b2e9598caf27 at {username='slave'} at 127.10.133.200:40057: session id = 6414b27f8e3f4f66ba81b2e9598caf27-16195ae890d445e39ed7ecdadde3009c
I20240502 01:58:34.149555 13493 tablet_copy_source_session.cc:205] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:34.154966 15936 tablet_bootstrap.cc:492] T 281ea2fa1f9f49cebd4bb3620335168a P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap starting.
I20240502 01:58:34.155162 15946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16195ae890d445e39ed7ecdadde3009c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:34.161638 15946 tablet_copy_client.cc:783] T 16195ae890d445e39ed7ecdadde3009c P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:34.161942 15946 tablet_copy_client.cc:647] T 16195ae890d445e39ed7ecdadde3009c P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:34.166846 15946 tablet_copy_client.cc:523] T 16195ae890d445e39ed7ecdadde3009c P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:34.171366 15946 tablet_bootstrap.cc:492] T 16195ae890d445e39ed7ecdadde3009c P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap starting.
I20240502 01:58:34.176121 15953 ts_tablet_manager.cc:902] T 6eef7d25de5541bbbc7576185e097ed1 P 6414b27f8e3f4f66ba81b2e9598caf27: Initiating tablet copy from peer 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143)
I20240502 01:58:34.177326 15953 tablet_copy_client.cc:308] T 6eef7d25de5541bbbc7576185e097ed1 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:40143
I20240502 01:58:34.185456 12959 tablet_copy_service.cc:140] P 42bc78875b454c7ab7fce86d56a28c1e: Received BeginTabletCopySession request for tablet 6eef7d25de5541bbbc7576185e097ed1 from peer 6414b27f8e3f4f66ba81b2e9598caf27 ({username='slave'} at 127.10.133.200:45501)
I20240502 01:58:34.185570 12959 tablet_copy_service.cc:161] P 42bc78875b454c7ab7fce86d56a28c1e: Beginning new tablet copy session on tablet 6eef7d25de5541bbbc7576185e097ed1 from peer 6414b27f8e3f4f66ba81b2e9598caf27 at {username='slave'} at 127.10.133.200:45501: session id = 6414b27f8e3f4f66ba81b2e9598caf27-6eef7d25de5541bbbc7576185e097ed1
I20240502 01:58:34.186614 12959 tablet_copy_source_session.cc:205] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:34.187608 15953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eef7d25de5541bbbc7576185e097ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:34.190078 15953 tablet_copy_client.cc:783] T 6eef7d25de5541bbbc7576185e097ed1 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:34.190282 15953 tablet_copy_client.cc:647] T 6eef7d25de5541bbbc7576185e097ed1 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:34.193962 15953 tablet_copy_client.cc:523] T 6eef7d25de5541bbbc7576185e097ed1 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:34.195336 15953 tablet_bootstrap.cc:492] T 6eef7d25de5541bbbc7576185e097ed1 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap starting.
I20240502 01:58:34.215524 15959 ts_tablet_manager.cc:902] T 400199df936243f2b49a4b556f29c575 P 6414b27f8e3f4f66ba81b2e9598caf27: Initiating tablet copy from peer 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263)
I20240502 01:58:34.216737 15959 tablet_copy_client.cc:308] T 400199df936243f2b49a4b556f29c575 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:46263
I20240502 01:58:34.217363 12825 tablet_copy_service.cc:140] P 27e2acacdad14caa8f66bc81fa8a2f88: Received BeginTabletCopySession request for tablet 400199df936243f2b49a4b556f29c575 from peer 6414b27f8e3f4f66ba81b2e9598caf27 ({username='slave'} at 127.10.133.200:44847)
I20240502 01:58:34.217470 12825 tablet_copy_service.cc:161] P 27e2acacdad14caa8f66bc81fa8a2f88: Beginning new tablet copy session on tablet 400199df936243f2b49a4b556f29c575 from peer 6414b27f8e3f4f66ba81b2e9598caf27 at {username='slave'} at 127.10.133.200:44847: session id = 6414b27f8e3f4f66ba81b2e9598caf27-400199df936243f2b49a4b556f29c575
I20240502 01:58:34.218482 12825 tablet_copy_source_session.cc:205] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:34.219408 15959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 400199df936243f2b49a4b556f29c575. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:34.221859 15959 tablet_copy_client.cc:783] T 400199df936243f2b49a4b556f29c575 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:34.222085 15959 tablet_copy_client.cc:647] T 400199df936243f2b49a4b556f29c575 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:34.232312 15959 tablet_copy_client.cc:523] T 400199df936243f2b49a4b556f29c575 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:34.242930 15959 tablet_bootstrap.cc:492] T 400199df936243f2b49a4b556f29c575 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap starting.
I20240502 01:58:34.364266 15909 tablet_bootstrap.cc:492] T a8e8a2483ab8452f9b798930ebc069ac P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap replayed 1/1 log segments. Stats: ops{read=337 overwritten=0 applied=337 ignored=0} inserts{seen=1006 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:34.364814 15909 tablet_bootstrap.cc:492] T a8e8a2483ab8452f9b798930ebc069ac P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap complete.
I20240502 01:58:34.365360 15909 ts_tablet_manager.cc:1367] T a8e8a2483ab8452f9b798930ebc069ac P 6414b27f8e3f4f66ba81b2e9598caf27: Time spent bootstrapping tablet: real 0.311s user 0.241s sys 0.017s
I20240502 01:58:34.368356 15909 raft_consensus.cc:348] T a8e8a2483ab8452f9b798930ebc069ac P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 337 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:34.368753 15909 raft_consensus.cc:729] T a8e8a2483ab8452f9b798930ebc069ac P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6414b27f8e3f4f66ba81b2e9598caf27, State: Initialized, Role: LEARNER
I20240502 01:58:34.369154 15909 consensus_queue.cc:260] T a8e8a2483ab8452f9b798930ebc069ac P 6414b27f8e3f4f66ba81b2e9598caf27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 337, Last appended: 1.337, Last appended by leader: 337, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 337 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:34.370265 15909 ts_tablet_manager.cc:1398] T a8e8a2483ab8452f9b798930ebc069ac P 6414b27f8e3f4f66ba81b2e9598caf27: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:58:34.371601 12825 tablet_copy_service.cc:342] P 27e2acacdad14caa8f66bc81fa8a2f88: Request end of tablet copy session 6414b27f8e3f4f66ba81b2e9598caf27-a8e8a2483ab8452f9b798930ebc069ac received from {username='slave'} at 127.10.133.200:44847
I20240502 01:58:34.371678 12825 tablet_copy_service.cc:433] P 27e2acacdad14caa8f66bc81fa8a2f88: ending tablet copy session 6414b27f8e3f4f66ba81b2e9598caf27-a8e8a2483ab8452f9b798930ebc069ac on tablet a8e8a2483ab8452f9b798930ebc069ac with peer 6414b27f8e3f4f66ba81b2e9598caf27
I20240502 01:58:34.413365 15953 tablet_bootstrap.cc:492] T 6eef7d25de5541bbbc7576185e097ed1 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap replayed 1/1 log segments. Stats: ops{read=152 overwritten=0 applied=152 ignored=0} inserts{seen=834 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:34.415920 15953 tablet_bootstrap.cc:492] T 6eef7d25de5541bbbc7576185e097ed1 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap complete.
I20240502 01:58:34.416920 15953 ts_tablet_manager.cc:1367] T 6eef7d25de5541bbbc7576185e097ed1 P 6414b27f8e3f4f66ba81b2e9598caf27: Time spent bootstrapping tablet: real 0.222s user 0.126s sys 0.007s
I20240502 01:58:34.417639 15953 raft_consensus.cc:348] T 6eef7d25de5541bbbc7576185e097ed1 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 152 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:34.418633 15953 raft_consensus.cc:729] T 6eef7d25de5541bbbc7576185e097ed1 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6414b27f8e3f4f66ba81b2e9598caf27, State: Initialized, Role: LEARNER
I20240502 01:58:34.418843 15953 consensus_queue.cc:260] T 6eef7d25de5541bbbc7576185e097ed1 P 6414b27f8e3f4f66ba81b2e9598caf27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 152, Last appended: 1.152, Last appended by leader: 152, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 152 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:34.421440 15953 ts_tablet_manager.cc:1398] T 6eef7d25de5541bbbc7576185e097ed1 P 6414b27f8e3f4f66ba81b2e9598caf27: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240502 01:58:34.421948 12959 tablet_copy_service.cc:342] P 42bc78875b454c7ab7fce86d56a28c1e: Request end of tablet copy session 6414b27f8e3f4f66ba81b2e9598caf27-6eef7d25de5541bbbc7576185e097ed1 received from {username='slave'} at 127.10.133.200:45501
I20240502 01:58:34.422060 12959 tablet_copy_service.cc:433] P 42bc78875b454c7ab7fce86d56a28c1e: ending tablet copy session 6414b27f8e3f4f66ba81b2e9598caf27-6eef7d25de5541bbbc7576185e097ed1 on tablet 6eef7d25de5541bbbc7576185e097ed1 with peer 6414b27f8e3f4f66ba81b2e9598caf27
I20240502 01:58:34.437155 15946 tablet_bootstrap.cc:492] T 16195ae890d445e39ed7ecdadde3009c P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap replayed 1/1 log segments. Stats: ops{read=195 overwritten=0 applied=195 ignored=0} inserts{seen=877 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:34.437428 15946 tablet_bootstrap.cc:492] T 16195ae890d445e39ed7ecdadde3009c P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap complete.
I20240502 01:58:34.437618 15946 ts_tablet_manager.cc:1367] T 16195ae890d445e39ed7ecdadde3009c P 6414b27f8e3f4f66ba81b2e9598caf27: Time spent bootstrapping tablet: real 0.269s user 0.139s sys 0.021s
I20240502 01:58:34.438023 15946 raft_consensus.cc:348] T 16195ae890d445e39ed7ecdadde3009c P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 195 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:34.438210 15946 raft_consensus.cc:729] T 16195ae890d445e39ed7ecdadde3009c P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6414b27f8e3f4f66ba81b2e9598caf27, State: Initialized, Role: LEARNER
I20240502 01:58:34.438333 15946 consensus_queue.cc:260] T 16195ae890d445e39ed7ecdadde3009c P 6414b27f8e3f4f66ba81b2e9598caf27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 195 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:34.438599 15946 ts_tablet_manager.cc:1398] T 16195ae890d445e39ed7ecdadde3009c P 6414b27f8e3f4f66ba81b2e9598caf27: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 01:58:34.439090 13493 tablet_copy_service.cc:342] P 1928367ae8d64ba49a7f5761b2d3dc4a: Request end of tablet copy session 6414b27f8e3f4f66ba81b2e9598caf27-16195ae890d445e39ed7ecdadde3009c received from {username='slave'} at 127.10.133.200:40057
I20240502 01:58:34.439167 13493 tablet_copy_service.cc:433] P 1928367ae8d64ba49a7f5761b2d3dc4a: ending tablet copy session 6414b27f8e3f4f66ba81b2e9598caf27-16195ae890d445e39ed7ecdadde3009c on tablet 16195ae890d445e39ed7ecdadde3009c with peer 6414b27f8e3f4f66ba81b2e9598caf27
I20240502 01:58:34.444253 15936 tablet_bootstrap.cc:492] T 281ea2fa1f9f49cebd4bb3620335168a P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap replayed 1/1 log segments. Stats: ops{read=189 overwritten=0 applied=189 ignored=0} inserts{seen=817 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:34.444557 15936 tablet_bootstrap.cc:492] T 281ea2fa1f9f49cebd4bb3620335168a P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap complete.
I20240502 01:58:34.444763 15936 ts_tablet_manager.cc:1367] T 281ea2fa1f9f49cebd4bb3620335168a P 6414b27f8e3f4f66ba81b2e9598caf27: Time spent bootstrapping tablet: real 0.290s user 0.145s sys 0.015s
I20240502 01:58:34.445152 15936 raft_consensus.cc:348] T 281ea2fa1f9f49cebd4bb3620335168a P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 189 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:34.445302 15936 raft_consensus.cc:729] T 281ea2fa1f9f49cebd4bb3620335168a P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6414b27f8e3f4f66ba81b2e9598caf27, State: Initialized, Role: LEARNER
I20240502 01:58:34.445451 15936 consensus_queue.cc:260] T 281ea2fa1f9f49cebd4bb3620335168a P 6414b27f8e3f4f66ba81b2e9598caf27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 189 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:34.445879 15936 ts_tablet_manager.cc:1398] T 281ea2fa1f9f49cebd4bb3620335168a P 6414b27f8e3f4f66ba81b2e9598caf27: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 01:58:34.446372 12825 tablet_copy_service.cc:342] P 27e2acacdad14caa8f66bc81fa8a2f88: Request end of tablet copy session 6414b27f8e3f4f66ba81b2e9598caf27-281ea2fa1f9f49cebd4bb3620335168a received from {username='slave'} at 127.10.133.200:44847
I20240502 01:58:34.446457 12825 tablet_copy_service.cc:433] P 27e2acacdad14caa8f66bc81fa8a2f88: ending tablet copy session 6414b27f8e3f4f66ba81b2e9598caf27-281ea2fa1f9f49cebd4bb3620335168a on tablet 281ea2fa1f9f49cebd4bb3620335168a with peer 6414b27f8e3f4f66ba81b2e9598caf27
I20240502 01:58:34.452934 15959 tablet_bootstrap.cc:492] T 400199df936243f2b49a4b556f29c575 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap replayed 1/1 log segments. Stats: ops{read=209 overwritten=0 applied=209 ignored=0} inserts{seen=840 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:34.453161 15959 tablet_bootstrap.cc:492] T 400199df936243f2b49a4b556f29c575 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap complete.
I20240502 01:58:34.453295 15959 ts_tablet_manager.cc:1367] T 400199df936243f2b49a4b556f29c575 P 6414b27f8e3f4f66ba81b2e9598caf27: Time spent bootstrapping tablet: real 0.210s user 0.140s sys 0.022s
I20240502 01:58:34.453606 15959 raft_consensus.cc:348] T 400199df936243f2b49a4b556f29c575 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:34.453693 15959 raft_consensus.cc:729] T 400199df936243f2b49a4b556f29c575 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6414b27f8e3f4f66ba81b2e9598caf27, State: Initialized, Role: LEARNER
I20240502 01:58:34.453760 15959 consensus_queue.cc:260] T 400199df936243f2b49a4b556f29c575 P 6414b27f8e3f4f66ba81b2e9598caf27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 209, Last appended: 1.209, Last appended by leader: 209, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 209 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:34.454006 15959 ts_tablet_manager.cc:1398] T 400199df936243f2b49a4b556f29c575 P 6414b27f8e3f4f66ba81b2e9598caf27: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 01:58:34.454418 12825 tablet_copy_service.cc:342] P 27e2acacdad14caa8f66bc81fa8a2f88: Request end of tablet copy session 6414b27f8e3f4f66ba81b2e9598caf27-400199df936243f2b49a4b556f29c575 received from {username='slave'} at 127.10.133.200:44847
I20240502 01:58:34.454500 12825 tablet_copy_service.cc:433] P 27e2acacdad14caa8f66bc81fa8a2f88: ending tablet copy session 6414b27f8e3f4f66ba81b2e9598caf27-400199df936243f2b49a4b556f29c575 on tablet 400199df936243f2b49a4b556f29c575 with peer 6414b27f8e3f4f66ba81b2e9598caf27
I20240502 01:58:34.524506 15653 raft_consensus.cc:1203] T 16195ae890d445e39ed7ecdadde3009c P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.194->[1.195-1.195] Dedup: 1.195->[]
I20240502 01:58:34.562599 15653 raft_consensus.cc:1203] T 6eef7d25de5541bbbc7576185e097ed1 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.151->[1.152-1.152] Dedup: 1.152->[]
I20240502 01:58:34.625226 15653 raft_consensus.cc:1203] T a8e8a2483ab8452f9b798930ebc069ac P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.336->[1.337-1.337] Dedup: 1.337->[]
I20240502 01:58:34.631903 15653 raft_consensus.cc:1203] T 400199df936243f2b49a4b556f29c575 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.208->[1.209-1.209] Dedup: 1.209->[]
I20240502 01:58:34.673051 15653 raft_consensus.cc:1203] T 281ea2fa1f9f49cebd4bb3620335168a P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.188->[1.189-1.189] Dedup: 1.189->[]
I20240502 01:58:34.913923 15996 raft_consensus.cc:1050] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a: attempting to promote NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 to VOTER
I20240502 01:58:34.914371 15996 consensus_queue.cc:237] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 195, Committed index: 195, Last appended: 1.195, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 196 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } }
I20240502 01:58:34.916203 14365 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 195. Preceding OpId from leader: term: 1 index: 196. (index mismatch)
I20240502 01:58:34.916208 13205 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 195. Preceding OpId from leader: term: 1 index: 196. (index mismatch)
I20240502 01:58:34.916241 15653 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 195. Preceding OpId from leader: term: 1 index: 196. (index mismatch)
I20240502 01:58:34.916589 13336 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 195. Preceding OpId from leader: term: 1 index: 196. (index mismatch)
I20240502 01:58:34.916769 16052 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 196, Last known committed idx: 195, Time since last communication: 0.000s
I20240502 01:58:34.917090 16053 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 196, Last known committed idx: 195, Time since last communication: 0.000s
I20240502 01:58:34.917277 13073 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 195. Preceding OpId from leader: term: 1 index: 196. (index mismatch)
I20240502 01:58:34.917286 16054 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 196, Last known committed idx: 195, Time since last communication: 0.000s
I20240502 01:58:34.917598 15995 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 196, Last known committed idx: 195, Time since last communication: 0.000s
I20240502 01:58:34.917750 16052 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 196, Last known committed idx: 195, Time since last communication: 0.000s
I20240502 01:58:34.920276 16054 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 LEADER]: Committing config change with OpId 1.196: config changed from index 195 to 196, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 196 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:34.920678 13205 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.196: config changed from index 195 to 196, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 196 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:34.920851 13336 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.196: config changed from index 195 to 196, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 196 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:34.920809 15653 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Committing config change with OpId 1.196: config changed from index 195 to 196, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 196 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:34.923086 14365 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.196: config changed from index 195 to 196, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 196 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:34.923509 12655 catalog_manager.cc:5484] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 reported cstate change: config changed from index 195 to 196, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" committed_config { opid_index: 196 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:34.925267 13073 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.196: config changed from index 195 to 196, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 196 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:34.927681 13473 consensus_queue.cc:237] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 196, Committed index: 196, Last appended: 1.196, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 197 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } }
I20240502 01:58:34.929374 15653 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 196. Preceding OpId from leader: term: 1 index: 197. (index mismatch)
I20240502 01:58:34.929412 13205 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 196. Preceding OpId from leader: term: 1 index: 197. (index mismatch)
I20240502 01:58:34.929553 13336 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 196. Preceding OpId from leader: term: 1 index: 197. (index mismatch)
I20240502 01:58:34.929808 16052 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 197, Last known committed idx: 196, Time since last communication: 0.000s
I20240502 01:58:34.929945 16053 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 197, Last known committed idx: 196, Time since last communication: 0.000s
I20240502 01:58:34.930285 15995 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 197, Last known committed idx: 196, Time since last communication: 0.000s
I20240502 01:58:34.930914 13073 raft_consensus.cc:1261] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 196. Preceding OpId from leader: term: 1 index: 197. (index mismatch)
I20240502 01:58:34.931257 16052 consensus_queue.cc:1035] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 197, Last known committed idx: 196, Time since last communication: 0.000s
I20240502 01:58:34.932632 16053 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 LEADER]: Committing config change with OpId 1.197: config changed from index 196 to 197, VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) evicted. New config: { opid_index: 197 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:34.933568 13205 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.197: config changed from index 196 to 197, VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) evicted. New config: { opid_index: 197 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:34.934341 12649 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 16195ae890d445e39ed7ecdadde3009c with cas_config_opid_index 196: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:34.934430 13341 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.197: config changed from index 196 to 197, VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) evicted. New config: { opid_index: 197 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:34.934641 13073 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.197: config changed from index 196 to 197, VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) evicted. New config: { opid_index: 197 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:34.935937 12655 catalog_manager.cc:5484] T 16195ae890d445e39ed7ecdadde3009c P 3d7bf587aa5a49eb92c3a53d17717149 reported cstate change: config changed from index 196 to 197, VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) evicted. New cstate: current_term: 1 leader_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" committed_config { opid_index: 197 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:34.936300 15652 raft_consensus.cc:2932] T 16195ae890d445e39ed7ecdadde3009c P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Committing config change with OpId 1.197: config changed from index 196 to 197, VOTER 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199) evicted. New config: { opid_index: 197 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:34.943450 14349 tablet_service.cc:1514] Processing DeleteTablet for tablet 16195ae890d445e39ed7ecdadde3009c with delete_type TABLET_DATA_TOMBSTONED (TS 1ef9768a03e545fba961cfeee4c1c867 not found in new config with opid_index 197) from {username='slave'} at 127.0.0.1:54672
I20240502 01:58:34.943863 16068 tablet_replica.cc:330] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867: stopping tablet replica
I20240502 01:58:34.944123 16068 raft_consensus.cc:2229] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:34.944362 16068 raft_consensus.cc:2258] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:34.946066 16068 ts_tablet_manager.cc:1875] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:34.947849 16068 ts_tablet_manager.cc:1888] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.196
I20240502 01:58:34.947929 16068 log.cc:1196] T 16195ae890d445e39ed7ecdadde3009c P 1ef9768a03e545fba961cfeee4c1c867: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal/wals/16195ae890d445e39ed7ecdadde3009c
I20240502 01:58:34.948455 12648 catalog_manager.cc:4830] TS 1ef9768a03e545fba961cfeee4c1c867 (127.10.133.199:34821): tablet 16195ae890d445e39ed7ecdadde3009c (table rebalance_test_table_3 [id=e192d1fc91574f419257f076074a1378]) successfully deleted
I20240502 01:58:35.057299 15997 raft_consensus.cc:1050] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e: attempting to promote NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 to VOTER
I20240502 01:58:35.057849 15997 consensus_queue.cc:237] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 152, Committed index: 152, Last appended: 1.152, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 153 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } }
I20240502 01:58:35.059561 14365 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 152. Preceding OpId from leader: term: 1 index: 153. (index mismatch)
I20240502 01:58:35.059598 15652 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 152. Preceding OpId from leader: term: 1 index: 153. (index mismatch)
I20240502 01:58:35.059599 13069 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 152. Preceding OpId from leader: term: 1 index: 153. (index mismatch)
I20240502 01:58:35.060061 13205 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 152. Preceding OpId from leader: term: 1 index: 153. (index mismatch)
I20240502 01:58:35.060040 16070 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 153, Last known committed idx: 152, Time since last communication: 0.000s
I20240502 01:58:35.060257 15815 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 153, Last known committed idx: 152, Time since last communication: 0.000s
I20240502 01:58:35.060483 16071 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 153, Last known committed idx: 152, Time since last communication: 0.000s
I20240502 01:58:35.060657 15998 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 153, Last known committed idx: 152, Time since last communication: 0.000s
I20240502 01:58:35.060770 12804 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 152. Preceding OpId from leader: term: 1 index: 153. (index mismatch)
I20240502 01:58:35.061343 16071 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 153, Last known committed idx: 152, Time since last communication: 0.000s
I20240502 01:58:35.063023 16071 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 LEADER]: Committing config change with OpId 1.153: config changed from index 152 to 153, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 153 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.063501 13069 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.153: config changed from index 152 to 153, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 153 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.064296 15652 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Committing config change with OpId 1.153: config changed from index 152 to 153, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 153 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.065500 13203 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.153: config changed from index 152 to 153, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 153 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.066716 14365 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.153: config changed from index 152 to 153, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 153 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.067297 12661 catalog_manager.cc:5484] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 reported cstate change: config changed from index 152 to 153, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "42bc78875b454c7ab7fce86d56a28c1e" committed_config { opid_index: 153 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.069240 15999 raft_consensus.cc:1050] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88: attempting to promote NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 to VOTER
I20240502 01:58:35.069767 15999 consensus_queue.cc:237] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 189, Committed index: 189, Last appended: 1.189, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 190 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } }
I20240502 01:58:35.070345 12804 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Committing config change with OpId 1.153: config changed from index 152 to 153, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 153 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.071619 13473 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 189. Preceding OpId from leader: term: 1 index: 190. (index mismatch)
I20240502 01:58:35.071761 12935 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 189. Preceding OpId from leader: term: 1 index: 190. (index mismatch)
I20240502 01:58:35.072242 13069 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 189. Preceding OpId from leader: term: 1 index: 190. (index mismatch)
I20240502 01:58:35.072332 13203 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 189. Preceding OpId from leader: term: 1 index: 190. (index mismatch)
I20240502 01:58:35.072556 15398 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 190, Last known committed idx: 189, Time since last communication: 0.000s
I20240502 01:58:35.073235 16081 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 190, Last known committed idx: 189, Time since last communication: 0.000s
I20240502 01:58:35.073403 16080 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 190, Last known committed idx: 189, Time since last communication: 0.000s
I20240502 01:58:35.073648 16081 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 190, Last known committed idx: 189, Time since last communication: 0.000s
I20240502 01:58:35.076946 16080 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.190: config changed from index 189 to 190, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 190 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.077356 13069 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.190: config changed from index 189 to 190, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 190 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.077750 12935 consensus_queue.cc:237] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 153, Committed index: 153, Last appended: 1.153, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 154 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } }
I20240502 01:58:35.077926 15652 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 189. Preceding OpId from leader: term: 1 index: 190. (index mismatch)
I20240502 01:58:35.078444 16079 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 190, Last known committed idx: 189, Time since last communication: 0.000s
I20240502 01:58:35.079591 13203 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.190: config changed from index 189 to 190, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 190 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.079792 13069 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 153. Preceding OpId from leader: term: 1 index: 154. (index mismatch)
I20240502 01:58:35.080246 16070 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 154, Last known committed idx: 153, Time since last communication: 0.000s
I20240502 01:58:35.082270 12655 catalog_manager.cc:5484] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 reported cstate change: config changed from index 189 to 190, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 190 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.082558 14365 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 153. Preceding OpId from leader: term: 1 index: 154. (index mismatch)
I20240502 01:58:35.082938 16070 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 154, Last known committed idx: 153, Time since last communication: 0.000s
I20240502 01:58:35.084074 15653 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Committing config change with OpId 1.190: config changed from index 189 to 190, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 190 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.085043 16070 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 LEADER]: Committing config change with OpId 1.154: config changed from index 153 to 154, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 154 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.085800 14365 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.154: config changed from index 153 to 154, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 154 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.086645 12935 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.190: config changed from index 189 to 190, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 190 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.088480 13473 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.190: config changed from index 189 to 190, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 190 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.089466 12657 catalog_manager.cc:5484] T 6eef7d25de5541bbbc7576185e097ed1 P 1ef9768a03e545fba961cfeee4c1c867 reported cstate change: config changed from index 153 to 154, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "42bc78875b454c7ab7fce86d56a28c1e" committed_config { opid_index: 154 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.090713 12646 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 6eef7d25de5541bbbc7576185e097ed1 with cas_config_opid_index 153: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:35.091826 12784 tablet_service.cc:1514] Processing DeleteTablet for tablet 6eef7d25de5541bbbc7576185e097ed1 with delete_type TABLET_DATA_TOMBSTONED (TS 27e2acacdad14caa8f66bc81fa8a2f88 not found in new config with opid_index 154) from {username='slave'} at 127.0.0.1:51568
I20240502 01:58:35.092227 16087 tablet_replica.cc:330] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88: stopping tablet replica
I20240502 01:58:35.092363 16087 raft_consensus.cc:2229] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:35.092520 16087 raft_consensus.cc:2258] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:35.093919 13203 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 153. Preceding OpId from leader: term: 1 index: 154. (index mismatch)
I20240502 01:58:35.094043 16087 ts_tablet_manager.cc:1875] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:35.094326 15997 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 154, Last known committed idx: 153, Time since last communication: 0.000s
I20240502 01:58:35.094954 13069 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.154: config changed from index 153 to 154, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 154 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.096314 16087 ts_tablet_manager.cc:1888] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.153
I20240502 01:58:35.096434 16087 log.cc:1196] T 6eef7d25de5541bbbc7576185e097ed1 P 27e2acacdad14caa8f66bc81fa8a2f88: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/6eef7d25de5541bbbc7576185e097ed1
I20240502 01:58:35.096308 13203 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.154: config changed from index 153 to 154, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 154 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.096493 15652 raft_consensus.cc:1261] T 6eef7d25de5541bbbc7576185e097ed1 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Refusing update from remote peer 42bc78875b454c7ab7fce86d56a28c1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 153. Preceding OpId from leader: term: 1 index: 154. (index mismatch)
I20240502 01:58:35.096917 15997 consensus_queue.cc:1035] T 6eef7d25de5541bbbc7576185e097ed1 P 42bc78875b454c7ab7fce86d56a28c1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 154, Last known committed idx: 153, Time since last communication: 0.000s
I20240502 01:58:35.097700 12648 catalog_manager.cc:4830] TS 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263): tablet 6eef7d25de5541bbbc7576185e097ed1 (table rebalance_test_table_4 [id=8471dbb0ba2d474da8ff5cbfa12790d9]) successfully deleted
I20240502 01:58:35.098057 15652 raft_consensus.cc:2932] T 6eef7d25de5541bbbc7576185e097ed1 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Committing config change with OpId 1.154: config changed from index 153 to 154, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 154 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.133327 12804 consensus_queue.cc:237] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 155, Committed index: 155, Last appended: 1.155, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 156 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:35.134904 13473 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 155. Preceding OpId from leader: term: 1 index: 156. (index mismatch)
I20240502 01:58:35.134904 13341 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 155. Preceding OpId from leader: term: 1 index: 156. (index mismatch)
W20240502 01:58:35.134974 12738 consensus_peers.cc:485] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 -> Peer 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200:46103): Couldn't send request to peer 6414b27f8e3f4f66ba81b2e9598caf27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 773b692c40df457caf7baea5a7b21c27. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:35.135030 14365 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 155. Preceding OpId from leader: term: 1 index: 156. (index mismatch)
I20240502 01:58:35.135299 15954 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 156, Last known committed idx: 155, Time since last communication: 0.000s
I20240502 01:58:35.135373 13203 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 155. Preceding OpId from leader: term: 1 index: 156. (index mismatch)
I20240502 01:58:35.135488 16079 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 156, Last known committed idx: 155, Time since last communication: 0.000s
I20240502 01:58:35.135736 16081 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 156, Last known committed idx: 155, Time since last communication: 0.000s
I20240502 01:58:35.135854 15999 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 156, Last known committed idx: 155, Time since last communication: 0.000s
I20240502 01:58:35.137676 16081 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.156: config changed from index 77 to 156, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 156 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.138134 14365 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.156: config changed from index 77 to 156, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 156 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.138188 13341 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.156: config changed from index 77 to 156, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 156 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.140347 12655 catalog_manager.cc:5484] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: config changed from index 77 to 156, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 156 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:35.140601 13203 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.156: config changed from index 77 to 156, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 156 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.143445 13473 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.156: config changed from index 77 to 156, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 156 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.151405 13473 consensus_queue.cc:237] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 344, Committed index: 344, Last appended: 1.344, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 345 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:35.153107 13341 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 344. Preceding OpId from leader: term: 1 index: 345. (index mismatch)
I20240502 01:58:35.153160 13069 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 344. Preceding OpId from leader: term: 1 index: 345. (index mismatch)
W20240502 01:58:35.153510 13406 consensus_peers.cc:485] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a -> Peer 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200:46103): Couldn't send request to peer 6414b27f8e3f4f66ba81b2e9598caf27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc637bf633fc4fe58db54a6bc0821417. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:35.153564 16052 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 345, Last known committed idx: 344, Time since last communication: 0.000s
I20240502 01:58:35.153764 12935 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 344. Preceding OpId from leader: term: 1 index: 345. (index mismatch)
I20240502 01:58:35.153890 15850 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 345, Last known committed idx: 344, Time since last communication: 0.000s
I20240502 01:58:35.154096 14365 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 344. Preceding OpId from leader: term: 1 index: 345. (index mismatch)
I20240502 01:58:35.154186 16052 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 345, Last known committed idx: 344, Time since last communication: 0.000s
I20240502 01:58:35.154425 15850 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 345, Last known committed idx: 344, Time since last communication: 0.000s
I20240502 01:58:35.157274 15850 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 LEADER]: Committing config change with OpId 1.345: config changed from index 73 to 345, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 345 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.159428 13341 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.345: config changed from index 73 to 345, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 345 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.159561 12659 catalog_manager.cc:5484] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a reported cstate change: config changed from index 73 to 345, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" committed_config { opid_index: 345 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:35.160369 12935 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.345: config changed from index 73 to 345, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 345 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.161885 13069 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.345: config changed from index 73 to 345, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 345 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.163115 14365 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.345: config changed from index 73 to 345, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 345 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.207648 15954 raft_consensus.cc:1050] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88: attempting to promote NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 to VOTER
I20240502 01:58:35.208050 15954 consensus_queue.cc:237] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 337, Committed index: 337, Last appended: 1.337, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 338 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } }
I20240502 01:58:35.209580 13203 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 337. Preceding OpId from leader: term: 1 index: 338. (index mismatch)
I20240502 01:58:35.209597 14365 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 337. Preceding OpId from leader: term: 1 index: 338. (index mismatch)
I20240502 01:58:35.209826 15652 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 337. Preceding OpId from leader: term: 1 index: 338. (index mismatch)
I20240502 01:58:35.209946 13341 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 337. Preceding OpId from leader: term: 1 index: 338. (index mismatch)
I20240502 01:58:35.210119 12935 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 337. Preceding OpId from leader: term: 1 index: 338. (index mismatch)
I20240502 01:58:35.210448 15398 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 338, Last known committed idx: 337, Time since last communication: 0.000s
I20240502 01:58:35.210623 16079 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 338, Last known committed idx: 337, Time since last communication: 0.000s
I20240502 01:58:35.210778 16081 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 338, Last known committed idx: 337, Time since last communication: 0.000s
I20240502 01:58:35.210896 15999 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 338, Last known committed idx: 337, Time since last communication: 0.000s
I20240502 01:58:35.211027 16080 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 338, Last known committed idx: 337, Time since last communication: 0.000s
I20240502 01:58:35.213256 16079 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.338: config changed from index 337 to 338, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 338 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.214689 13341 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.338: config changed from index 337 to 338, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 338 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.214823 12935 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.338: config changed from index 337 to 338, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 338 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.215381 14365 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.338: config changed from index 337 to 338, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 338 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.215404 15652 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Committing config change with OpId 1.338: config changed from index 337 to 338, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 338 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.217664 13203 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.338: config changed from index 337 to 338, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 338 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.218474 12659 catalog_manager.cc:5484] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867 reported cstate change: config changed from index 337 to 338, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 338 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.222365 12804 consensus_queue.cc:237] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 338, Committed index: 338, Last appended: 1.338, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 339 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } }
I20240502 01:58:35.223731 13341 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 338. Preceding OpId from leader: term: 1 index: 339. (index mismatch)
I20240502 01:58:35.223812 13203 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 338. Preceding OpId from leader: term: 1 index: 339. (index mismatch)
I20240502 01:58:35.223914 15652 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 338. Preceding OpId from leader: term: 1 index: 339. (index mismatch)
I20240502 01:58:35.224140 14365 raft_consensus.cc:1261] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 338. Preceding OpId from leader: term: 1 index: 339. (index mismatch)
I20240502 01:58:35.224229 16081 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 339, Last known committed idx: 338, Time since last communication: 0.000s
I20240502 01:58:35.224545 16081 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 339, Last known committed idx: 338, Time since last communication: 0.000s
I20240502 01:58:35.224839 16081 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 339, Last known committed idx: 338, Time since last communication: 0.000s
I20240502 01:58:35.225114 16081 consensus_queue.cc:1035] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 339, Last known committed idx: 338, Time since last communication: 0.000s
I20240502 01:58:35.226197 15954 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.339: config changed from index 338 to 339, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New config: { opid_index: 339 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.227104 13203 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.339: config changed from index 338 to 339, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New config: { opid_index: 339 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.227792 12648 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet a8e8a2483ab8452f9b798930ebc069ac with cas_config_opid_index 338: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:35.228137 15652 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Committing config change with OpId 1.339: config changed from index 338 to 339, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New config: { opid_index: 339 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.228142 13341 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.339: config changed from index 338 to 339, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New config: { opid_index: 339 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.229262 12660 catalog_manager.cc:5484] T a8e8a2483ab8452f9b798930ebc069ac P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: config changed from index 338 to 339, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 339 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:35.232630 12918 tablet_service.cc:1514] Processing DeleteTablet for tablet a8e8a2483ab8452f9b798930ebc069ac with delete_type TABLET_DATA_TOMBSTONED (TS 42bc78875b454c7ab7fce86d56a28c1e not found in new config with opid_index 339) from {username='slave'} at 127.0.0.1:60860
I20240502 01:58:35.232664 14365 raft_consensus.cc:2932] T a8e8a2483ab8452f9b798930ebc069ac P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.339: config changed from index 338 to 339, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New config: { opid_index: 339 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.233044 16165 tablet_replica.cc:330] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e: stopping tablet replica
I20240502 01:58:35.233208 16165 raft_consensus.cc:2229] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:35.233423 16165 raft_consensus.cc:2258] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:35.235590 16165 ts_tablet_manager.cc:1875] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:35.236824 16079 raft_consensus.cc:1050] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88: attempting to promote NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 to VOTER
I20240502 01:58:35.237206 16079 consensus_queue.cc:237] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 209, Committed index: 209, Last appended: 1.209, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 210 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } }
I20240502 01:58:35.237529 16165 ts_tablet_manager.cc:1888] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.338
I20240502 01:58:35.237607 16165 log.cc:1196] T a8e8a2483ab8452f9b798930ebc069ac P 42bc78875b454c7ab7fce86d56a28c1e: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/a8e8a2483ab8452f9b798930ebc069ac
I20240502 01:58:35.238157 12646 catalog_manager.cc:4830] TS 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143): tablet a8e8a2483ab8452f9b798930ebc069ac (table rebalance_test_table_2 [id=41727fe31ec64883ac850e582b40cb0b]) successfully deleted
I20240502 01:58:35.238883 15652 raft_consensus.cc:1261] T 400199df936243f2b49a4b556f29c575 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 209. Preceding OpId from leader: term: 1 index: 210. (index mismatch)
I20240502 01:58:35.239100 13473 raft_consensus.cc:1261] T 400199df936243f2b49a4b556f29c575 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 209. Preceding OpId from leader: term: 1 index: 210. (index mismatch)
I20240502 01:58:35.239214 15398 consensus_queue.cc:1035] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 210, Last known committed idx: 209, Time since last communication: 0.000s
I20240502 01:58:35.239388 13203 raft_consensus.cc:1261] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 209. Preceding OpId from leader: term: 1 index: 210. (index mismatch)
I20240502 01:58:35.239710 13069 raft_consensus.cc:1261] T 400199df936243f2b49a4b556f29c575 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 209. Preceding OpId from leader: term: 1 index: 210. (index mismatch)
I20240502 01:58:35.240456 15398 consensus_queue.cc:1035] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 210, Last known committed idx: 209, Time since last communication: 0.000s
I20240502 01:58:35.240598 16079 consensus_queue.cc:1035] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 210, Last known committed idx: 209, Time since last communication: 0.000s
I20240502 01:58:35.240728 15954 consensus_queue.cc:1035] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 210, Last known committed idx: 209, Time since last communication: 0.000s
I20240502 01:58:35.243676 16079 raft_consensus.cc:2932] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.210: config changed from index 209 to 210, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 210 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.244107 15652 raft_consensus.cc:2932] T 400199df936243f2b49a4b556f29c575 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Committing config change with OpId 1.210: config changed from index 209 to 210, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 210 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.245627 12935 raft_consensus.cc:1261] T 400199df936243f2b49a4b556f29c575 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 209. Preceding OpId from leader: term: 1 index: 210. (index mismatch)
I20240502 01:58:35.246361 16080 consensus_queue.cc:1035] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 210, Last known committed idx: 209, Time since last communication: 0.000s
I20240502 01:58:35.246361 12655 catalog_manager.cc:5484] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: config changed from index 209 to 210, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 210 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:35.247473 12935 raft_consensus.cc:2932] T 400199df936243f2b49a4b556f29c575 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.210: config changed from index 209 to 210, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 210 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.248490 13473 raft_consensus.cc:2932] T 400199df936243f2b49a4b556f29c575 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.210: config changed from index 209 to 210, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 210 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.251591 13069 raft_consensus.cc:2932] T 400199df936243f2b49a4b556f29c575 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.210: config changed from index 209 to 210, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 210 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.255226 13203 raft_consensus.cc:2932] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.210: config changed from index 209 to 210, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 210 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.426187 13341 consensus_queue.cc:237] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 325, Committed index: 325, Last appended: 1.325, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 326 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:35.428040 13203 raft_consensus.cc:1261] T f1e0f3e6a85b4998bdaaf83117af6f20 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 325. Preceding OpId from leader: term: 1 index: 326. (index mismatch)
I20240502 01:58:35.428675 12935 raft_consensus.cc:1261] T f1e0f3e6a85b4998bdaaf83117af6f20 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 325. Preceding OpId from leader: term: 1 index: 326. (index mismatch)
I20240502 01:58:35.428984 12804 raft_consensus.cc:1261] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 325. Preceding OpId from leader: term: 1 index: 326. (index mismatch)
I20240502 01:58:35.428982 16207 consensus_queue.cc:1035] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 326, Last known committed idx: 325, Time since last communication: 0.000s
I20240502 01:58:35.429241 16205 consensus_queue.cc:1035] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 326, Last known committed idx: 325, Time since last communication: 0.000s
I20240502 01:58:35.429322 13069 raft_consensus.cc:1261] T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 325. Preceding OpId from leader: term: 1 index: 326. (index mismatch)
I20240502 01:58:35.430411 16207 consensus_queue.cc:1035] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 326, Last known committed idx: 325, Time since last communication: 0.000s
I20240502 01:58:35.430572 16206 consensus_queue.cc:1035] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 326, Last known committed idx: 325, Time since last communication: 0.000s
W20240502 01:58:35.432986 13273 consensus_peers.cc:485] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 -> Peer 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200:46103): Couldn't send request to peer 6414b27f8e3f4f66ba81b2e9598caf27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f1e0f3e6a85b4998bdaaf83117af6f20. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:35.433341 16207 raft_consensus.cc:2932] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 LEADER]: Committing config change with OpId 1.326: config changed from index -1 to 326, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 326 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.433751 13069 raft_consensus.cc:2932] T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.326: config changed from index -1 to 326, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 326 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.435879 13203 raft_consensus.cc:2932] T f1e0f3e6a85b4998bdaaf83117af6f20 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.326: config changed from index -1 to 326, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 326 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.436959 12656 catalog_manager.cc:5484] T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7 reported cstate change: config changed from index -1 to 326, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "6b1e63d6b84a440a8864db2d36b57665" committed_config { opid_index: 326 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.438867 12935 raft_consensus.cc:2932] T f1e0f3e6a85b4998bdaaf83117af6f20 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.326: config changed from index -1 to 326, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 326 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.441074 12804 raft_consensus.cc:2932] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Committing config change with OpId 1.326: config changed from index -1 to 326, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 326 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.578158 16240 ts_tablet_manager.cc:902] T 773b692c40df457caf7baea5a7b21c27 P 6414b27f8e3f4f66ba81b2e9598caf27: Initiating tablet copy from peer 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263)
I20240502 01:58:35.578050 12804 consensus_queue.cc:237] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 190, Committed index: 190, Last appended: 1.190, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 191 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } }
I20240502 01:58:35.578704 16240 tablet_copy_client.cc:308] T 773b692c40df457caf7baea5a7b21c27 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:46263
I20240502 01:58:35.579291 12825 tablet_copy_service.cc:140] P 27e2acacdad14caa8f66bc81fa8a2f88: Received BeginTabletCopySession request for tablet 773b692c40df457caf7baea5a7b21c27 from peer 6414b27f8e3f4f66ba81b2e9598caf27 ({username='slave'} at 127.10.133.200:44847)
I20240502 01:58:35.579392 12825 tablet_copy_service.cc:161] P 27e2acacdad14caa8f66bc81fa8a2f88: Beginning new tablet copy session on tablet 773b692c40df457caf7baea5a7b21c27 from peer 6414b27f8e3f4f66ba81b2e9598caf27 at {username='slave'} at 127.10.133.200:44847: session id = 6414b27f8e3f4f66ba81b2e9598caf27-773b692c40df457caf7baea5a7b21c27
I20240502 01:58:35.579865 12935 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 190. Preceding OpId from leader: term: 1 index: 191. (index mismatch)
I20240502 01:58:35.579897 13203 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 190. Preceding OpId from leader: term: 1 index: 191. (index mismatch)
I20240502 01:58:35.580082 15652 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 190. Preceding OpId from leader: term: 1 index: 191. (index mismatch)
I20240502 01:58:35.580443 12825 tablet_copy_source_session.cc:205] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:35.580430 15999 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 191, Last known committed idx: 190, Time since last communication: 0.000s
I20240502 01:58:35.580487 13473 raft_consensus.cc:1261] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 190. Preceding OpId from leader: term: 1 index: 191. (index mismatch)
I20240502 01:58:35.580607 15398 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 191, Last known committed idx: 190, Time since last communication: 0.000s
I20240502 01:58:35.580842 15954 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 191, Last known committed idx: 190, Time since last communication: 0.000s
I20240502 01:58:35.581089 16080 consensus_queue.cc:1035] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 191, Last known committed idx: 190, Time since last communication: 0.000s
I20240502 01:58:35.581440 16240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 773b692c40df457caf7baea5a7b21c27. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:35.583366 16080 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.191: config changed from index 190 to 191, VOTER 71010353c29d4e988704295c8cd73ef7 (127.10.133.195) evicted. New config: { opid_index: 191 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.583794 13203 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.191: config changed from index 190 to 191, VOTER 71010353c29d4e988704295c8cd73ef7 (127.10.133.195) evicted. New config: { opid_index: 191 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.584085 16240 tablet_copy_client.cc:783] T 773b692c40df457caf7baea5a7b21c27 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:35.584225 16240 tablet_copy_client.cc:647] T 773b692c40df457caf7baea5a7b21c27 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:35.585355 12648 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 281ea2fa1f9f49cebd4bb3620335168a with cas_config_opid_index 190: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:35.586015 15652 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Committing config change with OpId 1.191: config changed from index 190 to 191, VOTER 71010353c29d4e988704295c8cd73ef7 (127.10.133.195) evicted. New config: { opid_index: 191 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.586752 12660 catalog_manager.cc:5484] T 281ea2fa1f9f49cebd4bb3620335168a P 3d7bf587aa5a49eb92c3a53d17717149 reported cstate change: config changed from index 190 to 191, VOTER 71010353c29d4e988704295c8cd73ef7 (127.10.133.195) evicted. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 191 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.587071 13473 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.191: config changed from index 190 to 191, VOTER 71010353c29d4e988704295c8cd73ef7 (127.10.133.195) evicted. New config: { opid_index: 191 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.587823 12935 raft_consensus.cc:2932] T 281ea2fa1f9f49cebd4bb3620335168a P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.191: config changed from index 190 to 191, VOTER 71010353c29d4e988704295c8cd73ef7 (127.10.133.195) evicted. New config: { opid_index: 191 OBSOLETE_local: false peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.589277 16240 tablet_copy_client.cc:523] T 773b692c40df457caf7baea5a7b21c27 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:35.590764 16240 tablet_bootstrap.cc:492] T 773b692c40df457caf7baea5a7b21c27 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap starting.
I20240502 01:58:35.590996 13051 tablet_service.cc:1514] Processing DeleteTablet for tablet 281ea2fa1f9f49cebd4bb3620335168a with delete_type TABLET_DATA_TOMBSTONED (TS 71010353c29d4e988704295c8cd73ef7 not found in new config with opid_index 191) from {username='slave'} at 127.0.0.1:57476
I20240502 01:58:35.591408 16245 tablet_replica.cc:330] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7: stopping tablet replica
I20240502 01:58:35.591593 16245 raft_consensus.cc:2229] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:35.591791 16245 raft_consensus.cc:2258] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:35.593430 16245 ts_tablet_manager.cc:1875] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:35.595293 16245 ts_tablet_manager.cc:1888] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.190
I20240502 01:58:35.595364 16245 log.cc:1196] T 281ea2fa1f9f49cebd4bb3620335168a P 71010353c29d4e988704295c8cd73ef7: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/wals/281ea2fa1f9f49cebd4bb3620335168a
I20240502 01:58:35.595911 12649 catalog_manager.cc:4830] TS 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887): tablet 281ea2fa1f9f49cebd4bb3620335168a (table rebalance_test_table_3 [id=e192d1fc91574f419257f076074a1378]) successfully deleted
I20240502 01:58:35.697527 16240 tablet_bootstrap.cc:492] T 773b692c40df457caf7baea5a7b21c27 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap replayed 1/1 log segments. Stats: ops{read=156 overwritten=0 applied=156 ignored=0} inserts{seen=825 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:35.697889 16240 tablet_bootstrap.cc:492] T 773b692c40df457caf7baea5a7b21c27 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap complete.
I20240502 01:58:35.698140 16240 ts_tablet_manager.cc:1367] T 773b692c40df457caf7baea5a7b21c27 P 6414b27f8e3f4f66ba81b2e9598caf27: Time spent bootstrapping tablet: real 0.107s user 0.102s sys 0.004s
I20240502 01:58:35.698606 16240 raft_consensus.cc:348] T 773b692c40df457caf7baea5a7b21c27 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 156 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:35.698738 16240 raft_consensus.cc:729] T 773b692c40df457caf7baea5a7b21c27 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6414b27f8e3f4f66ba81b2e9598caf27, State: Initialized, Role: LEARNER
I20240502 01:58:35.698845 16240 consensus_queue.cc:260] T 773b692c40df457caf7baea5a7b21c27 P 6414b27f8e3f4f66ba81b2e9598caf27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 156, Last appended: 1.156, Last appended by leader: 156, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 156 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:35.699168 16240 ts_tablet_manager.cc:1398] T 773b692c40df457caf7baea5a7b21c27 P 6414b27f8e3f4f66ba81b2e9598caf27: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:35.699759 12825 tablet_copy_service.cc:342] P 27e2acacdad14caa8f66bc81fa8a2f88: Request end of tablet copy session 6414b27f8e3f4f66ba81b2e9598caf27-773b692c40df457caf7baea5a7b21c27 received from {username='slave'} at 127.10.133.200:44847
I20240502 01:58:35.699832 12825 tablet_copy_service.cc:433] P 27e2acacdad14caa8f66bc81fa8a2f88: ending tablet copy session 6414b27f8e3f4f66ba81b2e9598caf27-773b692c40df457caf7baea5a7b21c27 on tablet 773b692c40df457caf7baea5a7b21c27 with peer 6414b27f8e3f4f66ba81b2e9598caf27
I20240502 01:58:35.707979 12804 consensus_queue.cc:237] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:35.709543 14365 raft_consensus.cc:1261] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:35.709600 12935 raft_consensus.cc:1261] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:35.709677 13341 raft_consensus.cc:1261] T 52775623e580480b83a6148e0b453ae5 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20240502 01:58:35.709748 12738 consensus_peers.cc:485] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 -> Peer 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200:46103): Couldn't send request to peer 6414b27f8e3f4f66ba81b2e9598caf27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 52775623e580480b83a6148e0b453ae5. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:35.710028 15398 consensus_queue.cc:1035] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:58:35.710202 16081 consensus_queue.cc:1035] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:58:35.710456 13473 raft_consensus.cc:1261] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:35.710732 16081 consensus_queue.cc:1035] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:58:35.711272 16079 consensus_queue.cc:1035] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20240502 01:58:35.712330 15398 raft_consensus.cc:2932] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.712766 12935 raft_consensus.cc:2932] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.713693 13341 raft_consensus.cc:2932] T 52775623e580480b83a6148e0b453ae5 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.714640 13473 raft_consensus.cc:2932] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.715893 14365 raft_consensus.cc:2932] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.716606 12656 catalog_manager.cc:5484] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e reported cstate change: config changed from index -1 to 2, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.770639 16240 ts_tablet_manager.cc:902] T bc637bf633fc4fe58db54a6bc0821417 P 6414b27f8e3f4f66ba81b2e9598caf27: Initiating tablet copy from peer 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759)
I20240502 01:58:35.771055 16240 tablet_copy_client.cc:308] T bc637bf633fc4fe58db54a6bc0821417 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.198:39759
I20240502 01:58:35.771529 13493 tablet_copy_service.cc:140] P 1928367ae8d64ba49a7f5761b2d3dc4a: Received BeginTabletCopySession request for tablet bc637bf633fc4fe58db54a6bc0821417 from peer 6414b27f8e3f4f66ba81b2e9598caf27 ({username='slave'} at 127.10.133.200:40057)
I20240502 01:58:35.771633 13493 tablet_copy_service.cc:161] P 1928367ae8d64ba49a7f5761b2d3dc4a: Beginning new tablet copy session on tablet bc637bf633fc4fe58db54a6bc0821417 from peer 6414b27f8e3f4f66ba81b2e9598caf27 at {username='slave'} at 127.10.133.200:40057: session id = 6414b27f8e3f4f66ba81b2e9598caf27-bc637bf633fc4fe58db54a6bc0821417
I20240502 01:58:35.772318 13493 tablet_copy_source_session.cc:205] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:35.773113 16240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc637bf633fc4fe58db54a6bc0821417. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:35.774886 16240 tablet_copy_client.cc:783] T bc637bf633fc4fe58db54a6bc0821417 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:35.775051 16240 tablet_copy_client.cc:647] T bc637bf633fc4fe58db54a6bc0821417 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:35.777016 16240 tablet_copy_client.cc:523] T bc637bf633fc4fe58db54a6bc0821417 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:35.778141 16240 tablet_bootstrap.cc:492] T bc637bf633fc4fe58db54a6bc0821417 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap starting.
I20240502 01:58:35.791750 12804 consensus_queue.cc:237] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 210, Committed index: 210, Last appended: 1.210, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 211 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } }
I20240502 01:58:35.793464 15652 raft_consensus.cc:1261] T 400199df936243f2b49a4b556f29c575 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 210. Preceding OpId from leader: term: 1 index: 211. (index mismatch)
I20240502 01:58:35.793488 13069 raft_consensus.cc:1261] T 400199df936243f2b49a4b556f29c575 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 210. Preceding OpId from leader: term: 1 index: 211. (index mismatch)
I20240502 01:58:35.793574 13473 raft_consensus.cc:1261] T 400199df936243f2b49a4b556f29c575 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 210. Preceding OpId from leader: term: 1 index: 211. (index mismatch)
I20240502 01:58:35.794036 16080 consensus_queue.cc:1035] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 211, Last known committed idx: 210, Time since last communication: 0.000s
I20240502 01:58:35.794229 16079 consensus_queue.cc:1035] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 211, Last known committed idx: 210, Time since last communication: 0.000s
I20240502 01:58:35.794381 15999 consensus_queue.cc:1035] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 211, Last known committed idx: 210, Time since last communication: 0.000s
I20240502 01:58:35.794875 12935 raft_consensus.cc:1261] T 400199df936243f2b49a4b556f29c575 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 210. Preceding OpId from leader: term: 1 index: 211. (index mismatch)
I20240502 01:58:35.795241 15999 consensus_queue.cc:1035] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 211, Last known committed idx: 210, Time since last communication: 0.000s
I20240502 01:58:35.797696 16079 raft_consensus.cc:2932] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.211: config changed from index 210 to 211, VOTER 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196) evicted. New config: { opid_index: 211 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.798980 12935 raft_consensus.cc:2932] T 400199df936243f2b49a4b556f29c575 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.211: config changed from index 210 to 211, VOTER 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196) evicted. New config: { opid_index: 211 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.799799 13069 raft_consensus.cc:2932] T 400199df936243f2b49a4b556f29c575 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.211: config changed from index 210 to 211, VOTER 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196) evicted. New config: { opid_index: 211 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.799779 13473 raft_consensus.cc:2932] T 400199df936243f2b49a4b556f29c575 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.211: config changed from index 210 to 211, VOTER 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196) evicted. New config: { opid_index: 211 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.802067 12655 catalog_manager.cc:5484] T 400199df936243f2b49a4b556f29c575 P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: config changed from index 210 to 211, VOTER 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 211 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:35.804389 12648 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 400199df936243f2b49a4b556f29c575 with cas_config_opid_index 210: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:35.804503 15652 raft_consensus.cc:2932] T 400199df936243f2b49a4b556f29c575 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Committing config change with OpId 1.211: config changed from index 210 to 211, VOTER 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196) evicted. New config: { opid_index: 211 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:35.806819 13185 tablet_service.cc:1514] Processing DeleteTablet for tablet 400199df936243f2b49a4b556f29c575 with delete_type TABLET_DATA_TOMBSTONED (TS 3d7bf587aa5a49eb92c3a53d17717149 not found in new config with opid_index 211) from {username='slave'} at 127.0.0.1:39126
I20240502 01:58:35.807765 16314 tablet_replica.cc:330] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149: stopping tablet replica
I20240502 01:58:35.807960 16314 raft_consensus.cc:2229] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:35.808198 16314 raft_consensus.cc:2258] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:35.809892 16314 ts_tablet_manager.cc:1875] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:35.812196 16314 ts_tablet_manager.cc:1888] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.210
I20240502 01:58:35.812278 16314 log.cc:1196] T 400199df936243f2b49a4b556f29c575 P 3d7bf587aa5a49eb92c3a53d17717149: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/400199df936243f2b49a4b556f29c575
I20240502 01:58:35.812873 12648 catalog_manager.cc:4830] TS 3d7bf587aa5a49eb92c3a53d17717149 (127.10.133.196:32825): tablet 400199df936243f2b49a4b556f29c575 (table rebalance_test_table_0 [id=87bf6032f2ab4ef8a4f1c2692004f94c]) successfully deleted
I20240502 01:58:35.989017 12804 consensus_queue.cc:237] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 308, Committed index: 308, Last appended: 2.308, Last appended by leader: 253, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 309 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:35.989861 16240 tablet_bootstrap.cc:492] T bc637bf633fc4fe58db54a6bc0821417 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap replayed 1/1 log segments. Stats: ops{read=345 overwritten=0 applied=345 ignored=0} inserts{seen=973 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:35.990213 16240 tablet_bootstrap.cc:492] T bc637bf633fc4fe58db54a6bc0821417 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap complete.
I20240502 01:58:35.990460 16240 ts_tablet_manager.cc:1367] T bc637bf633fc4fe58db54a6bc0821417 P 6414b27f8e3f4f66ba81b2e9598caf27: Time spent bootstrapping tablet: real 0.212s user 0.203s sys 0.008s
I20240502 01:58:35.990952 16240 raft_consensus.cc:348] T bc637bf633fc4fe58db54a6bc0821417 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 345 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:35.991037 14365 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 2 index: 308. Preceding OpId from leader: term: 2 index: 309. (index mismatch)
I20240502 01:58:35.991075 13069 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 2 index: 308. Preceding OpId from leader: term: 2 index: 309. (index mismatch)
I20240502 01:58:35.991091 16240 raft_consensus.cc:729] T bc637bf633fc4fe58db54a6bc0821417 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6414b27f8e3f4f66ba81b2e9598caf27, State: Initialized, Role: LEARNER
I20240502 01:58:35.991197 16240 consensus_queue.cc:260] T bc637bf633fc4fe58db54a6bc0821417 P 6414b27f8e3f4f66ba81b2e9598caf27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 345, Last appended: 1.345, Last appended by leader: 345, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 345 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:35.991533 16240 ts_tablet_manager.cc:1398] T bc637bf633fc4fe58db54a6bc0821417 P 6414b27f8e3f4f66ba81b2e9598caf27: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:35.991914 13473 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 2 index: 308. Preceding OpId from leader: term: 2 index: 309. (index mismatch)
I20240502 01:58:35.991869 16079 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 309, Last known committed idx: 308, Time since last communication: 0.000s
I20240502 01:58:35.992282 13493 tablet_copy_service.cc:342] P 1928367ae8d64ba49a7f5761b2d3dc4a: Request end of tablet copy session 6414b27f8e3f4f66ba81b2e9598caf27-bc637bf633fc4fe58db54a6bc0821417 received from {username='slave'} at 127.10.133.200:40057
I20240502 01:58:35.992287 16079 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 309, Last known committed idx: 308, Time since last communication: 0.000s
I20240502 01:58:35.992358 13493 tablet_copy_service.cc:433] P 1928367ae8d64ba49a7f5761b2d3dc4a: ending tablet copy session 6414b27f8e3f4f66ba81b2e9598caf27-bc637bf633fc4fe58db54a6bc0821417 on tablet bc637bf633fc4fe58db54a6bc0821417 with peer 6414b27f8e3f4f66ba81b2e9598caf27
W20240502 01:58:35.992718 12738 consensus_peers.cc:485] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 -> Peer 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200:46103): Couldn't send request to peer 6414b27f8e3f4f66ba81b2e9598caf27. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eeb77a056e494d5ab85138d8ecc52db9. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:35.993045 16080 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 309, Last known committed idx: 308, Time since last communication: 0.000s
I20240502 01:58:35.993530 13341 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 2 index: 308. Preceding OpId from leader: term: 2 index: 309. (index mismatch)
I20240502 01:58:35.993923 16080 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 309, Last known committed idx: 308, Time since last communication: 0.000s
I20240502 01:58:35.995694 16079 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 2 LEADER]: Committing config change with OpId 2.309: config changed from index 257 to 309, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 309 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.996234 13069 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 2 FOLLOWER]: Committing config change with OpId 2.309: config changed from index 257 to 309, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 309 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.997012 13341 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 2 FOLLOWER]: Committing config change with OpId 2.309: config changed from index 257 to 309, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 309 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:35.999123 12657 catalog_manager.cc:5484] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: config changed from index 257 to 309, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New cstate: current_term: 2 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 309 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:35.999925 13473 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 2 FOLLOWER]: Committing config change with OpId 2.309: config changed from index 257 to 309, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 309 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:36.001621 14365 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 2 FOLLOWER]: Committing config change with OpId 2.309: config changed from index 257 to 309, NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) added. New config: { opid_index: 309 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } } }
I20240502 01:58:36.036177 15652 raft_consensus.cc:1203] T 773b692c40df457caf7baea5a7b21c27 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.155->[1.156-1.156] Dedup: 1.156->[]
I20240502 01:58:36.040433 16240 ts_tablet_manager.cc:902] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6414b27f8e3f4f66ba81b2e9598caf27: Initiating tablet copy from peer 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283)
I20240502 01:58:36.040843 16240 tablet_copy_client.cc:308] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.197:42283
I20240502 01:58:36.044142 13361 tablet_copy_service.cc:140] P 6b1e63d6b84a440a8864db2d36b57665: Received BeginTabletCopySession request for tablet f1e0f3e6a85b4998bdaaf83117af6f20 from peer 6414b27f8e3f4f66ba81b2e9598caf27 ({username='slave'} at 127.10.133.200:46773)
I20240502 01:58:36.044240 13361 tablet_copy_service.cc:161] P 6b1e63d6b84a440a8864db2d36b57665: Beginning new tablet copy session on tablet f1e0f3e6a85b4998bdaaf83117af6f20 from peer 6414b27f8e3f4f66ba81b2e9598caf27 at {username='slave'} at 127.10.133.200:46773: session id = 6414b27f8e3f4f66ba81b2e9598caf27-f1e0f3e6a85b4998bdaaf83117af6f20
I20240502 01:58:36.045027 13361 tablet_copy_source_session.cc:205] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:36.045850 16240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1e0f3e6a85b4998bdaaf83117af6f20. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:36.047680 16240 tablet_copy_client.cc:783] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:36.047824 16240 tablet_copy_client.cc:647] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:36.049512 16240 tablet_copy_client.cc:523] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:36.050576 16240 tablet_bootstrap.cc:492] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap starting.
I20240502 01:58:36.108923 16383 ts_tablet_manager.cc:902] T 52775623e580480b83a6148e0b453ae5 P 6414b27f8e3f4f66ba81b2e9598caf27: Initiating tablet copy from peer 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263)
I20240502 01:58:36.109457 16383 tablet_copy_client.cc:308] T 52775623e580480b83a6148e0b453ae5 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:46263
I20240502 01:58:36.109967 12825 tablet_copy_service.cc:140] P 27e2acacdad14caa8f66bc81fa8a2f88: Received BeginTabletCopySession request for tablet 52775623e580480b83a6148e0b453ae5 from peer 6414b27f8e3f4f66ba81b2e9598caf27 ({username='slave'} at 127.10.133.200:44847)
I20240502 01:58:36.110119 12825 tablet_copy_service.cc:161] P 27e2acacdad14caa8f66bc81fa8a2f88: Beginning new tablet copy session on tablet 52775623e580480b83a6148e0b453ae5 from peer 6414b27f8e3f4f66ba81b2e9598caf27 at {username='slave'} at 127.10.133.200:44847: session id = 6414b27f8e3f4f66ba81b2e9598caf27-52775623e580480b83a6148e0b453ae5
I20240502 01:58:36.111189 12825 tablet_copy_source_session.cc:205] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:36.112004 16383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52775623e580480b83a6148e0b453ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:36.114121 16383 tablet_copy_client.cc:783] T 52775623e580480b83a6148e0b453ae5 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:36.114257 16383 tablet_copy_client.cc:647] T 52775623e580480b83a6148e0b453ae5 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:36.115968 16383 tablet_copy_client.cc:523] T 52775623e580480b83a6148e0b453ae5 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:36.117180 16383 tablet_bootstrap.cc:492] T 52775623e580480b83a6148e0b453ae5 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap starting.
I20240502 01:58:36.120468 16383 tablet_bootstrap.cc:492] T 52775623e580480b83a6148e0b453ae5 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:36.120707 16383 tablet_bootstrap.cc:492] T 52775623e580480b83a6148e0b453ae5 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap complete.
I20240502 01:58:36.120867 16383 ts_tablet_manager.cc:1367] T 52775623e580480b83a6148e0b453ae5 P 6414b27f8e3f4f66ba81b2e9598caf27: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 01:58:36.121238 16383 raft_consensus.cc:348] T 52775623e580480b83a6148e0b453ae5 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:36.121336 16383 raft_consensus.cc:729] T 52775623e580480b83a6148e0b453ae5 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6414b27f8e3f4f66ba81b2e9598caf27, State: Initialized, Role: LEARNER
I20240502 01:58:36.121415 16383 consensus_queue.cc:260] T 52775623e580480b83a6148e0b453ae5 P 6414b27f8e3f4f66ba81b2e9598caf27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:36.121690 16383 ts_tablet_manager.cc:1398] T 52775623e580480b83a6148e0b453ae5 P 6414b27f8e3f4f66ba81b2e9598caf27: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:36.122181 12825 tablet_copy_service.cc:342] P 27e2acacdad14caa8f66bc81fa8a2f88: Request end of tablet copy session 6414b27f8e3f4f66ba81b2e9598caf27-52775623e580480b83a6148e0b453ae5 received from {username='slave'} at 127.10.133.200:44847
I20240502 01:58:36.122249 12825 tablet_copy_service.cc:433] P 27e2acacdad14caa8f66bc81fa8a2f88: ending tablet copy session 6414b27f8e3f4f66ba81b2e9598caf27-52775623e580480b83a6148e0b453ae5 on tablet 52775623e580480b83a6148e0b453ae5 with peer 6414b27f8e3f4f66ba81b2e9598caf27
I20240502 01:58:36.254175 16240 tablet_bootstrap.cc:492] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap replayed 1/1 log segments. Stats: ops{read=326 overwritten=0 applied=326 ignored=0} inserts{seen=998 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:36.254451 16240 tablet_bootstrap.cc:492] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap complete.
I20240502 01:58:36.254699 16240 ts_tablet_manager.cc:1367] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6414b27f8e3f4f66ba81b2e9598caf27: Time spent bootstrapping tablet: real 0.204s user 0.192s sys 0.012s
I20240502 01:58:36.255190 16240 raft_consensus.cc:348] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 326 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:36.255306 16240 raft_consensus.cc:729] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6414b27f8e3f4f66ba81b2e9598caf27, State: Initialized, Role: LEARNER
I20240502 01:58:36.255407 16240 consensus_queue.cc:260] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6414b27f8e3f4f66ba81b2e9598caf27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 326, Last appended: 1.326, Last appended by leader: 326, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 326 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:36.255712 16240 ts_tablet_manager.cc:1398] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6414b27f8e3f4f66ba81b2e9598caf27: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:36.256407 13361 tablet_copy_service.cc:342] P 6b1e63d6b84a440a8864db2d36b57665: Request end of tablet copy session 6414b27f8e3f4f66ba81b2e9598caf27-f1e0f3e6a85b4998bdaaf83117af6f20 received from {username='slave'} at 127.10.133.200:46773
I20240502 01:58:36.256498 13361 tablet_copy_service.cc:433] P 6b1e63d6b84a440a8864db2d36b57665: ending tablet copy session 6414b27f8e3f4f66ba81b2e9598caf27-f1e0f3e6a85b4998bdaaf83117af6f20 on tablet f1e0f3e6a85b4998bdaaf83117af6f20 with peer 6414b27f8e3f4f66ba81b2e9598caf27
I20240502 01:58:36.274317 15652 raft_consensus.cc:1203] T bc637bf633fc4fe58db54a6bc0821417 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.344->[1.345-1.345] Dedup: 1.345->[]
I20240502 01:58:36.531404 16240 ts_tablet_manager.cc:902] T eeb77a056e494d5ab85138d8ecc52db9 P 6414b27f8e3f4f66ba81b2e9598caf27: Initiating tablet copy from peer 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263)
I20240502 01:58:36.531880 16240 tablet_copy_client.cc:308] T eeb77a056e494d5ab85138d8ecc52db9 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:46263
I20240502 01:58:36.532363 12825 tablet_copy_service.cc:140] P 27e2acacdad14caa8f66bc81fa8a2f88: Received BeginTabletCopySession request for tablet eeb77a056e494d5ab85138d8ecc52db9 from peer 6414b27f8e3f4f66ba81b2e9598caf27 ({username='slave'} at 127.10.133.200:44847)
I20240502 01:58:36.532487 12825 tablet_copy_service.cc:161] P 27e2acacdad14caa8f66bc81fa8a2f88: Beginning new tablet copy session on tablet eeb77a056e494d5ab85138d8ecc52db9 from peer 6414b27f8e3f4f66ba81b2e9598caf27 at {username='slave'} at 127.10.133.200:44847: session id = 6414b27f8e3f4f66ba81b2e9598caf27-eeb77a056e494d5ab85138d8ecc52db9
I20240502 01:58:36.533267 12825 tablet_copy_source_session.cc:205] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:36.534122 16240 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeb77a056e494d5ab85138d8ecc52db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:36.535867 16240 tablet_copy_client.cc:783] T eeb77a056e494d5ab85138d8ecc52db9 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:36.536020 16240 tablet_copy_client.cc:647] T eeb77a056e494d5ab85138d8ecc52db9 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:36.537578 16240 tablet_copy_client.cc:523] T eeb77a056e494d5ab85138d8ecc52db9 P 6414b27f8e3f4f66ba81b2e9598caf27: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:36.538596 16240 tablet_bootstrap.cc:492] T eeb77a056e494d5ab85138d8ecc52db9 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap starting.
I20240502 01:58:36.553715 15652 raft_consensus.cc:1203] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.325->[1.326-1.326] Dedup: 1.326->[]
I20240502 01:58:36.594980 16080 raft_consensus.cc:1050] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88: attempting to promote NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 to VOTER
I20240502 01:58:36.595548 16080 consensus_queue.cc:237] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 156, Committed index: 156, Last appended: 1.156, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 157 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } }
I20240502 01:58:36.597412 15652 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 156. Preceding OpId from leader: term: 1 index: 157. (index mismatch)
I20240502 01:58:36.597497 13341 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 156. Preceding OpId from leader: term: 1 index: 157. (index mismatch)
I20240502 01:58:36.597497 13473 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 156. Preceding OpId from leader: term: 1 index: 157. (index mismatch)
I20240502 01:58:36.598039 16449 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 157, Last known committed idx: 156, Time since last communication: 0.000s
I20240502 01:58:36.598140 14365 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 156. Preceding OpId from leader: term: 1 index: 157. (index mismatch)
I20240502 01:58:36.598656 16449 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 157, Last known committed idx: 156, Time since last communication: 0.000s
I20240502 01:58:36.598752 13203 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 156. Preceding OpId from leader: term: 1 index: 157. (index mismatch)
I20240502 01:58:36.598958 16451 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 157, Last known committed idx: 156, Time since last communication: 0.000s
I20240502 01:58:36.599473 16451 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 157, Last known committed idx: 156, Time since last communication: 0.000s
I20240502 01:58:36.600224 16080 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 157, Last known committed idx: 156, Time since last communication: 0.000s
I20240502 01:58:36.602381 16450 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.157: config changed from index 156 to 157, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 157 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.602738 14365 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.157: config changed from index 156 to 157, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 157 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.603420 13473 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.157: config changed from index 156 to 157, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 157 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.605083 15652 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Committing config change with OpId 1.157: config changed from index 156 to 157, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 157 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.609804 12655 catalog_manager.cc:5484] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: config changed from index 156 to 157, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 157 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:36.613011 13203 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.157: config changed from index 156 to 157, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 157 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.614457 13341 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.157: config changed from index 156 to 157, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 157 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } attrs { replace: true } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.626215 12804 consensus_queue.cc:237] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 157, Committed index: 157, Last appended: 1.157, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 158 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } }
I20240502 01:58:36.627786 15652 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 157. Preceding OpId from leader: term: 1 index: 158. (index mismatch)
I20240502 01:58:36.628224 13341 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 157. Preceding OpId from leader: term: 1 index: 158. (index mismatch)
I20240502 01:58:36.628602 14365 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 157. Preceding OpId from leader: term: 1 index: 158. (index mismatch)
I20240502 01:58:36.628619 16449 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 158, Last known committed idx: 157, Time since last communication: 0.000s
I20240502 01:58:36.629002 15954 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 158, Last known committed idx: 157, Time since last communication: 0.000s
I20240502 01:58:36.629331 15954 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 158, Last known committed idx: 157, Time since last communication: 0.000s
I20240502 01:58:36.631269 13203 raft_consensus.cc:1261] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 157. Preceding OpId from leader: term: 1 index: 158. (index mismatch)
I20240502 01:58:36.631723 16449 consensus_queue.cc:1035] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 158, Last known committed idx: 157, Time since last communication: 0.000s
I20240502 01:58:36.632243 16080 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.158: config changed from index 157 to 158, VOTER 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198) evicted. New config: { opid_index: 158 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.632594 15652 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Committing config change with OpId 1.158: config changed from index 157 to 158, VOTER 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198) evicted. New config: { opid_index: 158 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.633620 13341 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.158: config changed from index 157 to 158, VOTER 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198) evicted. New config: { opid_index: 158 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.634496 12648 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 773b692c40df457caf7baea5a7b21c27 with cas_config_opid_index 157: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:36.634842 14363 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.158: config changed from index 157 to 158, VOTER 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198) evicted. New config: { opid_index: 158 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.637393 12656 catalog_manager.cc:5484] T 773b692c40df457caf7baea5a7b21c27 P 1ef9768a03e545fba961cfeee4c1c867 reported cstate change: config changed from index 157 to 158, VOTER 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198) evicted. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 158 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.640506 13205 raft_consensus.cc:2932] T 773b692c40df457caf7baea5a7b21c27 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.158: config changed from index 157 to 158, VOTER 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198) evicted. New config: { opid_index: 158 OBSOLETE_local: false peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.642078 13452 tablet_service.cc:1514] Processing DeleteTablet for tablet 773b692c40df457caf7baea5a7b21c27 with delete_type TABLET_DATA_TOMBSTONED (TS 1928367ae8d64ba49a7f5761b2d3dc4a not found in new config with opid_index 158) from {username='slave'} at 127.0.0.1:44176
I20240502 01:58:36.645011 16462 tablet_replica.cc:330] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a: stopping tablet replica
I20240502 01:58:36.645359 16462 raft_consensus.cc:2229] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:36.645555 16462 raft_consensus.cc:2258] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:36.647306 16462 ts_tablet_manager.cc:1875] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:36.649498 16462 ts_tablet_manager.cc:1888] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.157
I20240502 01:58:36.649570 16462 log.cc:1196] T 773b692c40df457caf7baea5a7b21c27 P 1928367ae8d64ba49a7f5761b2d3dc4a: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal/wals/773b692c40df457caf7baea5a7b21c27
I20240502 01:58:36.650112 12649 catalog_manager.cc:4830] TS 1928367ae8d64ba49a7f5761b2d3dc4a (127.10.133.198:39759): tablet 773b692c40df457caf7baea5a7b21c27 (table rebalance_test_table_4 [id=8471dbb0ba2d474da8ff5cbfa12790d9]) successfully deleted
I20240502 01:58:36.654278 15652 raft_consensus.cc:1203] T 52775623e580480b83a6148e0b453ae5 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20240502 01:58:36.794890 16240 tablet_bootstrap.cc:492] T eeb77a056e494d5ab85138d8ecc52db9 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap replayed 1/1 log segments. Stats: ops{read=309 overwritten=0 applied=309 ignored=0} inserts{seen=933 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:36.795264 16240 tablet_bootstrap.cc:492] T eeb77a056e494d5ab85138d8ecc52db9 P 6414b27f8e3f4f66ba81b2e9598caf27: Bootstrap complete.
I20240502 01:58:36.795504 16240 ts_tablet_manager.cc:1367] T eeb77a056e494d5ab85138d8ecc52db9 P 6414b27f8e3f4f66ba81b2e9598caf27: Time spent bootstrapping tablet: real 0.257s user 0.219s sys 0.024s
I20240502 01:58:36.796116 16240 raft_consensus.cc:348] T eeb77a056e494d5ab85138d8ecc52db9 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 309 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:36.796303 16240 raft_consensus.cc:729] T eeb77a056e494d5ab85138d8ecc52db9 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6414b27f8e3f4f66ba81b2e9598caf27, State: Initialized, Role: LEARNER
I20240502 01:58:36.796432 16240 consensus_queue.cc:260] T eeb77a056e494d5ab85138d8ecc52db9 P 6414b27f8e3f4f66ba81b2e9598caf27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 309, Last appended: 2.309, Last appended by leader: 309, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 309 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: true } }
I20240502 01:58:36.796820 16240 ts_tablet_manager.cc:1398] T eeb77a056e494d5ab85138d8ecc52db9 P 6414b27f8e3f4f66ba81b2e9598caf27: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:36.797382 12825 tablet_copy_service.cc:342] P 27e2acacdad14caa8f66bc81fa8a2f88: Request end of tablet copy session 6414b27f8e3f4f66ba81b2e9598caf27-eeb77a056e494d5ab85138d8ecc52db9 received from {username='slave'} at 127.10.133.200:44847
I20240502 01:58:36.797470 12825 tablet_copy_service.cc:433] P 27e2acacdad14caa8f66bc81fa8a2f88: ending tablet copy session 6414b27f8e3f4f66ba81b2e9598caf27-eeb77a056e494d5ab85138d8ecc52db9 on tablet eeb77a056e494d5ab85138d8ecc52db9 with peer 6414b27f8e3f4f66ba81b2e9598caf27
I20240502 01:58:36.892520 16508 raft_consensus.cc:1050] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a: attempting to promote NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 to VOTER
I20240502 01:58:36.892988 16508 consensus_queue.cc:237] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 345, Committed index: 345, Last appended: 1.345, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 346 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } }
I20240502 01:58:36.894804 12935 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 345. Preceding OpId from leader: term: 1 index: 346. (index mismatch)
I20240502 01:58:36.894932 15652 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 345. Preceding OpId from leader: term: 1 index: 346. (index mismatch)
I20240502 01:58:36.894943 14365 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 345. Preceding OpId from leader: term: 1 index: 346. (index mismatch)
I20240502 01:58:36.895305 16510 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 346, Last known committed idx: 345, Time since last communication: 0.000s
I20240502 01:58:36.895481 16511 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 346, Last known committed idx: 345, Time since last communication: 0.000s
I20240502 01:58:36.895622 16512 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 346, Last known committed idx: 345, Time since last communication: 0.000s
I20240502 01:58:36.896231 13341 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 345. Preceding OpId from leader: term: 1 index: 346. (index mismatch)
I20240502 01:58:36.896529 13069 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 345. Preceding OpId from leader: term: 1 index: 346. (index mismatch)
I20240502 01:58:36.897130 16512 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 346, Last known committed idx: 345, Time since last communication: 0.000s
I20240502 01:58:36.897444 16512 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 346, Last known committed idx: 345, Time since last communication: 0.000s
I20240502 01:58:36.900625 13341 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.346: config changed from index 345 to 346, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 346 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.901353 12935 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.346: config changed from index 345 to 346, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 346 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.903577 16510 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 LEADER]: Committing config change with OpId 1.346: config changed from index 345 to 346, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 346 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.903669 13069 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.346: config changed from index 345 to 346, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 346 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.904405 12661 catalog_manager.cc:5484] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e reported cstate change: config changed from index 345 to 346, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" committed_config { opid_index: 346 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.905604 14365 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.346: config changed from index 345 to 346, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 346 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.906050 15652 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Committing config change with OpId 1.346: config changed from index 345 to 346, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 346 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } attrs { replace: true } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.910319 13473 consensus_queue.cc:237] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 346, Committed index: 346, Last appended: 1.346, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 347 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } }
I20240502 01:58:36.911837 15652 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 346. Preceding OpId from leader: term: 1 index: 347. (index mismatch)
I20240502 01:58:36.911868 14365 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 346. Preceding OpId from leader: term: 1 index: 347. (index mismatch)
I20240502 01:58:36.911886 12935 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 346. Preceding OpId from leader: term: 1 index: 347. (index mismatch)
I20240502 01:58:36.912235 16511 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 347, Last known committed idx: 346, Time since last communication: 0.000s
I20240502 01:58:36.912849 16508 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 347, Last known committed idx: 346, Time since last communication: 0.000s
I20240502 01:58:36.913067 15850 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 347, Last known committed idx: 346, Time since last communication: 0.000s
I20240502 01:58:36.915513 13069 raft_consensus.cc:1261] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 1928367ae8d64ba49a7f5761b2d3dc4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 346. Preceding OpId from leader: term: 1 index: 347. (index mismatch)
I20240502 01:58:36.916028 16508 consensus_queue.cc:1035] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 347, Last known committed idx: 346, Time since last communication: 0.000s
I20240502 01:58:36.916227 16511 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 LEADER]: Committing config change with OpId 1.347: config changed from index 346 to 347, VOTER 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197) evicted. New config: { opid_index: 347 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.918041 12649 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet bc637bf633fc4fe58db54a6bc0821417 with cas_config_opid_index 346: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:36.918370 12935 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.347: config changed from index 346 to 347, VOTER 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197) evicted. New config: { opid_index: 347 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.918931 13069 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.347: config changed from index 346 to 347, VOTER 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197) evicted. New config: { opid_index: 347 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.921253 14365 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.347: config changed from index 346 to 347, VOTER 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197) evicted. New config: { opid_index: 347 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.921293 12661 catalog_manager.cc:5484] T bc637bf633fc4fe58db54a6bc0821417 P 71010353c29d4e988704295c8cd73ef7 reported cstate change: config changed from index 346 to 347, VOTER 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197) evicted. New cstate: current_term: 1 leader_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" committed_config { opid_index: 347 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.921337 15652 raft_consensus.cc:2932] T bc637bf633fc4fe58db54a6bc0821417 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Committing config change with OpId 1.347: config changed from index 346 to 347, VOTER 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197) evicted. New config: { opid_index: 347 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:36.924049 13321 tablet_service.cc:1514] Processing DeleteTablet for tablet bc637bf633fc4fe58db54a6bc0821417 with delete_type TABLET_DATA_TOMBSTONED (TS 6b1e63d6b84a440a8864db2d36b57665 not found in new config with opid_index 347) from {username='slave'} at 127.0.0.1:48890
I20240502 01:58:36.924690 16520 tablet_replica.cc:330] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665: stopping tablet replica
I20240502 01:58:36.924870 16520 raft_consensus.cc:2229] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:36.925100 16520 raft_consensus.cc:2258] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:36.927052 16520 ts_tablet_manager.cc:1875] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:36.928941 16520 ts_tablet_manager.cc:1888] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.346
I20240502 01:58:36.929008 16520 log.cc:1196] T bc637bf633fc4fe58db54a6bc0821417 P 6b1e63d6b84a440a8864db2d36b57665: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal/wals/bc637bf633fc4fe58db54a6bc0821417
I20240502 01:58:36.929559 12649 catalog_manager.cc:4830] TS 6b1e63d6b84a440a8864db2d36b57665 (127.10.133.197:42283): tablet bc637bf633fc4fe58db54a6bc0821417 (table rebalance_test_table_2 [id=41727fe31ec64883ac850e582b40cb0b]) successfully deleted
I20240502 01:58:37.028374 15652 raft_consensus.cc:1203] T eeb77a056e494d5ab85138d8ecc52db9 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.308->[2.309-2.309] Dedup: 2.309->[]
I20240502 01:58:37.174718 16445 raft_consensus.cc:1050] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665: attempting to promote NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 to VOTER
I20240502 01:58:37.175237 16445 consensus_queue.cc:237] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 326, Committed index: 326, Last appended: 1.326, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } }
I20240502 01:58:37.176707 13203 raft_consensus.cc:1261] T f1e0f3e6a85b4998bdaaf83117af6f20 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 326. Preceding OpId from leader: term: 1 index: 327. (index mismatch)
I20240502 01:58:37.176883 12935 raft_consensus.cc:1261] T f1e0f3e6a85b4998bdaaf83117af6f20 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 326. Preceding OpId from leader: term: 1 index: 327. (index mismatch)
I20240502 01:58:37.176978 15652 raft_consensus.cc:1261] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 326. Preceding OpId from leader: term: 1 index: 327. (index mismatch)
I20240502 01:58:37.177070 13069 raft_consensus.cc:1261] T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 326. Preceding OpId from leader: term: 1 index: 327. (index mismatch)
I20240502 01:58:37.177363 12804 raft_consensus.cc:1261] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 326. Preceding OpId from leader: term: 1 index: 327. (index mismatch)
I20240502 01:58:37.177472 16559 consensus_queue.cc:1035] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 327, Last known committed idx: 326, Time since last communication: 0.000s
I20240502 01:58:37.177729 16556 consensus_queue.cc:1035] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 327, Last known committed idx: 326, Time since last communication: 0.000s
I20240502 01:58:37.178057 16558 consensus_queue.cc:1035] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 327, Last known committed idx: 326, Time since last communication: 0.000s
I20240502 01:58:37.178416 16560 consensus_queue.cc:1035] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 327, Last known committed idx: 326, Time since last communication: 0.000s
I20240502 01:58:37.178555 16445 consensus_queue.cc:1035] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 327, Last known committed idx: 326, Time since last communication: 0.000s
I20240502 01:58:37.180922 16445 raft_consensus.cc:2932] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 LEADER]: Committing config change with OpId 1.327: config changed from index 326 to 327, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.181308 13203 raft_consensus.cc:2932] T f1e0f3e6a85b4998bdaaf83117af6f20 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.327: config changed from index 326 to 327, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.181723 12804 raft_consensus.cc:2932] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Committing config change with OpId 1.327: config changed from index 326 to 327, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.183622 13069 raft_consensus.cc:2932] T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.327: config changed from index 326 to 327, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.183802 12657 catalog_manager.cc:5484] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 reported cstate change: config changed from index 326 to 327, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6b1e63d6b84a440a8864db2d36b57665" committed_config { opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:37.183794 12935 raft_consensus.cc:2932] T f1e0f3e6a85b4998bdaaf83117af6f20 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.327: config changed from index 326 to 327, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.186189 15652 raft_consensus.cc:2932] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Committing config change with OpId 1.327: config changed from index 326 to 327, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 327 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { replace: true } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.189813 13341 consensus_queue.cc:237] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 327, Committed index: 327, Last appended: 1.327, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } }
I20240502 01:58:37.191102 13069 raft_consensus.cc:1261] T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 327. Preceding OpId from leader: term: 1 index: 328. (index mismatch)
I20240502 01:58:37.191267 15652 raft_consensus.cc:1261] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 327. Preceding OpId from leader: term: 1 index: 328. (index mismatch)
I20240502 01:58:37.191381 12935 raft_consensus.cc:1261] T f1e0f3e6a85b4998bdaaf83117af6f20 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 327. Preceding OpId from leader: term: 1 index: 328. (index mismatch)
I20240502 01:58:37.191655 16559 consensus_queue.cc:1035] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 328, Last known committed idx: 327, Time since last communication: 0.000s
I20240502 01:58:37.191838 16558 consensus_queue.cc:1035] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 328, Last known committed idx: 327, Time since last communication: 0.000s
I20240502 01:58:37.192091 16561 consensus_queue.cc:1035] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 328, Last known committed idx: 327, Time since last communication: 0.000s
I20240502 01:58:37.193509 16561 raft_consensus.cc:2932] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 LEADER]: Committing config change with OpId 1.328: config changed from index 327 to 328, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.194341 13203 raft_consensus.cc:1261] T f1e0f3e6a85b4998bdaaf83117af6f20 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Refusing update from remote peer 6b1e63d6b84a440a8864db2d36b57665: Log matching property violated. Preceding OpId in replica: term: 1 index: 327. Preceding OpId from leader: term: 1 index: 328. (index mismatch)
I20240502 01:58:37.195205 12649 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet f1e0f3e6a85b4998bdaaf83117af6f20 with cas_config_opid_index 327: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:37.195463 16561 consensus_queue.cc:1035] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 328, Last known committed idx: 327, Time since last communication: 0.000s
I20240502 01:58:37.195694 12935 raft_consensus.cc:2932] T f1e0f3e6a85b4998bdaaf83117af6f20 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.328: config changed from index 327 to 328, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.196111 12659 catalog_manager.cc:5484] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 reported cstate change: config changed from index 327 to 328, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "6b1e63d6b84a440a8864db2d36b57665" committed_config { opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:37.197163 13069 raft_consensus.cc:2932] T f1e0f3e6a85b4998bdaaf83117af6f20 P 71010353c29d4e988704295c8cd73ef7 [term 1 FOLLOWER]: Committing config change with OpId 1.328: config changed from index 327 to 328, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.197271 15652 raft_consensus.cc:2932] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Committing config change with OpId 1.328: config changed from index 327 to 328, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.198563 12784 tablet_service.cc:1514] Processing DeleteTablet for tablet f1e0f3e6a85b4998bdaaf83117af6f20 with delete_type TABLET_DATA_TOMBSTONED (TS 27e2acacdad14caa8f66bc81fa8a2f88 not found in new config with opid_index 328) from {username='slave'} at 127.0.0.1:51568
I20240502 01:58:37.200059 13203 raft_consensus.cc:2932] T f1e0f3e6a85b4998bdaaf83117af6f20 P 3d7bf587aa5a49eb92c3a53d17717149 [term 1 FOLLOWER]: Committing config change with OpId 1.328: config changed from index 327 to 328, VOTER 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193) evicted. New config: { opid_index: 328 OBSOLETE_local: false peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } } peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } } peers { permanent_uuid: "3d7bf587aa5a49eb92c3a53d17717149" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 32825 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.206161 16567 tablet_replica.cc:330] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88: stopping tablet replica
I20240502 01:58:37.206290 16567 raft_consensus.cc:2229] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:37.206467 16567 raft_consensus.cc:2258] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:37.211261 16567 ts_tablet_manager.cc:1875] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:37.213037 16567 ts_tablet_manager.cc:1888] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.327
I20240502 01:58:37.213099 16567 log.cc:1196] T f1e0f3e6a85b4998bdaaf83117af6f20 P 27e2acacdad14caa8f66bc81fa8a2f88: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/f1e0f3e6a85b4998bdaaf83117af6f20
I20240502 01:58:37.213632 12648 catalog_manager.cc:4830] TS 27e2acacdad14caa8f66bc81fa8a2f88 (127.10.133.193:46263): tablet f1e0f3e6a85b4998bdaaf83117af6f20 (table rebalance_test_table_1 [id=744919a455134d42b3ec60abe824250b]) successfully deleted
I20240502 01:58:37.254184 16451 raft_consensus.cc:1050] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88: attempting to promote NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 to VOTER
I20240502 01:58:37.254595 16451 consensus_queue.cc:237] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } }
I20240502 01:58:37.256155 15652 raft_consensus.cc:1261] T 52775623e580480b83a6148e0b453ae5 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 LEARNER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:58:37.256246 13341 raft_consensus.cc:1261] T 52775623e580480b83a6148e0b453ae5 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:58:37.256331 13473 raft_consensus.cc:1261] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:58:37.256402 14365 raft_consensus.cc:1261] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:58:37.256824 16596 consensus_queue.cc:1035] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:58:37.257025 16595 consensus_queue.cc:1035] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:58:37.257122 12935 raft_consensus.cc:1261] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20240502 01:58:37.257201 15954 consensus_queue.cc:1035] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:58:37.257467 16594 consensus_queue.cc:1035] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:58:37.257786 15954 consensus_queue.cc:1035] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20240502 01:58:37.260521 16449 raft_consensus.cc:2932] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.260954 12935 raft_consensus.cc:2932] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.262544 15652 raft_consensus.cc:2932] T 52775623e580480b83a6148e0b453ae5 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.262867 13341 raft_consensus.cc:2932] T 52775623e580480b83a6148e0b453ae5 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.263743 14365 raft_consensus.cc:2932] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.265018 12656 catalog_manager.cc:5484] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: config changed from index 2 to 3, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:37.265031 13473 raft_consensus.cc:2932] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "42bc78875b454c7ab7fce86d56a28c1e" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 40143 } attrs { replace: true } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.268798 12804 consensus_queue.cc:237] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } }
I20240502 01:58:37.270572 15652 raft_consensus.cc:1261] T 52775623e580480b83a6148e0b453ae5 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:37.270568 14365 raft_consensus.cc:1261] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:37.270640 13473 raft_consensus.cc:1261] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:37.270980 16594 consensus_queue.cc:1035] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:37.271277 16596 consensus_queue.cc:1035] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:37.271348 13341 raft_consensus.cc:1261] T 52775623e580480b83a6148e0b453ae5 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:37.271674 16595 consensus_queue.cc:1035] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:37.271832 16594 consensus_queue.cc:1035] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:37.273182 16594 raft_consensus.cc:2932] T 52775623e580480b83a6148e0b453ae5 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.273604 13473 raft_consensus.cc:2932] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.274662 13341 raft_consensus.cc:2932] T 52775623e580480b83a6148e0b453ae5 P 6b1e63d6b84a440a8864db2d36b57665 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.275399 12648 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 52775623e580480b83a6148e0b453ae5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:37.276072 12661 catalog_manager.cc:5484] T 52775623e580480b83a6148e0b453ae5 P 1928367ae8d64ba49a7f5761b2d3dc4a reported cstate change: config changed from index 3 to 4, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New cstate: current_term: 1 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.276060 15652 raft_consensus.cc:2932] T 52775623e580480b83a6148e0b453ae5 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.276859 14365 raft_consensus.cc:2932] T 52775623e580480b83a6148e0b453ae5 P 1ef9768a03e545fba961cfeee4c1c867 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.279130 12918 tablet_service.cc:1514] Processing DeleteTablet for tablet 52775623e580480b83a6148e0b453ae5 with delete_type TABLET_DATA_TOMBSTONED (TS 42bc78875b454c7ab7fce86d56a28c1e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60860
I20240502 01:58:37.279487 16602 tablet_replica.cc:330] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e: stopping tablet replica
I20240502 01:58:37.279664 16602 raft_consensus.cc:2229] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:37.279825 16602 raft_consensus.cc:2258] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:37.281601 16602 ts_tablet_manager.cc:1875] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:37.283520 16602 ts_tablet_manager.cc:1888] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20240502 01:58:37.283584 16602 log.cc:1196] T 52775623e580480b83a6148e0b453ae5 P 42bc78875b454c7ab7fce86d56a28c1e: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/52775623e580480b83a6148e0b453ae5
I20240502 01:58:37.284087 12646 catalog_manager.cc:4830] TS 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143): tablet 52775623e580480b83a6148e0b453ae5 (table TestTable [id=844e44214ba04ed5a1c080b35744bee3]) successfully deleted
I20240502 01:58:37.646011 16595 raft_consensus.cc:1050] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88: attempting to promote NON_VOTER 6414b27f8e3f4f66ba81b2e9598caf27 to VOTER
I20240502 01:58:37.646726 16595 consensus_queue.cc:237] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 309, Committed index: 309, Last appended: 2.309, Last appended by leader: 253, Current term: 2, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 310 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } }
I20240502 01:58:37.648327 15652 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 2 LEARNER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 2 index: 309. Preceding OpId from leader: term: 2 index: 310. (index mismatch)
I20240502 01:58:37.648845 16594 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 310, Last known committed idx: 309, Time since last communication: 0.000s
I20240502 01:58:37.648931 13473 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 2 index: 309. Preceding OpId from leader: term: 2 index: 310. (index mismatch)
I20240502 01:58:37.649012 14365 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 2 index: 309. Preceding OpId from leader: term: 2 index: 310. (index mismatch)
I20240502 01:58:37.649277 13341 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 2 index: 309. Preceding OpId from leader: term: 2 index: 310. (index mismatch)
I20240502 01:58:37.649567 16594 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 310, Last known committed idx: 309, Time since last communication: 0.000s
I20240502 01:58:37.649741 16449 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 310, Last known committed idx: 309, Time since last communication: 0.000s
I20240502 01:58:37.649910 16596 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 310, Last known committed idx: 309, Time since last communication: 0.000s
I20240502 01:58:37.650671 13069 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 2 index: 309. Preceding OpId from leader: term: 2 index: 310. (index mismatch)
I20240502 01:58:37.651479 16451 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 310, Last known committed idx: 309, Time since last communication: 0.000s
I20240502 01:58:37.652261 16595 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 2 LEADER]: Committing config change with OpId 2.310: config changed from index 309 to 310, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 310 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.652766 13341 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 2 FOLLOWER]: Committing config change with OpId 2.310: config changed from index 309 to 310, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 310 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.653504 14365 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 2 FOLLOWER]: Committing config change with OpId 2.310: config changed from index 309 to 310, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 310 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.655048 13473 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 2 FOLLOWER]: Committing config change with OpId 2.310: config changed from index 309 to 310, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 310 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.655786 12661 catalog_manager.cc:5484] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 reported cstate change: config changed from index 309 to 310, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 310 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.657428 13069 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 2 FOLLOWER]: Committing config change with OpId 2.310: config changed from index 309 to 310, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 310 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.661415 15652 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 2 FOLLOWER]: Committing config change with OpId 2.310: config changed from index 309 to 310, 6414b27f8e3f4f66ba81b2e9598caf27 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 310 OBSOLETE_local: false peers { permanent_uuid: "71010353c29d4e988704295c8cd73ef7" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 33887 } attrs { replace: true } } peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.661710 12804 consensus_queue.cc:237] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 310, Committed index: 310, Last appended: 2.310, Last appended by leader: 253, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 311 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } }
I20240502 01:58:37.663429 13473 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 2 index: 310. Preceding OpId from leader: term: 2 index: 311. (index mismatch)
I20240502 01:58:37.663447 13341 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 2 index: 310. Preceding OpId from leader: term: 2 index: 311. (index mismatch)
I20240502 01:58:37.664340 15652 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 2 index: 310. Preceding OpId from leader: term: 2 index: 311. (index mismatch)
I20240502 01:58:37.664623 16449 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 311, Last known committed idx: 310, Time since last communication: 0.000s
I20240502 01:58:37.664831 16594 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 311, Last known committed idx: 310, Time since last communication: 0.000s
I20240502 01:58:37.665210 16451 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 311, Last known committed idx: 310, Time since last communication: 0.000s
I20240502 01:58:37.666970 16594 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [term 2 LEADER]: Committing config change with OpId 2.311: config changed from index 310 to 311, VOTER 71010353c29d4e988704295c8cd73ef7 (127.10.133.195) evicted. New config: { opid_index: 311 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.667110 14363 raft_consensus.cc:1261] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 2 FOLLOWER]: Refusing update from remote peer 27e2acacdad14caa8f66bc81fa8a2f88: Log matching property violated. Preceding OpId in replica: term: 2 index: 310. Preceding OpId from leader: term: 2 index: 311. (index mismatch)
I20240502 01:58:37.667409 13341 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 6b1e63d6b84a440a8864db2d36b57665 [term 2 FOLLOWER]: Committing config change with OpId 2.311: config changed from index 310 to 311, VOTER 71010353c29d4e988704295c8cd73ef7 (127.10.133.195) evicted. New config: { opid_index: 311 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.667611 13473 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 1928367ae8d64ba49a7f5761b2d3dc4a [term 2 FOLLOWER]: Committing config change with OpId 2.311: config changed from index 310 to 311, VOTER 71010353c29d4e988704295c8cd73ef7 (127.10.133.195) evicted. New config: { opid_index: 311 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.669332 12648 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet eeb77a056e494d5ab85138d8ecc52db9 with cas_config_opid_index 310: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:37.669739 15954 consensus_queue.cc:1035] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 311, Last known committed idx: 310, Time since last communication: 0.000s
I20240502 01:58:37.670635 12661 catalog_manager.cc:5484] T eeb77a056e494d5ab85138d8ecc52db9 P 27e2acacdad14caa8f66bc81fa8a2f88 reported cstate change: config changed from index 310 to 311, VOTER 71010353c29d4e988704295c8cd73ef7 (127.10.133.195) evicted. New cstate: current_term: 2 leader_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" committed_config { opid_index: 311 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:37.670953 14365 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 1ef9768a03e545fba961cfeee4c1c867 [term 2 FOLLOWER]: Committing config change with OpId 2.311: config changed from index 310 to 311, VOTER 71010353c29d4e988704295c8cd73ef7 (127.10.133.195) evicted. New config: { opid_index: 311 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.673321 13051 tablet_service.cc:1514] Processing DeleteTablet for tablet eeb77a056e494d5ab85138d8ecc52db9 with delete_type TABLET_DATA_TOMBSTONED (TS 71010353c29d4e988704295c8cd73ef7 not found in new config with opid_index 311) from {username='slave'} at 127.0.0.1:57476
I20240502 01:58:37.673692 16629 tablet_replica.cc:330] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7: stopping tablet replica
I20240502 01:58:37.673959 16629 raft_consensus.cc:2229] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:37.674248 16629 raft_consensus.cc:2258] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:37.674537 15652 raft_consensus.cc:2932] T eeb77a056e494d5ab85138d8ecc52db9 P 6414b27f8e3f4f66ba81b2e9598caf27 [term 2 FOLLOWER]: Committing config change with OpId 2.311: config changed from index 310 to 311, VOTER 71010353c29d4e988704295c8cd73ef7 (127.10.133.195) evicted. New config: { opid_index: 311 OBSOLETE_local: false peers { permanent_uuid: "1928367ae8d64ba49a7f5761b2d3dc4a" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 39759 } } peers { permanent_uuid: "6b1e63d6b84a440a8864db2d36b57665" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 42283 } } peers { permanent_uuid: "1ef9768a03e545fba961cfeee4c1c867" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34821 } attrs { promote: false } } peers { permanent_uuid: "27e2acacdad14caa8f66bc81fa8a2f88" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 46263 } attrs { promote: false } } peers { permanent_uuid: "6414b27f8e3f4f66ba81b2e9598caf27" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46103 } attrs { promote: false } } }
I20240502 01:58:37.676898 16629 ts_tablet_manager.cc:1875] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:37.679205 16629 ts_tablet_manager.cc:1888] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.310
I20240502 01:58:37.679436 16629 log.cc:1196] T eeb77a056e494d5ab85138d8ecc52db9 P 71010353c29d4e988704295c8cd73ef7: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/wals/eeb77a056e494d5ab85138d8ecc52db9
I20240502 01:58:37.680065 12649 catalog_manager.cc:4830] TS 71010353c29d4e988704295c8cd73ef7 (127.10.133.195:33887): tablet eeb77a056e494d5ab85138d8ecc52db9 (table rebalance_test_table_1 [id=744919a455134d42b3ec60abe824250b]) successfully deleted
I20240502 01:58:37.735971 12918 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:37.736949 12784 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:37.745247 14349 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:37.745541 13321 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:37.745719 13452 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:37.766090 15632 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:37.768343 13051 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:37.769533 13185 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:58:37.858095 13452 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:37.860388 12784 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:37.862174 15632 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:37.862890 12918 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:37.868175 14349 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:37.869216 13185 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:58:37.878520 13321 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:37.887558 13051 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:38.005496 13452 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:38.006659 12784 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:38.010591 13185 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:58:38.011883 12918 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:38.013345 15632 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:38.030558 14349 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:38.047464 13321 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:58:38.050230 13051 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
cbd2873c124c4aadb8dc3e7d69935b04 | 127.10.133.254:41317 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
allow_unsafe_replication_factor | true | runtime,unsafe | all 1 server(s) checked
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
raft_prepare_replacement_before_eviction | true | experimental,advanced | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.133.212:37675 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
1928367ae8d64ba49a7f5761b2d3dc4a | 127.10.133.198:39759 | HEALTHY | <none> | 2 | 0
1ef9768a03e545fba961cfeee4c1c867 | 127.10.133.199:34821 | HEALTHY | <none> | 0 | 0
27e2acacdad14caa8f66bc81fa8a2f88 | 127.10.133.193:46263 | HEALTHY | <none> | 9 | 0
3d7bf587aa5a49eb92c3a53d17717149 | 127.10.133.196:32825 | HEALTHY | <none> | 1 | 0
42bc78875b454c7ab7fce86d56a28c1e | 127.10.133.194:40143 | HEALTHY | <none> | 2 | 0
6414b27f8e3f4f66ba81b2e9598caf27 | 127.10.133.200:46103 | HEALTHY | <none> | 0 | 0
6b1e63d6b84a440a8864db2d36b57665 | 127.10.133.197:42283 | HEALTHY | <none> | 2 | 0
71010353c29d4e988704295c8cd73ef7 | 127.10.133.195:33887 | HEALTHY | <none> | 0 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 8
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
ipki_server_key_size | 768 | experimental | all 8 server(s) checked
local_ip_for_outbound_sockets | 127.10.133.193 | experimental | 127.10.133.193:46263
local_ip_for_outbound_sockets | 127.10.133.194 | experimental | 127.10.133.194:40143
local_ip_for_outbound_sockets | 127.10.133.195 | experimental | 127.10.133.195:33887
local_ip_for_outbound_sockets | 127.10.133.196 | experimental | 127.10.133.196:32825
local_ip_for_outbound_sockets | 127.10.133.197 | experimental | 127.10.133.197:42283
local_ip_for_outbound_sockets | 127.10.133.198 | experimental | 127.10.133.198:39759
local_ip_for_outbound_sockets | 127.10.133.199 | experimental | 127.10.133.199:34821
local_ip_for_outbound_sockets | 127.10.133.200 | experimental | 127.10.133.200:46103
never_fsync | true | unsafe,advanced | all 8 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 8 server(s) checked
raft_prepare_replacement_before_eviction | true | experimental,advanced | all 8 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 8 server(s) checked
server_dump_info_format | pb | hidden | all 8 server(s) checked
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.10.133.193:46263
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.10.133.194:40143
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.10.133.195:33887
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb | hidden | 127.10.133.196:32825
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/info.pb | hidden | 127.10.133.197:42283
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/info.pb | hidden | 127.10.133.198:39759
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/info.pb | hidden | 127.10.133.199:34821
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalanceParamTest.Rebalance_7.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/info.pb | hidden | 127.10.133.200:46103
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.133.212:37675 | all 8 server(s) checked
time_source | builtin | all 8 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 9 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
------------------------+----+---------+---------------+---------+------------+------------------+-------------
TestTable | 5 | HEALTHY | 1 | 1 | 0 | 0 | 0
rebalance_test_table_0 | 5 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_1 | 5 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_2 | 5 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_3 | 5 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_4 | 5 | HEALTHY | 3 | 3 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 10
First Quartile | 10
Median | 10
Third Quartile | 10
Maximum | 10
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 8
Tables | 6
Tablets | 16
Replicas | 80
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20240502 01:58:38.075383 10775 log_verifier.cc:126] Checking tablet 16195ae890d445e39ed7ecdadde3009c
I20240502 01:58:38.185324 10775 log_verifier.cc:177] Verified matching terms for 197 ops in tablet 16195ae890d445e39ed7ecdadde3009c
I20240502 01:58:38.185483 10775 log_verifier.cc:126] Checking tablet 24d91cbbc7cb4be7a0034613b96ac1cd
I20240502 01:58:38.305208 10775 log_verifier.cc:177] Verified matching terms for 232 ops in tablet 24d91cbbc7cb4be7a0034613b96ac1cd
I20240502 01:58:38.305415 10775 log_verifier.cc:126] Checking tablet 281ea2fa1f9f49cebd4bb3620335168a
I20240502 01:58:38.406432 10775 log_verifier.cc:177] Verified matching terms for 191 ops in tablet 281ea2fa1f9f49cebd4bb3620335168a
I20240502 01:58:38.406613 10775 log_verifier.cc:126] Checking tablet 2963f09accd44e3db75d2f2c9b38b6cd
I20240502 01:58:38.510417 10775 log_verifier.cc:177] Verified matching terms for 224 ops in tablet 2963f09accd44e3db75d2f2c9b38b6cd
I20240502 01:58:38.510596 10775 log_verifier.cc:126] Checking tablet 400199df936243f2b49a4b556f29c575
I20240502 01:58:38.614919 10775 log_verifier.cc:177] Verified matching terms for 211 ops in tablet 400199df936243f2b49a4b556f29c575
I20240502 01:58:38.615103 10775 log_verifier.cc:126] Checking tablet 5175c37ef65f4f2fb83d64497592a180
I20240502 01:58:38.716576 10775 log_verifier.cc:177] Verified matching terms for 197 ops in tablet 5175c37ef65f4f2fb83d64497592a180
I20240502 01:58:38.716734 10775 log_verifier.cc:126] Checking tablet 52775623e580480b83a6148e0b453ae5
I20240502 01:58:38.744622 10775 log_verifier.cc:177] Verified matching terms for 4 ops in tablet 52775623e580480b83a6148e0b453ae5
I20240502 01:58:38.744694 10775 log_verifier.cc:126] Checking tablet 6b4405ed71824af7bde2e54f5f592d10
I20240502 01:58:38.872534 10775 log_verifier.cc:177] Verified matching terms for 277 ops in tablet 6b4405ed71824af7bde2e54f5f592d10
I20240502 01:58:38.872712 10775 log_verifier.cc:126] Checking tablet 6eef7d25de5541bbbc7576185e097ed1
I20240502 01:58:38.962992 10775 log_verifier.cc:177] Verified matching terms for 154 ops in tablet 6eef7d25de5541bbbc7576185e097ed1
I20240502 01:58:38.963117 10775 log_verifier.cc:126] Checking tablet 773b692c40df457caf7baea5a7b21c27
I20240502 01:58:39.049834 10775 log_verifier.cc:177] Verified matching terms for 158 ops in tablet 773b692c40df457caf7baea5a7b21c27
I20240502 01:58:39.049962 10775 log_verifier.cc:126] Checking tablet 8ec2e7e6494c42749311d109abfdd205
I20240502 01:58:39.190927 10775 log_verifier.cc:177] Verified matching terms for 304 ops in tablet 8ec2e7e6494c42749311d109abfdd205
I20240502 01:58:39.191125 10775 log_verifier.cc:126] Checking tablet a8e8a2483ab8452f9b798930ebc069ac
I20240502 01:58:39.344933 10775 log_verifier.cc:177] Verified matching terms for 339 ops in tablet a8e8a2483ab8452f9b798930ebc069ac
I20240502 01:58:39.345160 10775 log_verifier.cc:126] Checking tablet bc637bf633fc4fe58db54a6bc0821417
I20240502 01:58:39.498335 10775 log_verifier.cc:177] Verified matching terms for 347 ops in tablet bc637bf633fc4fe58db54a6bc0821417
I20240502 01:58:39.498567 10775 log_verifier.cc:126] Checking tablet eb9d0001da2643ed8a9d78e79e30fccd
I20240502 01:58:39.580134 10775 log_verifier.cc:177] Verified matching terms for 155 ops in tablet eb9d0001da2643ed8a9d78e79e30fccd
I20240502 01:58:39.580298 10775 log_verifier.cc:126] Checking tablet eeb77a056e494d5ab85138d8ecc52db9
I20240502 01:58:39.721164 10775 log_verifier.cc:177] Verified matching terms for 311 ops in tablet eeb77a056e494d5ab85138d8ecc52db9
I20240502 01:58:39.721381 10775 log_verifier.cc:126] Checking tablet f1e0f3e6a85b4998bdaaf83117af6f20
I20240502 01:58:39.867376 10775 log_verifier.cc:177] Verified matching terms for 328 ops in tablet f1e0f3e6a85b4998bdaaf83117af6f20
I20240502 01:58:39.869009 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 12723
I20240502 01:58:39.879877 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 12854
I20240502 01:58:39.887429 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 12988
W20240502 01:58:39.889278 13273 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.133.194:40143: connect: Connection refused (error 111)
W20240502 01:58:39.890043 13273 consensus_peers.cc:485] T f1e0f3e6a85b4998bdaaf83117af6f20 P 6b1e63d6b84a440a8864db2d36b57665 -> Peer 42bc78875b454c7ab7fce86d56a28c1e (127.10.133.194:40143): Couldn't send request to peer 42bc78875b454c7ab7fce86d56a28c1e. Status: Network error: Client connection negotiation failed: client connection to 127.10.133.194:40143: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:39.894204 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 13123
I20240502 01:58:39.900190 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 13258
I20240502 01:58:39.907732 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 13391
I20240502 01:58:39.914384 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 14285
I20240502 01:58:39.920622 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 15569
I20240502 01:58:39.926690 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 12631
2024-05-02T01:58:39Z chronyd exiting
[ OK ] RebalanceParamTest.Rebalance/7 (34056 ms)
[----------] 1 test from RebalanceParamTest (34056 ms total)
[----------] 1 test from TserverAddedDuringRebalancingTest
[ RUN ] TserverAddedDuringRebalancingTest.TserverStarts/1
I20240502 01:58:40.032379 10775 test_util.cc:268] Using random seed: -249040266
I20240502 01:58:40.033185 10775 ts_itest-base.cc:112] Starting cluster with:
I20240502 01:58:40.033236 10775 ts_itest-base.cc:113] --------------
I20240502 01:58:40.033254 10775 ts_itest-base.cc:114] 8 tablet servers
I20240502 01:58:40.033272 10775 ts_itest-base.cc:115] 3 replicas per TS
I20240502 01:58:40.033298 10775 ts_itest-base.cc:116] --------------
2024-05-02T01:58:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T01:58:40Z Disabled control of system clock
I20240502 01:58:40.042395 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.133.254:37275
--webserver_interface=127.10.133.254
--webserver_port=0
--builtin_ntp_servers=127.10.133.212:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.133.254:37275
--tserver_unresponsive_timeout_ms=3000
--enable_range_replica_placement=false
--raft_prepare_replacement_before_eviction=true
--enable_range_replica_placement=false with env {}
W20240502 01:58:40.142119 16748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:40.142321 16748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:40.142360 16748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:40.145300 16748 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:40.145361 16748 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 01:58:40.145383 16748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:40.145402 16748 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 01:58:40.145439 16748 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 01:58:40.148990 16748 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
--enable_range_replica_placement=false
--ipki_ca_key_size=768
--master_addresses=127.10.133.254:37275
--tserver_unresponsive_timeout_ms=3000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.133.254:37275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.133.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.16748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:40.149793 16748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:40.150859 16748 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:40.158179 16754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:40.158690 16756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:40.159545 16753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:40.160377 16748 server_base.cc:1034] running on GCE node
I20240502 01:58:40.160820 16748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:40.161649 16748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:40.162793 16748 hybrid_clock.cc:648] HybridClock initialized: now 1714615120162774 us; error 30 us; skew 500 ppm
I20240502 01:58:40.168743 16748 webserver.cc:460] Webserver started at http://127.10.133.254:36545/ using document root <none> and password file <none>
I20240502 01:58:40.169293 16748 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:40.169348 16748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:40.169529 16748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:40.171187 16748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "c5fc5b5e661947f2a14f067ed4c09d1d"
format_stamp: "Formatted at 2024-05-02 01:58:40 on dist-test-slave-dr9f"
I20240502 01:58:40.171667 16748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "c5fc5b5e661947f2a14f067ed4c09d1d"
format_stamp: "Formatted at 2024-05-02 01:58:40 on dist-test-slave-dr9f"
I20240502 01:58:40.174832 16748 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 01:58:40.176985 16763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:40.177904 16748 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240502 01:58:40.178030 16748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
uuid: "c5fc5b5e661947f2a14f067ed4c09d1d"
format_stamp: "Formatted at 2024-05-02 01:58:40 on dist-test-slave-dr9f"
I20240502 01:58:40.178113 16748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:40.206732 16748 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:40.207357 16748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:40.207548 16748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:40.213750 16748 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.254:37275
I20240502 01:58:40.213764 16816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.254:37275 every 8 connection(s)
I20240502 01:58:40.214776 16748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20240502 01:58:40.217212 16817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:40.217263 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 16748
I20240502 01:58:40.217388 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal/instance
I20240502 01:58:40.222640 16817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d: Bootstrap starting.
I20240502 01:58:40.224756 16817 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:40.225478 16817 log.cc:824] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:40.227211 16817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d: No bootstrap required, opened a new log
I20240502 01:58:40.229503 16817 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5fc5b5e661947f2a14f067ed4c09d1d" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 37275 } }
I20240502 01:58:40.229693 16817 raft_consensus.cc:374] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:40.229745 16817 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5fc5b5e661947f2a14f067ed4c09d1d, State: Initialized, Role: FOLLOWER
I20240502 01:58:40.230140 16817 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5fc5b5e661947f2a14f067ed4c09d1d" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 37275 } }
I20240502 01:58:40.230259 16817 raft_consensus.cc:388] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:58:40.230316 16817 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:58:40.230415 16817 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:40.231223 16817 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5fc5b5e661947f2a14f067ed4c09d1d" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 37275 } }
I20240502 01:58:40.231539 16817 leader_election.cc:302] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5fc5b5e661947f2a14f067ed4c09d1d; no voters:
I20240502 01:58:40.231781 16817 leader_election.cc:288] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:58:40.231885 16822 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:40.232097 16822 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d [term 1 LEADER]: Becoming Leader. State: Replica: c5fc5b5e661947f2a14f067ed4c09d1d, State: Running, Role: LEADER
I20240502 01:58:40.232805 16817 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d [sys.catalog]: configured and running, proceeding with master startup.
I20240502 01:58:40.232797 16822 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5fc5b5e661947f2a14f067ed4c09d1d" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 37275 } }
I20240502 01:58:40.234257 16823 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5fc5b5e661947f2a14f067ed4c09d1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5fc5b5e661947f2a14f067ed4c09d1d" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 37275 } } }
I20240502 01:58:40.234303 16824 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5fc5b5e661947f2a14f067ed4c09d1d. Latest consensus state: current_term: 1 leader_uuid: "c5fc5b5e661947f2a14f067ed4c09d1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5fc5b5e661947f2a14f067ed4c09d1d" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 37275 } } }
I20240502 01:58:40.234390 16824 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d [sys.catalog]: This master's current role is: LEADER
I20240502 01:58:40.234390 16823 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d [sys.catalog]: This master's current role is: LEADER
W20240502 01:58:40.237080 16837 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20240502 01:58:40.237144 16837 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20240502 01:58:40.237202 16835 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 01:58:40.238085 16835 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 01:58:40.242281 16835 catalog_manager.cc:1347] Generated new cluster ID: 7b93c433d1a14a7986b7548df4319091
I20240502 01:58:40.242339 16835 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 01:58:40.254029 16835 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 01:58:40.255124 16835 catalog_manager.cc:1504] Loading token signing keys...
I20240502 01:58:40.265841 16835 catalog_manager.cc:5857] T 00000000000000000000000000000000 P c5fc5b5e661947f2a14f067ed4c09d1d: Generated new TSK 0
I20240502 01:58:40.266583 16835 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 01:58:40.274595 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.193:0
--local_ip_for_outbound_sockets=127.10.133.193
--webserver_interface=127.10.133.193
--webserver_port=0
--tserver_master_addrs=127.10.133.254:37275
--builtin_ntp_servers=127.10.133.212:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
W20240502 01:58:40.378226 16841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:40.378420 16841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:40.378473 16841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:40.381455 16841 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:40.381511 16841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:40.381609 16841 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.193
I20240502 01:58:40.385118 16841 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.133.193
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.10.133.254:37275
--never_fsync=true
--heap_profile_path=/tmp/kudu.16841
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.193
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:40.385939 16841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:40.387012 16841 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:40.395341 16849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:40.395888 16846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:40.396754 16847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:40.397652 16841 server_base.cc:1034] running on GCE node
I20240502 01:58:40.398068 16841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:40.398581 16841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:40.399727 16841 hybrid_clock.cc:648] HybridClock initialized: now 1714615120399716 us; error 36 us; skew 500 ppm
I20240502 01:58:40.401592 16841 webserver.cc:460] Webserver started at http://127.10.133.193:42923/ using document root <none> and password file <none>
I20240502 01:58:40.402141 16841 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:40.402202 16841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:40.402375 16841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:40.403929 16841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "191fe00ca08b44c9aef6646e86aecebc"
format_stamp: "Formatted at 2024-05-02 01:58:40 on dist-test-slave-dr9f"
I20240502 01:58:40.404385 16841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "191fe00ca08b44c9aef6646e86aecebc"
format_stamp: "Formatted at 2024-05-02 01:58:40 on dist-test-slave-dr9f"
I20240502 01:58:40.407542 16841 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20240502 01:58:40.409694 16855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:40.410620 16841 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:40.410732 16841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "191fe00ca08b44c9aef6646e86aecebc"
format_stamp: "Formatted at 2024-05-02 01:58:40 on dist-test-slave-dr9f"
I20240502 01:58:40.410809 16841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:40.434127 16841 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:40.434756 16841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:40.434911 16841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:40.435403 16841 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:40.436247 16841 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:40.436295 16841 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:40.436350 16841 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:40.436383 16841 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:40.444473 16841 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.193:45571
I20240502 01:58:40.444501 16970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.193:45571 every 8 connection(s)
I20240502 01:58:40.445348 16841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20240502 01:58:40.450356 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 16841
I20240502 01:58:40.450479 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20240502 01:58:40.452612 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.194:0
--local_ip_for_outbound_sockets=127.10.133.194
--webserver_interface=127.10.133.194
--webserver_port=0
--tserver_master_addrs=127.10.133.254:37275
--builtin_ntp_servers=127.10.133.212:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 01:58:40.454284 16971 heartbeater.cc:347] Connected to a master server at 127.10.133.254:37275
I20240502 01:58:40.454494 16971 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:40.455013 16971 heartbeater.cc:511] Master 127.10.133.254:37275 requested a full tablet report, sending...
I20240502 01:58:40.456377 16780 ts_manager.cc:194] Registered new tserver with Master: 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:40.457481 16780 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.193:57391
W20240502 01:58:40.556077 16974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:40.556293 16974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:40.556370 16974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:40.559397 16974 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:40.559464 16974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:40.559562 16974 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.194
I20240502 01:58:40.563128 16974 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.133.194
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.10.133.254:37275
--never_fsync=true
--heap_profile_path=/tmp/kudu.16974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.194
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:40.564003 16974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:40.565101 16974 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:40.573773 16979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:40.574290 16980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:40.574918 16982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:40.575878 16974 server_base.cc:1034] running on GCE node
I20240502 01:58:40.576225 16974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:40.576736 16974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:40.577884 16974 hybrid_clock.cc:648] HybridClock initialized: now 1714615120577862 us; error 35 us; skew 500 ppm
I20240502 01:58:40.579744 16974 webserver.cc:460] Webserver started at http://127.10.133.194:37877/ using document root <none> and password file <none>
I20240502 01:58:40.580236 16974 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:40.580286 16974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:40.580436 16974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:40.582140 16974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "6431e35365644aac943c07c97e370fee"
format_stamp: "Formatted at 2024-05-02 01:58:40 on dist-test-slave-dr9f"
I20240502 01:58:40.582600 16974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "6431e35365644aac943c07c97e370fee"
format_stamp: "Formatted at 2024-05-02 01:58:40 on dist-test-slave-dr9f"
I20240502 01:58:40.585744 16974 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20240502 01:58:40.587894 16988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:40.588864 16974 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:40.588953 16974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "6431e35365644aac943c07c97e370fee"
format_stamp: "Formatted at 2024-05-02 01:58:40 on dist-test-slave-dr9f"
I20240502 01:58:40.589023 16974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:40.611086 16974 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:40.611653 16974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:40.611780 16974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:40.612237 16974 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:40.613052 16974 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:40.613096 16974 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:40.613134 16974 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:40.613154 16974 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:40.621083 16974 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.194:37811
I20240502 01:58:40.621111 17105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.194:37811 every 8 connection(s)
I20240502 01:58:40.621937 16974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20240502 01:58:40.628551 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 16974
I20240502 01:58:40.628674 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20240502 01:58:40.630275 17106 heartbeater.cc:347] Connected to a master server at 127.10.133.254:37275
I20240502 01:58:40.630487 17106 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:40.630844 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.195:0
--local_ip_for_outbound_sockets=127.10.133.195
--webserver_interface=127.10.133.195
--webserver_port=0
--tserver_master_addrs=127.10.133.254:37275
--builtin_ntp_servers=127.10.133.212:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 01:58:40.630973 17106 heartbeater.cc:511] Master 127.10.133.254:37275 requested a full tablet report, sending...
I20240502 01:58:40.631916 16780 ts_manager.cc:194] Registered new tserver with Master: 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:40.632491 16780 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.194:54081
W20240502 01:58:40.734444 17110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:40.734650 17110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:40.734709 17110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:40.737685 17110 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:40.737746 17110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:40.737844 17110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.195
I20240502 01:58:40.741163 17110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.133.195
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.10.133.254:37275
--never_fsync=true
--heap_profile_path=/tmp/kudu.17110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.195
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:40.741967 17110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:40.742996 17110 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:40.751184 17118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:40.751672 17115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:40.752568 17116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:40.753451 17110 server_base.cc:1034] running on GCE node
I20240502 01:58:40.753794 17110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:40.754374 17110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:40.755527 17110 hybrid_clock.cc:648] HybridClock initialized: now 1714615120755509 us; error 32 us; skew 500 ppm
I20240502 01:58:40.757340 17110 webserver.cc:460] Webserver started at http://127.10.133.195:36525/ using document root <none> and password file <none>
I20240502 01:58:40.757884 17110 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:40.757939 17110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:40.758137 17110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:40.759739 17110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "a1c00c21761540dea7ddae8d0dd26df4"
format_stamp: "Formatted at 2024-05-02 01:58:40 on dist-test-slave-dr9f"
I20240502 01:58:40.760186 17110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "a1c00c21761540dea7ddae8d0dd26df4"
format_stamp: "Formatted at 2024-05-02 01:58:40 on dist-test-slave-dr9f"
I20240502 01:58:40.763358 17110 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 01:58:40.765377 17124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:40.766450 17110 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 01:58:40.766566 17110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "a1c00c21761540dea7ddae8d0dd26df4"
format_stamp: "Formatted at 2024-05-02 01:58:40 on dist-test-slave-dr9f"
I20240502 01:58:40.766672 17110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:40.801374 17110 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:40.801950 17110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:40.802110 17110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:40.802548 17110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:40.803308 17110 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:40.803349 17110 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:40.803385 17110 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:40.803403 17110 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:40.811316 17110 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.195:35923
I20240502 01:58:40.811383 17239 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.195:35923 every 8 connection(s)
I20240502 01:58:40.813513 17110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20240502 01:58:40.816881 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 17110
I20240502 01:58:40.816998 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20240502 01:58:40.820008 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.196:0
--local_ip_for_outbound_sockets=127.10.133.196
--webserver_interface=127.10.133.196
--webserver_port=0
--tserver_master_addrs=127.10.133.254:37275
--builtin_ntp_servers=127.10.133.212:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 01:58:40.823038 17240 heartbeater.cc:347] Connected to a master server at 127.10.133.254:37275
I20240502 01:58:40.823235 17240 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:40.823768 17240 heartbeater.cc:511] Master 127.10.133.254:37275 requested a full tablet report, sending...
I20240502 01:58:40.824826 16780 ts_manager.cc:194] Registered new tserver with Master: a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:40.825615 16780 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.195:39571
W20240502 01:58:40.939327 17243 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:40.939534 17243 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:40.939579 17243 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:40.942378 17243 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:40.942430 17243 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:40.942494 17243 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.196
I20240502 01:58:40.945878 17243 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.196:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.10.133.196
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.10.133.254:37275
--never_fsync=true
--heap_profile_path=/tmp/kudu.17243
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.196
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:40.946738 17243 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:40.947799 17243 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:40.956190 17251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:40.956916 17248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:40.957650 17249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:40.958312 17243 server_base.cc:1034] running on GCE node
I20240502 01:58:40.958652 17243 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:40.959172 17243 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:40.960333 17243 hybrid_clock.cc:648] HybridClock initialized: now 1714615120960307 us; error 38 us; skew 500 ppm
I20240502 01:58:40.962204 17243 webserver.cc:460] Webserver started at http://127.10.133.196:42247/ using document root <none> and password file <none>
I20240502 01:58:40.962741 17243 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:40.962798 17243 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:40.962983 17243 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:40.964594 17243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "ec11d4bb3a064a94a80084142637b441"
format_stamp: "Formatted at 2024-05-02 01:58:40 on dist-test-slave-dr9f"
I20240502 01:58:40.965061 17243 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "ec11d4bb3a064a94a80084142637b441"
format_stamp: "Formatted at 2024-05-02 01:58:40 on dist-test-slave-dr9f"
I20240502 01:58:40.968335 17243 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 01:58:40.970485 17257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:40.971537 17243 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:40.971626 17243 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "ec11d4bb3a064a94a80084142637b441"
format_stamp: "Formatted at 2024-05-02 01:58:40 on dist-test-slave-dr9f"
I20240502 01:58:40.971698 17243 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:40.987375 17243 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:40.987929 17243 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:40.988057 17243 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:40.988497 17243 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:40.989317 17243 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:40.989360 17243 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:40.989396 17243 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:40.989416 17243 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:40.998034 17243 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.196:38135
I20240502 01:58:40.998064 17371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.196:38135 every 8 connection(s)
I20240502 01:58:40.998903 17243 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20240502 01:58:41.006377 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 17243
I20240502 01:58:41.006525 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20240502 01:58:41.006897 17372 heartbeater.cc:347] Connected to a master server at 127.10.133.254:37275
I20240502 01:58:41.007108 17372 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:41.007663 17372 heartbeater.cc:511] Master 127.10.133.254:37275 requested a full tablet report, sending...
I20240502 01:58:41.008607 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.197:0
--local_ip_for_outbound_sockets=127.10.133.197
--webserver_interface=127.10.133.197
--webserver_port=0
--tserver_master_addrs=127.10.133.254:37275
--builtin_ntp_servers=127.10.133.212:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 01:58:41.008610 16780 ts_manager.cc:194] Registered new tserver with Master: ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:41.009146 16780 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.196:41729
W20240502 01:58:41.113636 17375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:41.113878 17375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:41.113940 17375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:41.116986 17375 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:41.117044 17375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:41.117143 17375 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.197
I20240502 01:58:41.120592 17375 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.197:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.10.133.197
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.10.133.254:37275
--never_fsync=true
--heap_profile_path=/tmp/kudu.17375
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.197
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:41.121403 17375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:41.122541 17375 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:41.131071 17381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:41.131544 17380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:41.132408 17383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:41.133308 17375 server_base.cc:1034] running on GCE node
I20240502 01:58:41.133755 17375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:41.134374 17375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:41.135527 17375 hybrid_clock.cc:648] HybridClock initialized: now 1714615121135489 us; error 50 us; skew 500 ppm
I20240502 01:58:41.137398 17375 webserver.cc:460] Webserver started at http://127.10.133.197:34457/ using document root <none> and password file <none>
I20240502 01:58:41.137948 17375 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:41.138038 17375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:41.138232 17375 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:41.139878 17375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "436e7859396c42a6b60714873cb60495"
format_stamp: "Formatted at 2024-05-02 01:58:41 on dist-test-slave-dr9f"
I20240502 01:58:41.140337 17375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "436e7859396c42a6b60714873cb60495"
format_stamp: "Formatted at 2024-05-02 01:58:41 on dist-test-slave-dr9f"
I20240502 01:58:41.143536 17375 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20240502 01:58:41.145660 17390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:41.146669 17375 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240502 01:58:41.146775 17375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "436e7859396c42a6b60714873cb60495"
format_stamp: "Formatted at 2024-05-02 01:58:41 on dist-test-slave-dr9f"
I20240502 01:58:41.146859 17375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:41.157460 17375 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:41.158064 17375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:41.158211 17375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:41.158694 17375 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:41.159531 17375 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:41.159580 17375 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:41.159637 17375 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:41.159672 17375 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:41.167740 17375 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.197:45213
I20240502 01:58:41.167779 17504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.197:45213 every 8 connection(s)
I20240502 01:58:41.168655 17375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20240502 01:58:41.174142 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 17375
I20240502 01:58:41.174252 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20240502 01:58:41.176491 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.198:0
--local_ip_for_outbound_sockets=127.10.133.198
--webserver_interface=127.10.133.198
--webserver_port=0
--tserver_master_addrs=127.10.133.254:37275
--builtin_ntp_servers=127.10.133.212:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 01:58:41.177376 17505 heartbeater.cc:347] Connected to a master server at 127.10.133.254:37275
I20240502 01:58:41.177614 17505 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:41.178228 17505 heartbeater.cc:511] Master 127.10.133.254:37275 requested a full tablet report, sending...
I20240502 01:58:41.179222 16780 ts_manager.cc:194] Registered new tserver with Master: 436e7859396c42a6b60714873cb60495 (127.10.133.197:45213)
I20240502 01:58:41.179998 16780 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.197:43127
W20240502 01:58:41.282289 17508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:41.282477 17508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:41.282521 17508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:41.285413 17508 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:41.285467 17508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:41.285531 17508 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.198
I20240502 01:58:41.288947 17508 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.198:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.10.133.198
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.10.133.254:37275
--never_fsync=true
--heap_profile_path=/tmp/kudu.17508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.198
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:41.289686 17508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:41.290735 17508 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:41.299057 17514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:41.299816 17513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:41.300621 17516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:41.301380 17508 server_base.cc:1034] running on GCE node
I20240502 01:58:41.301723 17508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:41.302294 17508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:41.303439 17508 hybrid_clock.cc:648] HybridClock initialized: now 1714615121303430 us; error 24 us; skew 500 ppm
I20240502 01:58:41.305269 17508 webserver.cc:460] Webserver started at http://127.10.133.198:41611/ using document root <none> and password file <none>
I20240502 01:58:41.305802 17508 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:41.305861 17508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:41.306069 17508 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:41.307526 17508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/instance:
uuid: "d7989bd96de94be4a94995fcfcd6b16b"
format_stamp: "Formatted at 2024-05-02 01:58:41 on dist-test-slave-dr9f"
I20240502 01:58:41.307997 17508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal/instance:
uuid: "d7989bd96de94be4a94995fcfcd6b16b"
format_stamp: "Formatted at 2024-05-02 01:58:41 on dist-test-slave-dr9f"
I20240502 01:58:41.311142 17508 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 01:58:41.313133 17522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:41.314116 17508 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 01:58:41.314209 17508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "d7989bd96de94be4a94995fcfcd6b16b"
format_stamp: "Formatted at 2024-05-02 01:58:41 on dist-test-slave-dr9f"
I20240502 01:58:41.314282 17508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:41.332798 17508 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:41.333420 17508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:41.333580 17508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:41.334134 17508 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:41.335048 17508 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:41.335098 17508 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:41.335160 17508 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:41.335189 17508 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:41.343233 17508 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.198:45549
I20240502 01:58:41.343262 17637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.198:45549 every 8 connection(s)
I20240502 01:58:41.344110 17508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/info.pb
I20240502 01:58:41.352619 17638 heartbeater.cc:347] Connected to a master server at 127.10.133.254:37275
I20240502 01:58:41.352779 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 17508
I20240502 01:58:41.352859 17638 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:41.352909 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal/instance
I20240502 01:58:41.353477 17638 heartbeater.cc:511] Master 127.10.133.254:37275 requested a full tablet report, sending...
I20240502 01:58:41.354475 16779 ts_manager.cc:194] Registered new tserver with Master: d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198:45549)
I20240502 01:58:41.355155 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.199:0
--local_ip_for_outbound_sockets=127.10.133.199
--webserver_interface=127.10.133.199
--webserver_port=0
--tserver_master_addrs=127.10.133.254:37275
--builtin_ntp_servers=127.10.133.212:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 01:58:41.355212 16779 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.198:37581
I20240502 01:58:41.459802 16971 heartbeater.cc:503] Master 127.10.133.254:37275 was elected leader, sending a full tablet report...
W20240502 01:58:41.461867 17641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:41.462101 17641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:41.462181 17641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:41.465171 17641 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:41.465235 17641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:41.465322 17641 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.199
I20240502 01:58:41.468911 17641 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.199:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--webserver_interface=127.10.133.199
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.10.133.254:37275
--never_fsync=true
--heap_profile_path=/tmp/kudu.17641
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.199
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:41.469743 17641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:41.470901 17641 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:41.479233 17646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:41.480067 17647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:41.480690 17649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:41.481493 17641 server_base.cc:1034] running on GCE node
I20240502 01:58:41.481887 17641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:41.482532 17641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:41.483686 17641 hybrid_clock.cc:648] HybridClock initialized: now 1714615121483670 us; error 36 us; skew 500 ppm
I20240502 01:58:41.485514 17641 webserver.cc:460] Webserver started at http://127.10.133.199:46497/ using document root <none> and password file <none>
I20240502 01:58:41.486109 17641 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:41.486176 17641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:41.486361 17641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:41.487987 17641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/instance:
uuid: "b7ec79239ce64b38a1d55f66a95407c0"
format_stamp: "Formatted at 2024-05-02 01:58:41 on dist-test-slave-dr9f"
I20240502 01:58:41.488446 17641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal/instance:
uuid: "b7ec79239ce64b38a1d55f66a95407c0"
format_stamp: "Formatted at 2024-05-02 01:58:41 on dist-test-slave-dr9f"
I20240502 01:58:41.491727 17641 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 01:58:41.493834 17655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:41.494799 17641 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:41.494911 17641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
uuid: "b7ec79239ce64b38a1d55f66a95407c0"
format_stamp: "Formatted at 2024-05-02 01:58:41 on dist-test-slave-dr9f"
I20240502 01:58:41.494988 17641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:41.526834 17641 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:41.527431 17641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:41.527592 17641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:41.528191 17641 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:41.529103 17641 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:41.529152 17641 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:41.529212 17641 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:41.529238 17641 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:41.537638 17641 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.199:34045
I20240502 01:58:41.537680 17768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.199:34045 every 8 connection(s)
I20240502 01:58:41.538580 17641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/info.pb
I20240502 01:58:41.540895 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 17641
I20240502 01:58:41.541029 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal/instance
I20240502 01:58:41.543452 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.200:0
--local_ip_for_outbound_sockets=127.10.133.200
--webserver_interface=127.10.133.200
--webserver_port=0
--tserver_master_addrs=127.10.133.254:37275
--builtin_ntp_servers=127.10.133.212:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 01:58:41.547402 17769 heartbeater.cc:347] Connected to a master server at 127.10.133.254:37275
I20240502 01:58:41.547614 17769 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:41.548110 17769 heartbeater.cc:511] Master 127.10.133.254:37275 requested a full tablet report, sending...
I20240502 01:58:41.549201 16779 ts_manager.cc:194] Registered new tserver with Master: b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199:34045)
I20240502 01:58:41.550104 16779 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.199:54831
I20240502 01:58:41.634418 17106 heartbeater.cc:503] Master 127.10.133.254:37275 was elected leader, sending a full tablet report...
W20240502 01:58:41.650777 17772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:41.650969 17772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:41.651029 17772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:41.653970 17772 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:41.654042 17772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:41.654143 17772 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.200
I20240502 01:58:41.657867 17772 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.200:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--webserver_interface=127.10.133.200
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.10.133.254:37275
--never_fsync=true
--heap_profile_path=/tmp/kudu.17772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.200
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:41.658653 17772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:41.659639 17772 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:41.667436 17777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:41.668273 17778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:41.668918 17780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:41.669721 17772 server_base.cc:1034] running on GCE node
I20240502 01:58:41.670097 17772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:41.670632 17772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:41.671770 17772 hybrid_clock.cc:648] HybridClock initialized: now 1714615121671754 us; error 27 us; skew 500 ppm
I20240502 01:58:41.673411 17772 webserver.cc:460] Webserver started at http://127.10.133.200:37847/ using document root <none> and password file <none>
I20240502 01:58:41.674026 17772 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:41.674090 17772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:41.674265 17772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:41.675813 17772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/instance:
uuid: "b6aa9ef40e50468ca7a9742c21140d24"
format_stamp: "Formatted at 2024-05-02 01:58:41 on dist-test-slave-dr9f"
I20240502 01:58:41.676292 17772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal/instance:
uuid: "b6aa9ef40e50468ca7a9742c21140d24"
format_stamp: "Formatted at 2024-05-02 01:58:41 on dist-test-slave-dr9f"
I20240502 01:58:41.679425 17772 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 01:58:41.681360 17786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:41.682363 17772 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:41.682457 17772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
uuid: "b6aa9ef40e50468ca7a9742c21140d24"
format_stamp: "Formatted at 2024-05-02 01:58:41 on dist-test-slave-dr9f"
I20240502 01:58:41.682552 17772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:41.698292 17772 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:41.698841 17772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:41.698993 17772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:41.699456 17772 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:41.700317 17772 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:41.700366 17772 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:41.700421 17772 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:41.700450 17772 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:41.708441 17772 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.200:46021
I20240502 01:58:41.708480 17902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.200:46021 every 8 connection(s)
I20240502 01:58:41.709335 17772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/info.pb
I20240502 01:58:41.717489 17903 heartbeater.cc:347] Connected to a master server at 127.10.133.254:37275
I20240502 01:58:41.717748 17903 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:41.718220 17903 heartbeater.cc:511] Master 127.10.133.254:37275 requested a full tablet report, sending...
I20240502 01:58:41.718962 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 17772
I20240502 01:58:41.719095 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal/instance
I20240502 01:58:41.719162 16779 ts_manager.cc:194] Registered new tserver with Master: b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200:46021)
I20240502 01:58:41.719774 16779 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.200:58603
I20240502 01:58:41.721400 10775 external_mini_cluster.cc:930] 8 TS(s) registered with all masters
I20240502 01:58:41.730141 10775 external_mini_cluster.cc:930] 8 TS(s) registered with all masters
I20240502 01:58:41.730203 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 17375
I20240502 01:58:41.736151 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 17508
I20240502 01:58:41.742086 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 17641
I20240502 01:58:41.747113 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 17772
I20240502 01:58:41.828590 17240 heartbeater.cc:503] Master 127.10.133.254:37275 was elected leader, sending a full tablet report...
I20240502 01:58:42.010968 17372 heartbeater.cc:503] Master 127.10.133.254:37275 was elected leader, sending a full tablet report...
I20240502 01:58:45.504499 16779 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40394:
name: "rebalance_test_table_0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 01:58:45.523332 16903 tablet_service.cc:1467] Processing CreateTablet for tablet 6fb89894cf594139aecab491957f96c9 (DEFAULT_TABLE table=rebalance_test_table_0 [id=61315444265f4e1e9a2b3fed3a82c4a5]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:45.523825 17038 tablet_service.cc:1467] Processing CreateTablet for tablet f7d9d4310df14878a5ae4167c5320e3a (DEFAULT_TABLE table=rebalance_test_table_0 [id=61315444265f4e1e9a2b3fed3a82c4a5]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:45.524340 16903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fb89894cf594139aecab491957f96c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:45.524294 16902 tablet_service.cc:1467] Processing CreateTablet for tablet f7d9d4310df14878a5ae4167c5320e3a (DEFAULT_TABLE table=rebalance_test_table_0 [id=61315444265f4e1e9a2b3fed3a82c4a5]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:45.524660 17038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7d9d4310df14878a5ae4167c5320e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:45.524645 16901 tablet_service.cc:1467] Processing CreateTablet for tablet 86c8e4b2177946de9d18d4ef657da4be (DEFAULT_TABLE table=rebalance_test_table_0 [id=61315444265f4e1e9a2b3fed3a82c4a5]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:45.524850 16901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86c8e4b2177946de9d18d4ef657da4be. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:45.525564 16902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7d9d4310df14878a5ae4167c5320e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:45.523821 17039 tablet_service.cc:1467] Processing CreateTablet for tablet 6fb89894cf594139aecab491957f96c9 (DEFAULT_TABLE table=rebalance_test_table_0 [id=61315444265f4e1e9a2b3fed3a82c4a5]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:45.526445 17039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fb89894cf594139aecab491957f96c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:45.526508 17172 tablet_service.cc:1467] Processing CreateTablet for tablet f7d9d4310df14878a5ae4167c5320e3a (DEFAULT_TABLE table=rebalance_test_table_0 [id=61315444265f4e1e9a2b3fed3a82c4a5]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:45.527346 17172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7d9d4310df14878a5ae4167c5320e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:45.526511 17171 tablet_service.cc:1467] Processing CreateTablet for tablet 86c8e4b2177946de9d18d4ef657da4be (DEFAULT_TABLE table=rebalance_test_table_0 [id=61315444265f4e1e9a2b3fed3a82c4a5]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:45.530594 17171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86c8e4b2177946de9d18d4ef657da4be. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:45.532203 17924 tablet_bootstrap.cc:492] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:45.534174 17926 tablet_bootstrap.cc:492] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:45.534278 17306 tablet_service.cc:1467] Processing CreateTablet for tablet 6fb89894cf594139aecab491957f96c9 (DEFAULT_TABLE table=rebalance_test_table_0 [id=61315444265f4e1e9a2b3fed3a82c4a5]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:45.534664 17924 tablet_bootstrap.cc:654] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:45.534638 17305 tablet_service.cc:1467] Processing CreateTablet for tablet 86c8e4b2177946de9d18d4ef657da4be (DEFAULT_TABLE table=rebalance_test_table_0 [id=61315444265f4e1e9a2b3fed3a82c4a5]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:45.535102 17306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fb89894cf594139aecab491957f96c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:45.535440 17924 log.cc:824] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:45.535529 17925 tablet_bootstrap.cc:492] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:45.536090 17305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86c8e4b2177946de9d18d4ef657da4be. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:45.536996 17926 tablet_bootstrap.cc:654] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:45.537446 17925 tablet_bootstrap.cc:654] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:45.537751 17924 tablet_bootstrap.cc:492] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:45.537753 17926 log.cc:824] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:45.537925 17924 ts_tablet_manager.cc:1367] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240502 01:58:45.538398 17925 log.cc:824] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:45.539274 17926 tablet_bootstrap.cc:492] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:45.539431 17926 ts_tablet_manager.cc:1367] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:58:45.541486 17930 tablet_bootstrap.cc:492] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:45.541452 17924 raft_consensus.cc:348] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:45.541651 17924 raft_consensus.cc:374] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:45.541700 17924 raft_consensus.cc:729] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:45.541977 17925 tablet_bootstrap.cc:492] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:45.542135 17925 ts_tablet_manager.cc:1367] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20240502 01:58:45.542153 17924 consensus_queue.cc:260] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:45.542943 17924 ts_tablet_manager.cc:1398] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
I20240502 01:58:45.542996 17926 raft_consensus.cc:348] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:45.543162 17926 raft_consensus.cc:374] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:45.543215 17926 raft_consensus.cc:729] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:45.543257 17924 tablet_bootstrap.cc:492] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:45.543289 17930 tablet_bootstrap.cc:654] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:45.543995 17930 log.cc:824] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:45.544219 17924 tablet_bootstrap.cc:654] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:45.544291 17926 consensus_queue.cc:260] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:45.545094 17926 ts_tablet_manager.cc:1398] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20240502 01:58:45.545454 17930 tablet_bootstrap.cc:492] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:45.545590 17930 ts_tablet_manager.cc:1367] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 01:58:45.545953 17925 raft_consensus.cc:348] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:45.546164 17925 raft_consensus.cc:374] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:45.546238 17925 raft_consensus.cc:729] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:45.546608 17925 consensus_queue.cc:260] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:45.547406 17925 ts_tablet_manager.cc:1398] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20240502 01:58:45.547621 17925 tablet_bootstrap.cc:492] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:45.548617 17925 tablet_bootstrap.cc:654] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:45.548538 17930 raft_consensus.cc:348] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:45.548705 17930 raft_consensus.cc:374] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:45.548771 17930 raft_consensus.cc:729] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:45.548804 17935 raft_consensus.cc:482] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:45.548964 17926 tablet_bootstrap.cc:492] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:45.548943 17935 raft_consensus.cc:504] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:45.550182 17924 tablet_bootstrap.cc:492] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:45.550266 17924 ts_tablet_manager.cc:1367] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20240502 01:58:45.550179 17930 consensus_queue.cc:260] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:45.550869 17924 raft_consensus.cc:348] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:45.550983 17924 raft_consensus.cc:374] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:45.551015 17924 raft_consensus.cc:729] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:45.551177 17924 consensus_queue.cc:260] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:45.551271 17930 ts_tablet_manager.cc:1398] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20240502 01:58:45.551612 17924 ts_tablet_manager.cc:1398] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:45.551820 17924 tablet_bootstrap.cc:492] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:45.552165 17926 tablet_bootstrap.cc:654] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:45.552799 17924 tablet_bootstrap.cc:654] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:45.552918 17930 tablet_bootstrap.cc:492] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:45.553774 17930 tablet_bootstrap.cc:654] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:45.554319 17925 tablet_bootstrap.cc:492] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:45.554401 17925 ts_tablet_manager.cc:1367] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240502 01:58:45.554584 17935 leader_election.cc:288] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923), 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:45.554946 17925 raft_consensus.cc:348] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:45.555054 17925 raft_consensus.cc:374] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:45.555090 17925 raft_consensus.cc:729] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:45.555227 17925 consensus_queue.cc:260] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:45.555409 17924 tablet_bootstrap.cc:492] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:45.555452 17930 tablet_bootstrap.cc:492] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:45.555532 17925 ts_tablet_manager.cc:1398] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:45.555546 17930 ts_tablet_manager.cc:1367] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240502 01:58:45.555567 17924 ts_tablet_manager.cc:1367] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:58:45.556038 17930 raft_consensus.cc:348] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:45.556154 17930 raft_consensus.cc:374] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:45.556210 17930 raft_consensus.cc:729] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:45.556077 17924 raft_consensus.cc:348] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:45.556375 17924 raft_consensus.cc:374] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:45.556406 17930 consensus_queue.cc:260] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:45.556471 17924 raft_consensus.cc:729] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:45.556720 17924 consensus_queue.cc:260] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:45.556813 17930 ts_tablet_manager.cc:1398] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:45.557137 17924 ts_tablet_manager.cc:1398] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:45.557683 17926 tablet_bootstrap.cc:492] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:45.557776 17926 ts_tablet_manager.cc:1367] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240502 01:58:45.558396 17926 raft_consensus.cc:348] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:45.558507 17926 raft_consensus.cc:374] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:45.558576 17926 raft_consensus.cc:729] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:45.558703 17926 consensus_queue.cc:260] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:45.559017 17926 ts_tablet_manager.cc:1398] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 01:58:45.560634 16923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7d9d4310df14878a5ae4167c5320e3a" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc" is_pre_election: true
I20240502 01:58:45.560894 16923 raft_consensus.cc:2454] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:45.561446 16989 leader_election.cc:302] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, 6431e35365644aac943c07c97e370fee; no voters:
I20240502 01:58:45.561787 17935 raft_consensus.cc:2781] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:45.561880 17935 raft_consensus.cc:482] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:45.561935 17935 raft_consensus.cc:3037] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:45.562250 17193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7d9d4310df14878a5ae4167c5320e3a" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4" is_pre_election: true
I20240502 01:58:45.562474 17193 raft_consensus.cc:2454] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:45.563058 17935 raft_consensus.cc:504] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:45.563417 17935 leader_election.cc:288] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Requested vote from peers a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923), 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:45.563891 16923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7d9d4310df14878a5ae4167c5320e3a" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
I20240502 01:58:45.563880 17193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7d9d4310df14878a5ae4167c5320e3a" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:58:45.563979 16923 raft_consensus.cc:3037] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:45.563988 17193 raft_consensus.cc:3037] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:45.564747 17193 raft_consensus.cc:2454] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:45.565021 16990 leader_election.cc:302] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:45.565140 16923 raft_consensus.cc:2454] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:45.565188 17935 raft_consensus.cc:2781] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:45.565369 17935 raft_consensus.cc:686] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Becoming Leader. State: Replica: 6431e35365644aac943c07c97e370fee, State: Running, Role: LEADER
I20240502 01:58:45.565670 17935 consensus_queue.cc:237] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
W20240502 01:58:45.567840 17241 tablet.cc:2369] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 01:58:45.568315 16780 catalog_manager.cc:5484] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee reported cstate change: term changed from 0 to 1, leader changed from <none> to 6431e35365644aac943c07c97e370fee (127.10.133.194). New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:45.582383 17933 raft_consensus.cc:482] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:45.582512 17933 raft_consensus.cc:504] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:45.583564 17933 leader_election.cc:288] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135), 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:45.587301 16923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86c8e4b2177946de9d18d4ef657da4be" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc" is_pre_election: true
I20240502 01:58:45.587344 17326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86c8e4b2177946de9d18d4ef657da4be" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441" is_pre_election: true
I20240502 01:58:45.587432 16923 raft_consensus.cc:2454] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 0.
I20240502 01:58:45.587625 17326 raft_consensus.cc:2454] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 0.
I20240502 01:58:45.588135 17125 leader_election.cc:302] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:45.588358 17933 raft_consensus.cc:2781] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:45.588416 17933 raft_consensus.cc:482] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:45.588444 17933 raft_consensus.cc:3037] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:45.589246 17933 raft_consensus.cc:504] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:45.589566 17933 leader_election.cc:288] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [CANDIDATE]: Term 1 election: Requested vote from peers ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135), 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:45.589897 17326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86c8e4b2177946de9d18d4ef657da4be" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441"
I20240502 01:58:45.589922 16923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86c8e4b2177946de9d18d4ef657da4be" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
I20240502 01:58:45.590031 17326 raft_consensus.cc:3037] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:45.590054 16923 raft_consensus.cc:3037] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:45.590780 16923 raft_consensus.cc:2454] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 1.
I20240502 01:58:45.590935 17326 raft_consensus.cc:2454] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 1.
I20240502 01:58:45.591060 17125 leader_election.cc:302] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:45.591231 17933 raft_consensus.cc:2781] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:45.591445 17933 raft_consensus.cc:686] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Becoming Leader. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Running, Role: LEADER
I20240502 01:58:45.591740 17933 consensus_queue.cc:237] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:45.594643 16779 catalog_manager.cc:5484] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195). New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: UNKNOWN } } }
W20240502 01:58:45.626412 17107 tablet.cc:2369] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 01:58:45.700435 16972 tablet.cc:2369] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 01:58:45.742097 17931 raft_consensus.cc:482] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:45.742244 17931 raft_consensus.cc:504] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:45.743271 17931 leader_election.cc:288] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6431e35365644aac943c07c97e370fee (127.10.133.194:37811), ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:45.747224 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fb89894cf594139aecab491957f96c9" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee" is_pre_election: true
I20240502 01:58:45.747282 17326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fb89894cf594139aecab491957f96c9" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441" is_pre_election: true
I20240502 01:58:45.747408 17326 raft_consensus.cc:2454] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 0.
I20240502 01:58:45.747426 17059 raft_consensus.cc:2454] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 0.
I20240502 01:58:45.747771 16856 leader_election.cc:302] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:45.748021 17931 raft_consensus.cc:2781] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:45.748085 17931 raft_consensus.cc:482] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:45.748126 17931 raft_consensus.cc:3037] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:45.748955 17931 raft_consensus.cc:504] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:45.749275 17931 leader_election.cc:288] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 election: Requested vote from peers 6431e35365644aac943c07c97e370fee (127.10.133.194:37811), ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:45.749614 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fb89894cf594139aecab491957f96c9" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee"
I20240502 01:58:45.749714 17059 raft_consensus.cc:3037] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:45.749692 17326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fb89894cf594139aecab491957f96c9" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441"
I20240502 01:58:45.749812 17326 raft_consensus.cc:3037] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:45.750546 17326 raft_consensus.cc:2454] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 1.
I20240502 01:58:45.750547 17059 raft_consensus.cc:2454] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 1.
I20240502 01:58:45.750785 16856 leader_election.cc:302] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:45.750963 17931 raft_consensus.cc:2781] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:45.751153 17931 raft_consensus.cc:686] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Becoming Leader. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Running, Role: LEADER
I20240502 01:58:45.751472 17931 consensus_queue.cc:237] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
W20240502 01:58:45.753940 17373 tablet.cc:2369] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 01:58:45.754312 16779 catalog_manager.cc:5484] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: term changed from 0 to 1, leader changed from <none> to 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193). New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: UNKNOWN } } }
W20240502 01:58:45.918711 17954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:45.918936 17954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:45.921797 17954 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_0'
I20240502 01:58:46.021771 16923 raft_consensus.cc:1261] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:46.022486 17326 raft_consensus.cc:1261] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:46.023003 17059 raft_consensus.cc:1261] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:46.023386 17948 consensus_queue.cc:1035] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:46.023598 17931 consensus_queue.cc:1035] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:46.022498 17325 raft_consensus.cc:1261] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:46.024542 17931 consensus_queue.cc:1035] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:46.027119 16922 raft_consensus.cc:1261] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:46.027678 17935 consensus_queue.cc:1035] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:46.028885 17193 raft_consensus.cc:1261] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:46.029331 17948 consensus_queue.cc:1035] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:46.030038 17935 consensus_queue.cc:1035] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:46.038304 17986 mvcc.cc:205] Tried to move back new op lower bound from 7023063556181458944 to 7023063555080327168. Current Snapshot: MvccSnapshot[applied={T|T < 7023063556181458944}]
I20240502 01:58:46.040529 17995 mvcc.cc:205] Tried to move back new op lower bound from 7023063556209410048 to 7023063555080327168. Current Snapshot: MvccSnapshot[applied={T|T < 7023063556181458944}]
I20240502 01:58:46.042469 17984 mvcc.cc:205] Tried to move back new op lower bound from 7023063556177469440 to 7023063554425954304. Current Snapshot: MvccSnapshot[applied={T|T < 7023063556177469440}]
I20240502 01:58:46.048293 17993 mvcc.cc:205] Tried to move back new op lower bound from 7023063556181458944 to 7023063555080327168. Current Snapshot: MvccSnapshot[applied={T|T < 7023063556181458944}]
INSERT report
rows total: 2000
time total: 127.159 ms
time per row: 0.0635794 ms
I20240502 01:58:46.096110 16780 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40394:
name: "rebalance_test_table_1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 01:58:46.101507 17305 tablet_service.cc:1467] Processing CreateTablet for tablet c9240a82777b44648966e18a616fdfa2 (DEFAULT_TABLE table=rebalance_test_table_1 [id=e1f098a771d942879080a8a67a25fa1c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:46.101806 17306 tablet_service.cc:1467] Processing CreateTablet for tablet 1a396235bc534141bcd180430c51e7e1 (DEFAULT_TABLE table=rebalance_test_table_1 [id=e1f098a771d942879080a8a67a25fa1c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:46.101843 17039 tablet_service.cc:1467] Processing CreateTablet for tablet c9240a82777b44648966e18a616fdfa2 (DEFAULT_TABLE table=rebalance_test_table_1 [id=e1f098a771d942879080a8a67a25fa1c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:46.102142 17039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9240a82777b44648966e18a616fdfa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:46.102152 17172 tablet_service.cc:1467] Processing CreateTablet for tablet c9240a82777b44648966e18a616fdfa2 (DEFAULT_TABLE table=rebalance_test_table_1 [id=e1f098a771d942879080a8a67a25fa1c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:46.102434 17172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9240a82777b44648966e18a616fdfa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:46.101832 17305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9240a82777b44648966e18a616fdfa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:46.102710 16903 tablet_service.cc:1467] Processing CreateTablet for tablet 1a375533a25a4da5b0030b0e06488351 (DEFAULT_TABLE table=rebalance_test_table_1 [id=e1f098a771d942879080a8a67a25fa1c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:46.102969 16903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a375533a25a4da5b0030b0e06488351. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:46.104512 17038 tablet_service.cc:1467] Processing CreateTablet for tablet 1a396235bc534141bcd180430c51e7e1 (DEFAULT_TABLE table=rebalance_test_table_1 [id=e1f098a771d942879080a8a67a25fa1c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:46.104754 17038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a396235bc534141bcd180430c51e7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:46.104776 17306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a396235bc534141bcd180430c51e7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:46.104838 17037 tablet_service.cc:1467] Processing CreateTablet for tablet 1a375533a25a4da5b0030b0e06488351 (DEFAULT_TABLE table=rebalance_test_table_1 [id=e1f098a771d942879080a8a67a25fa1c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:46.105084 17037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a375533a25a4da5b0030b0e06488351. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:46.106621 18014 tablet_bootstrap.cc:492] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:46.106787 17171 tablet_service.cc:1467] Processing CreateTablet for tablet 1a375533a25a4da5b0030b0e06488351 (DEFAULT_TABLE table=rebalance_test_table_1 [id=e1f098a771d942879080a8a67a25fa1c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:46.107009 17171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a375533a25a4da5b0030b0e06488351. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:46.107300 17172 tablet_service.cc:1467] Processing CreateTablet for tablet 1a396235bc534141bcd180430c51e7e1 (DEFAULT_TABLE table=rebalance_test_table_1 [id=e1f098a771d942879080a8a67a25fa1c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:46.107470 18016 tablet_bootstrap.cc:492] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:46.107538 17172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a396235bc534141bcd180430c51e7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:46.107539 18014 tablet_bootstrap.cc:654] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:46.108296 18016 tablet_bootstrap.cc:654] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:46.109732 18015 tablet_bootstrap.cc:492] T c9240a82777b44648966e18a616fdfa2 P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:46.109905 18016 tablet_bootstrap.cc:492] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:46.109979 18014 tablet_bootstrap.cc:492] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:46.110016 18016 ts_tablet_manager.cc:1367] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:46.110093 18014 ts_tablet_manager.cc:1367] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:58:46.110519 18015 tablet_bootstrap.cc:654] T c9240a82777b44648966e18a616fdfa2 P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:46.110466 18016 raft_consensus.cc:348] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:46.110493 18014 raft_consensus.cc:348] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:46.110572 18016 raft_consensus.cc:374] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:46.110574 18014 raft_consensus.cc:374] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:46.110615 18016 raft_consensus.cc:729] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:46.110617 18014 raft_consensus.cc:729] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:46.110745 18014 consensus_queue.cc:260] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:46.110756 18016 consensus_queue.cc:260] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:46.111104 18014 ts_tablet_manager.cc:1398] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:46.111104 18016 ts_tablet_manager.cc:1398] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:46.111200 18017 tablet_bootstrap.cc:492] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:46.111258 18014 tablet_bootstrap.cc:492] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:46.111486 18015 tablet_bootstrap.cc:492] T c9240a82777b44648966e18a616fdfa2 P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:46.111570 18015 ts_tablet_manager.cc:1367] T c9240a82777b44648966e18a616fdfa2 P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:46.112020 18015 raft_consensus.cc:348] T c9240a82777b44648966e18a616fdfa2 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:46.112123 18015 raft_consensus.cc:374] T c9240a82777b44648966e18a616fdfa2 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:46.112131 18014 tablet_bootstrap.cc:654] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:46.112144 18016 tablet_bootstrap.cc:492] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:46.112157 18015 raft_consensus.cc:729] T c9240a82777b44648966e18a616fdfa2 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:46.112277 18015 consensus_queue.cc:260] T c9240a82777b44648966e18a616fdfa2 P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:46.112524 18015 ts_tablet_manager.cc:1398] T c9240a82777b44648966e18a616fdfa2 P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:46.112708 18015 tablet_bootstrap.cc:492] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:46.113039 18016 tablet_bootstrap.cc:654] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:46.113461 18017 tablet_bootstrap.cc:654] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:46.113956 18015 tablet_bootstrap.cc:654] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:46.114207 18014 tablet_bootstrap.cc:492] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:46.114284 18014 ts_tablet_manager.cc:1367] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:46.114768 18016 tablet_bootstrap.cc:492] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:46.114843 18016 ts_tablet_manager.cc:1367] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:58:46.114800 18014 raft_consensus.cc:348] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:46.114899 18014 raft_consensus.cc:374] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:46.114948 18014 raft_consensus.cc:729] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:46.115067 18015 tablet_bootstrap.cc:492] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:46.115068 18014 consensus_queue.cc:260] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:46.115140 18015 ts_tablet_manager.cc:1367] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:46.115392 18014 ts_tablet_manager.cc:1398] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:46.115339 18016 raft_consensus.cc:348] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:46.115445 18016 raft_consensus.cc:374] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:46.115478 18016 raft_consensus.cc:729] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:46.115550 18014 tablet_bootstrap.cc:492] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:46.115535 18015 raft_consensus.cc:348] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:46.115577 18016 consensus_queue.cc:260] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:46.115641 18015 raft_consensus.cc:374] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:46.115675 18015 raft_consensus.cc:729] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:46.115798 18015 consensus_queue.cc:260] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:46.115844 18016 ts_tablet_manager.cc:1398] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:46.116036 18015 ts_tablet_manager.cc:1398] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:46.116178 18015 tablet_bootstrap.cc:492] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:46.116504 18014 tablet_bootstrap.cc:654] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:46.117082 18015 tablet_bootstrap.cc:654] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:46.117591 18017 tablet_bootstrap.cc:492] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:46.117686 18017 ts_tablet_manager.cc:1367] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240502 01:58:46.118216 18015 tablet_bootstrap.cc:492] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:46.118187 18017 raft_consensus.cc:348] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:46.118294 18017 raft_consensus.cc:374] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:46.118301 18015 ts_tablet_manager.cc:1367] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:46.118324 18017 raft_consensus.cc:729] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:46.118440 18017 consensus_queue.cc:260] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:46.118722 18017 ts_tablet_manager.cc:1398] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:46.118728 18015 raft_consensus.cc:348] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:46.118825 18015 raft_consensus.cc:374] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:46.118862 18015 raft_consensus.cc:729] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:46.118973 18015 consensus_queue.cc:260] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:46.119230 18015 ts_tablet_manager.cc:1398] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:46.120227 18014 tablet_bootstrap.cc:492] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:46.120319 18014 ts_tablet_manager.cc:1367] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:58:46.120729 18014 raft_consensus.cc:348] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:46.120823 18014 raft_consensus.cc:374] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:46.120872 18014 raft_consensus.cc:729] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:46.121002 18014 consensus_queue.cc:260] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:46.121346 18014 ts_tablet_manager.cc:1398] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:46.134258 17944 raft_consensus.cc:482] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:46.134358 17944 raft_consensus.cc:504] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:46.134752 17944 leader_election.cc:288] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923), 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:46.135107 17193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a375533a25a4da5b0030b0e06488351" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4" is_pre_election: true
I20240502 01:58:46.135144 16922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a375533a25a4da5b0030b0e06488351" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc" is_pre_election: true
I20240502 01:58:46.135224 17193 raft_consensus.cc:2454] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:46.135291 16922 raft_consensus.cc:2454] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:46.135501 16990 leader_election.cc:302] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:46.135664 17944 raft_consensus.cc:2781] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:46.135726 17944 raft_consensus.cc:482] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:46.135779 17944 raft_consensus.cc:3037] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:46.136592 17944 raft_consensus.cc:504] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:46.136922 17944 leader_election.cc:288] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Requested vote from peers a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923), 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:46.137204 17193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a375533a25a4da5b0030b0e06488351" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:58:46.137236 16922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a375533a25a4da5b0030b0e06488351" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
I20240502 01:58:46.137311 17193 raft_consensus.cc:3037] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:46.137327 16922 raft_consensus.cc:3037] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:46.138067 17193 raft_consensus.cc:2454] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:46.138113 16922 raft_consensus.cc:2454] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:46.138370 16990 leader_election.cc:302] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:46.138532 17944 raft_consensus.cc:2781] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:46.138628 17944 raft_consensus.cc:686] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Becoming Leader. State: Replica: 6431e35365644aac943c07c97e370fee, State: Running, Role: LEADER
I20240502 01:58:46.138756 17944 consensus_queue.cc:237] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:46.140276 16780 catalog_manager.cc:5484] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee reported cstate change: term changed from 0 to 1, leader changed from <none> to 6431e35365644aac943c07c97e370fee (127.10.133.194). New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } }
I20240502 01:58:46.199831 17944 raft_consensus.cc:482] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:46.199956 17944 raft_consensus.cc:504] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:46.200359 17944 leader_election.cc:288] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:46.200855 17193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a396235bc534141bcd180430c51e7e1" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4" is_pre_election: true
I20240502 01:58:46.201018 17193 raft_consensus.cc:2454] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:46.201323 16990 leader_election.cc:302] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:46.201498 17944 raft_consensus.cc:2781] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:46.201575 17944 raft_consensus.cc:482] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:46.201611 17944 raft_consensus.cc:3037] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:46.202548 17944 raft_consensus.cc:504] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:46.202879 17944 leader_election.cc:288] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Requested vote from peers ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:46.203260 17193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a396235bc534141bcd180430c51e7e1" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:58:46.203357 17193 raft_consensus.cc:3037] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:46.204198 17193 raft_consensus.cc:2454] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:46.204340 17326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a396235bc534141bcd180430c51e7e1" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441" is_pre_election: true
I20240502 01:58:46.204480 17326 raft_consensus.cc:2454] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:46.204504 16990 leader_election.cc:302] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:46.204699 17325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a396235bc534141bcd180430c51e7e1" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441"
I20240502 01:58:46.204711 17944 raft_consensus.cc:2781] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:46.204778 17325 raft_consensus.cc:3037] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:46.204816 17944 raft_consensus.cc:686] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Becoming Leader. State: Replica: 6431e35365644aac943c07c97e370fee, State: Running, Role: LEADER
I20240502 01:58:46.204957 17944 consensus_queue.cc:237] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:46.206269 17325 raft_consensus.cc:2454] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:46.206569 16780 catalog_manager.cc:5484] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee reported cstate change: term changed from 0 to 1, leader changed from <none> to 6431e35365644aac943c07c97e370fee (127.10.133.194). New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:46.286581 17937 raft_consensus.cc:482] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:46.286754 17937 raft_consensus.cc:504] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:46.287796 17937 leader_election.cc:288] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923), 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:46.292388 17193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9240a82777b44648966e18a616fdfa2" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4" is_pre_election: true
I20240502 01:58:46.292361 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9240a82777b44648966e18a616fdfa2" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee" is_pre_election: true
I20240502 01:58:46.292531 17059 raft_consensus.cc:2454] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 0.
I20240502 01:58:46.292543 17193 raft_consensus.cc:2454] T c9240a82777b44648966e18a616fdfa2 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 0.
I20240502 01:58:46.292901 17259 leader_election.cc:302] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1c00c21761540dea7ddae8d0dd26df4, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:46.293164 17937 raft_consensus.cc:2781] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:46.293219 17937 raft_consensus.cc:482] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:46.293263 17937 raft_consensus.cc:3037] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:46.294117 17937 raft_consensus.cc:504] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:46.294446 17937 leader_election.cc:288] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 election: Requested vote from peers a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923), 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:46.294800 17193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9240a82777b44648966e18a616fdfa2" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:58:46.294828 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c9240a82777b44648966e18a616fdfa2" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee"
I20240502 01:58:46.294919 17193 raft_consensus.cc:3037] T c9240a82777b44648966e18a616fdfa2 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:46.294931 17059 raft_consensus.cc:3037] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:46.295854 17059 raft_consensus.cc:2454] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 1.
I20240502 01:58:46.295854 17193 raft_consensus.cc:2454] T c9240a82777b44648966e18a616fdfa2 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 1.
I20240502 01:58:46.296145 17258 leader_election.cc:302] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:46.296360 17937 raft_consensus.cc:2781] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:46.296571 17937 raft_consensus.cc:686] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Becoming Leader. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Running, Role: LEADER
I20240502 01:58:46.296870 17937 consensus_queue.cc:237] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:46.299010 16780 catalog_manager.cc:5484] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec11d4bb3a064a94a80084142637b441 (127.10.133.196). New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: UNKNOWN } } }
W20240502 01:58:46.450644 18035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:46.450964 18035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:46.454339 18035 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_1'
I20240502 01:58:46.538331 17193 raft_consensus.cc:1261] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:46.538779 17944 consensus_queue.cc:1035] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:46.539674 16922 raft_consensus.cc:1261] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:46.544667 17193 raft_consensus.cc:1261] T c9240a82777b44648966e18a616fdfa2 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:46.546424 17937 consensus_queue.cc:1035] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:46.547008 17935 consensus_queue.cc:1035] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:46.549199 17059 raft_consensus.cc:1261] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:46.549664 17325 raft_consensus.cc:1261] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:46.550163 17192 raft_consensus.cc:1261] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:46.550315 17935 consensus_queue.cc:1035] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:46.550680 17935 consensus_queue.cc:1035] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:46.550660 17937 consensus_queue.cc:1035] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 108.688 ms
time per row: 0.054344 ms
I20240502 01:58:46.607519 16774 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40394:
name: "rebalance_test_table_2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 01:58:46.612920 17037 tablet_service.cc:1467] Processing CreateTablet for tablet df21aa40548c4f49bae79294085c80f4 (DEFAULT_TABLE table=rebalance_test_table_2 [id=e2d3cd2117a14964a0bc535eca4d5850]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:46.612990 16903 tablet_service.cc:1467] Processing CreateTablet for tablet df21aa40548c4f49bae79294085c80f4 (DEFAULT_TABLE table=rebalance_test_table_2 [id=e2d3cd2117a14964a0bc535eca4d5850]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:46.613090 16902 tablet_service.cc:1467] Processing CreateTablet for tablet 2162035e4ed4433fafcc49934be62a9c (DEFAULT_TABLE table=rebalance_test_table_2 [id=e2d3cd2117a14964a0bc535eca4d5850]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:46.613263 17037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df21aa40548c4f49bae79294085c80f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:46.613323 16903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df21aa40548c4f49bae79294085c80f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:46.613575 17306 tablet_service.cc:1467] Processing CreateTablet for tablet df21aa40548c4f49bae79294085c80f4 (DEFAULT_TABLE table=rebalance_test_table_2 [id=e2d3cd2117a14964a0bc535eca4d5850]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:46.613834 17306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df21aa40548c4f49bae79294085c80f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:46.614074 17172 tablet_service.cc:1467] Processing CreateTablet for tablet 2162035e4ed4433fafcc49934be62a9c (DEFAULT_TABLE table=rebalance_test_table_2 [id=e2d3cd2117a14964a0bc535eca4d5850]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:46.614336 17172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2162035e4ed4433fafcc49934be62a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:46.615942 18016 tablet_bootstrap.cc:492] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:46.616132 16902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2162035e4ed4433fafcc49934be62a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:46.616479 18015 tablet_bootstrap.cc:492] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:46.616542 18014 tablet_bootstrap.cc:492] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:46.616832 18016 tablet_bootstrap.cc:654] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:46.617312 18015 tablet_bootstrap.cc:654] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:46.617370 18014 tablet_bootstrap.cc:654] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:46.617475 16901 tablet_service.cc:1467] Processing CreateTablet for tablet 4965b4399f744b67807d2d5361bc1bd5 (DEFAULT_TABLE table=rebalance_test_table_2 [id=e2d3cd2117a14964a0bc535eca4d5850]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:46.617702 16901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4965b4399f744b67807d2d5361bc1bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:46.618113 18017 tablet_bootstrap.cc:492] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:46.618074 17305 tablet_service.cc:1467] Processing CreateTablet for tablet 4965b4399f744b67807d2d5361bc1bd5 (DEFAULT_TABLE table=rebalance_test_table_2 [id=e2d3cd2117a14964a0bc535eca4d5850]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:46.618304 17305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4965b4399f744b67807d2d5361bc1bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:46.618891 18017 tablet_bootstrap.cc:654] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:46.618872 17306 tablet_service.cc:1467] Processing CreateTablet for tablet 2162035e4ed4433fafcc49934be62a9c (DEFAULT_TABLE table=rebalance_test_table_2 [id=e2d3cd2117a14964a0bc535eca4d5850]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:46.619088 17306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2162035e4ed4433fafcc49934be62a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:46.619129 18016 tablet_bootstrap.cc:492] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:46.619222 18016 ts_tablet_manager.cc:1367] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:46.619684 18016 raft_consensus.cc:348] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:46.619781 18016 raft_consensus.cc:374] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:46.619812 18016 raft_consensus.cc:729] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:46.619927 18016 consensus_queue.cc:260] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:46.620193 18016 ts_tablet_manager.cc:1398] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:46.620357 18016 tablet_bootstrap.cc:492] T 4965b4399f744b67807d2d5361bc1bd5 P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:46.621026 17037 tablet_service.cc:1467] Processing CreateTablet for tablet 4965b4399f744b67807d2d5361bc1bd5 (DEFAULT_TABLE table=rebalance_test_table_2 [id=e2d3cd2117a14964a0bc535eca4d5850]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:46.621218 18016 tablet_bootstrap.cc:654] T 4965b4399f744b67807d2d5361bc1bd5 P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:46.621279 17037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4965b4399f744b67807d2d5361bc1bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:46.621661 18015 tablet_bootstrap.cc:492] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:46.621757 18015 ts_tablet_manager.cc:1367] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20240502 01:58:46.622246 18016 tablet_bootstrap.cc:492] T 4965b4399f744b67807d2d5361bc1bd5 P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:46.622323 18016 ts_tablet_manager.cc:1367] T 4965b4399f744b67807d2d5361bc1bd5 P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:46.622362 18017 tablet_bootstrap.cc:492] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:46.622433 18017 ts_tablet_manager.cc:1367] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20240502 01:58:46.622936 18017 raft_consensus.cc:348] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:46.622936 18016 raft_consensus.cc:348] T 4965b4399f744b67807d2d5361bc1bd5 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:46.623039 18017 raft_consensus.cc:374] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:46.623039 18016 raft_consensus.cc:374] T 4965b4399f744b67807d2d5361bc1bd5 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:46.623072 18017 raft_consensus.cc:729] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:46.623072 18016 raft_consensus.cc:729] T 4965b4399f744b67807d2d5361bc1bd5 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:46.623184 18017 consensus_queue.cc:260] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:46.623184 18016 consensus_queue.cc:260] T 4965b4399f744b67807d2d5361bc1bd5 P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:46.623421 18016 ts_tablet_manager.cc:1398] T 4965b4399f744b67807d2d5361bc1bd5 P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:46.623421 18017 ts_tablet_manager.cc:1398] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240502 01:58:46.623569 18016 tablet_bootstrap.cc:492] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:46.623569 18017 tablet_bootstrap.cc:492] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:46.624414 18017 tablet_bootstrap.cc:654] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:46.624414 18016 tablet_bootstrap.cc:654] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:46.626382 18015 raft_consensus.cc:348] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:46.626488 18015 raft_consensus.cc:374] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:46.626514 18015 raft_consensus.cc:729] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:46.626621 18015 consensus_queue.cc:260] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:46.626835 18015 ts_tablet_manager.cc:1398] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20240502 01:58:46.627840 18017 tablet_bootstrap.cc:492] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:46.627939 18017 ts_tablet_manager.cc:1367] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20240502 01:58:46.628228 18014 tablet_bootstrap.cc:492] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:46.628315 18014 ts_tablet_manager.cc:1367] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20240502 01:58:46.628715 18017 raft_consensus.cc:348] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:46.628829 18017 raft_consensus.cc:374] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:46.628796 18014 raft_consensus.cc:348] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:46.628870 18017 raft_consensus.cc:729] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:46.628912 18014 raft_consensus.cc:374] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:46.628957 18014 raft_consensus.cc:729] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:46.629015 18017 consensus_queue.cc:260] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:46.629078 18014 consensus_queue.cc:260] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:46.629263 18017 ts_tablet_manager.cc:1398] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:46.629386 18014 ts_tablet_manager.cc:1398] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:46.629417 18017 tablet_bootstrap.cc:492] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:46.629577 18014 tablet_bootstrap.cc:492] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:46.630298 18017 tablet_bootstrap.cc:654] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:46.631659 18014 tablet_bootstrap.cc:654] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:46.632596 18016 tablet_bootstrap.cc:492] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:46.632683 18016 ts_tablet_manager.cc:1367] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20240502 01:58:46.632905 18014 tablet_bootstrap.cc:492] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:46.632985 18014 ts_tablet_manager.cc:1367] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20240502 01:58:46.633132 18016 raft_consensus.cc:348] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:46.633280 18016 raft_consensus.cc:374] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:46.633318 18016 raft_consensus.cc:729] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:46.633433 18016 consensus_queue.cc:260] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:46.633744 18016 ts_tablet_manager.cc:1398] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:46.634163 18014 raft_consensus.cc:348] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:46.634280 18014 raft_consensus.cc:374] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:46.634320 18014 raft_consensus.cc:729] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:46.634461 18014 consensus_queue.cc:260] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:46.634652 18017 tablet_bootstrap.cc:492] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:46.634722 18017 ts_tablet_manager.cc:1367] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20240502 01:58:46.635084 18017 raft_consensus.cc:348] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:46.635170 18017 raft_consensus.cc:374] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:46.635195 18017 raft_consensus.cc:729] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:46.635286 18017 consensus_queue.cc:260] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:46.635507 18017 ts_tablet_manager.cc:1398] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:46.636335 18014 ts_tablet_manager.cc:1398] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20240502 01:58:46.686513 17952 raft_consensus.cc:482] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:46.686646 17952 raft_consensus.cc:504] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:46.687150 17952 leader_election.cc:288] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:46.687652 17325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2162035e4ed4433fafcc49934be62a9c" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441" is_pre_election: true
I20240502 01:58:46.687820 17325 raft_consensus.cc:2454] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 0.
I20240502 01:58:46.688184 16856 leader_election.cc:302] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:46.688390 17952 raft_consensus.cc:2781] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:46.688449 17952 raft_consensus.cc:482] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:46.688496 17952 raft_consensus.cc:3037] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:46.689000 18087 raft_consensus.cc:482] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:46.689146 18087 raft_consensus.cc:504] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:46.689546 18087 leader_election.cc:288] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6431e35365644aac943c07c97e370fee (127.10.133.194:37811), ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:46.689803 17952 raft_consensus.cc:504] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:46.690274 17952 leader_election.cc:288] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 election: Requested vote from peers ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:46.690263 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df21aa40548c4f49bae79294085c80f4" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee" is_pre_election: true
I20240502 01:58:46.690408 17059 raft_consensus.cc:2454] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 0.
I20240502 01:58:46.690560 17325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df21aa40548c4f49bae79294085c80f4" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441" is_pre_election: true
I20240502 01:58:46.690726 17325 raft_consensus.cc:2454] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 0.
I20240502 01:58:46.690747 16856 leader_election.cc:302] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, 6431e35365644aac943c07c97e370fee; no voters:
I20240502 01:58:46.690901 17952 raft_consensus.cc:2781] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:46.690949 17952 raft_consensus.cc:482] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:46.690984 17952 raft_consensus.cc:3037] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:46.690948 17326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2162035e4ed4433fafcc49934be62a9c" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441"
I20240502 01:58:46.691058 17326 raft_consensus.cc:3037] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:46.692020 17952 raft_consensus.cc:504] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:46.692121 17326 raft_consensus.cc:2454] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 1.
I20240502 01:58:46.692512 17952 leader_election.cc:288] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 election: Requested vote from peers 6431e35365644aac943c07c97e370fee (127.10.133.194:37811), ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:46.692674 16856 leader_election.cc:302] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:46.693150 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df21aa40548c4f49bae79294085c80f4" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee"
I20240502 01:58:46.693266 17059 raft_consensus.cc:3037] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:46.693285 17193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2162035e4ed4433fafcc49934be62a9c" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4" is_pre_election: true
I20240502 01:58:46.693318 17192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2162035e4ed4433fafcc49934be62a9c" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:58:46.693404 17193 raft_consensus.cc:2454] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 0.
I20240502 01:58:46.693980 17326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df21aa40548c4f49bae79294085c80f4" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441"
I20240502 01:58:46.694124 17326 raft_consensus.cc:3037] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:46.694205 17059 raft_consensus.cc:2454] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 1.
I20240502 01:58:46.694226 17952 raft_consensus.cc:2781] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:46.694305 17952 raft_consensus.cc:686] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Becoming Leader. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Running, Role: LEADER
I20240502 01:58:46.694422 17952 consensus_queue.cc:237] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:46.694504 16856 leader_election.cc:302] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, 6431e35365644aac943c07c97e370fee; no voters:
I20240502 01:58:46.695060 18088 raft_consensus.cc:2781] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:46.695075 17326 raft_consensus.cc:2454] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 1.
I20240502 01:58:46.695220 18088 raft_consensus.cc:686] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Becoming Leader. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Running, Role: LEADER
I20240502 01:58:46.695406 18088 consensus_queue.cc:237] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:46.697139 16771 catalog_manager.cc:5484] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: term changed from 0 to 1, leader changed from <none> to 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193). New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:46.697376 16771 catalog_manager.cc:5484] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: term changed from 0 to 1, leader changed from <none> to 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193). New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:46.812623 18065 raft_consensus.cc:482] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:46.812763 18065 raft_consensus.cc:504] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:46.813148 18065 leader_election.cc:288] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135), 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:46.813584 17326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4965b4399f744b67807d2d5361bc1bd5" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441" is_pre_election: true
I20240502 01:58:46.813614 16922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4965b4399f744b67807d2d5361bc1bd5" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc" is_pre_election: true
I20240502 01:58:46.813728 17326 raft_consensus.cc:2454] T 4965b4399f744b67807d2d5361bc1bd5 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:46.813753 16922 raft_consensus.cc:2454] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:46.814081 16989 leader_election.cc:302] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:46.814261 18065 raft_consensus.cc:2781] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:46.814319 18065 raft_consensus.cc:482] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:46.814373 18065 raft_consensus.cc:3037] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:46.815254 18065 raft_consensus.cc:504] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:46.815553 18065 leader_election.cc:288] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Requested vote from peers ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135), 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:46.815894 17326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4965b4399f744b67807d2d5361bc1bd5" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441"
I20240502 01:58:46.815907 16922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4965b4399f744b67807d2d5361bc1bd5" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
I20240502 01:58:46.816001 17326 raft_consensus.cc:3037] T 4965b4399f744b67807d2d5361bc1bd5 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:46.816016 16922 raft_consensus.cc:3037] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:46.816967 17326 raft_consensus.cc:2454] T 4965b4399f744b67807d2d5361bc1bd5 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:46.817076 16922 raft_consensus.cc:2454] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:46.817262 16989 leader_election.cc:302] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:46.817504 18065 raft_consensus.cc:2781] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:46.817579 18065 raft_consensus.cc:686] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Becoming Leader. State: Replica: 6431e35365644aac943c07c97e370fee, State: Running, Role: LEADER
I20240502 01:58:46.817694 18065 consensus_queue.cc:237] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:46.819344 16771 catalog_manager.cc:5484] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee reported cstate change: term changed from 0 to 1, leader changed from <none> to 6431e35365644aac943c07c97e370fee (127.10.133.194). New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: UNKNOWN } } }
W20240502 01:58:46.963788 18092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:46.964000 18092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:46.967023 18092 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_2'
I20240502 01:58:47.064002 17326 raft_consensus.cc:1261] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:47.064424 17059 raft_consensus.cc:1261] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:47.065265 16922 raft_consensus.cc:1261] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:47.065501 18088 consensus_queue.cc:1035] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:47.065645 18087 consensus_queue.cc:1035] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:47.066110 17944 consensus_queue.cc:1035] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:47.066854 17326 raft_consensus.cc:1261] T 4965b4399f744b67807d2d5361bc1bd5 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:47.070710 17192 raft_consensus.cc:3037] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:47.071900 17192 raft_consensus.cc:1261] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:47.072070 17326 raft_consensus.cc:1261] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:47.072110 18065 consensus_queue.cc:1035] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:47.073805 18087 consensus_queue.cc:1035] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:47.075881 18087 consensus_queue.cc:1035] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 128.016 ms
time per row: 0.0640081 ms
I20240502 01:58:47.134763 16771 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40394:
name: "rebalance_test_table_3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 01:58:47.140501 16902 tablet_service.cc:1467] Processing CreateTablet for tablet 787b9b0227da4dd08df5aeb37f0d0468 (DEFAULT_TABLE table=rebalance_test_table_3 [id=0c4182cf7d98406d87a12a073ef6b915]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:47.140576 17037 tablet_service.cc:1467] Processing CreateTablet for tablet 029dba0050a64bd4adb35e9815450450 (DEFAULT_TABLE table=rebalance_test_table_3 [id=0c4182cf7d98406d87a12a073ef6b915]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:47.140815 16902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 787b9b0227da4dd08df5aeb37f0d0468. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:47.140813 17037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 029dba0050a64bd4adb35e9815450450. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:47.142984 18142 tablet_bootstrap.cc:492] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:47.142997 16901 tablet_service.cc:1467] Processing CreateTablet for tablet 029dba0050a64bd4adb35e9815450450 (DEFAULT_TABLE table=rebalance_test_table_3 [id=0c4182cf7d98406d87a12a073ef6b915]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:47.143226 16901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 029dba0050a64bd4adb35e9815450450. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:47.143429 17306 tablet_service.cc:1467] Processing CreateTablet for tablet 787b9b0227da4dd08df5aeb37f0d0468 (DEFAULT_TABLE table=rebalance_test_table_3 [id=0c4182cf7d98406d87a12a073ef6b915]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:47.143704 17306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 787b9b0227da4dd08df5aeb37f0d0468. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:47.143910 18142 tablet_bootstrap.cc:654] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:47.144443 18141 tablet_bootstrap.cc:492] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:47.145107 18141 tablet_bootstrap.cc:654] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:47.145967 18145 tablet_bootstrap.cc:492] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:47.146137 17305 tablet_service.cc:1467] Processing CreateTablet for tablet 0429b2d6357546f48b422810148fdce1 (DEFAULT_TABLE table=rebalance_test_table_3 [id=0c4182cf7d98406d87a12a073ef6b915]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:47.146191 18141 tablet_bootstrap.cc:492] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:47.146268 18141 ts_tablet_manager.cc:1367] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:47.146337 17305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0429b2d6357546f48b422810148fdce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:47.146652 18141 raft_consensus.cc:348] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:47.146745 18141 raft_consensus.cc:374] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:47.146778 18141 raft_consensus.cc:729] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:47.146814 18145 tablet_bootstrap.cc:654] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:47.146895 18141 consensus_queue.cc:260] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:47.147230 18141 ts_tablet_manager.cc:1398] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:47.147382 18141 tablet_bootstrap.cc:492] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:47.148419 18141 tablet_bootstrap.cc:654] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:47.140210 17172 tablet_service.cc:1467] Processing CreateTablet for tablet 029dba0050a64bd4adb35e9815450450 (DEFAULT_TABLE table=rebalance_test_table_3 [id=0c4182cf7d98406d87a12a073ef6b915]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:47.148847 17037 tablet_service.cc:1467] Processing CreateTablet for tablet 0429b2d6357546f48b422810148fdce1 (DEFAULT_TABLE table=rebalance_test_table_3 [id=0c4182cf7d98406d87a12a073ef6b915]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:47.148941 17172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 029dba0050a64bd4adb35e9815450450. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:47.149062 17037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0429b2d6357546f48b422810148fdce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:47.150349 18141 tablet_bootstrap.cc:492] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:47.150424 18141 ts_tablet_manager.cc:1367] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:47.140621 17171 tablet_service.cc:1467] Processing CreateTablet for tablet 787b9b0227da4dd08df5aeb37f0d0468 (DEFAULT_TABLE table=rebalance_test_table_3 [id=0c4182cf7d98406d87a12a073ef6b915]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:47.151244 17171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 787b9b0227da4dd08df5aeb37f0d0468. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:47.151479 18141 raft_consensus.cc:348] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.151588 18141 raft_consensus.cc:374] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:47.151629 18141 raft_consensus.cc:729] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:47.151746 18141 consensus_queue.cc:260] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.151991 18141 ts_tablet_manager.cc:1398] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 01:58:47.141068 17170 tablet_service.cc:1467] Processing CreateTablet for tablet 0429b2d6357546f48b422810148fdce1 (DEFAULT_TABLE table=rebalance_test_table_3 [id=0c4182cf7d98406d87a12a073ef6b915]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:47.153137 17170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0429b2d6357546f48b422810148fdce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:47.154189 18148 tablet_bootstrap.cc:492] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:47.154989 18148 tablet_bootstrap.cc:654] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:47.155944 18142 tablet_bootstrap.cc:492] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:47.156018 18142 ts_tablet_manager.cc:1367] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20240502 01:58:47.156133 18145 tablet_bootstrap.cc:492] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:47.156219 18145 ts_tablet_manager.cc:1367] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.001s
I20240502 01:58:47.156447 18142 raft_consensus.cc:348] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.156533 18142 raft_consensus.cc:374] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:47.156554 18142 raft_consensus.cc:729] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:47.156598 18145 raft_consensus.cc:348] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:47.156674 18142 consensus_queue.cc:260] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.156713 18145 raft_consensus.cc:374] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:47.156759 18145 raft_consensus.cc:729] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:47.156889 18145 consensus_queue.cc:260] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:47.156924 18142 ts_tablet_manager.cc:1398] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:47.157069 18142 tablet_bootstrap.cc:492] T 0429b2d6357546f48b422810148fdce1 P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:47.157106 18145 ts_tablet_manager.cc:1398] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:47.157269 18145 tablet_bootstrap.cc:492] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:47.157881 18142 tablet_bootstrap.cc:654] T 0429b2d6357546f48b422810148fdce1 P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:47.158141 18145 tablet_bootstrap.cc:654] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:47.159612 18148 tablet_bootstrap.cc:492] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:47.159709 18148 ts_tablet_manager.cc:1367] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240502 01:58:47.160164 18145 tablet_bootstrap.cc:492] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:47.160156 18148 raft_consensus.cc:348] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.160233 18145 ts_tablet_manager.cc:1367] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:58:47.160249 18148 raft_consensus.cc:374] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:47.160283 18148 raft_consensus.cc:729] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:47.160413 18148 consensus_queue.cc:260] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.160579 18145 raft_consensus.cc:348] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:47.160672 18145 raft_consensus.cc:374] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:47.160679 18148 ts_tablet_manager.cc:1398] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:47.160697 18145 raft_consensus.cc:729] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:47.160792 18145 consensus_queue.cc:260] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:47.160936 18148 tablet_bootstrap.cc:492] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:47.161266 18142 tablet_bootstrap.cc:492] T 0429b2d6357546f48b422810148fdce1 P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:47.161342 18142 ts_tablet_manager.cc:1367] T 0429b2d6357546f48b422810148fdce1 P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:58:47.161753 18142 raft_consensus.cc:348] T 0429b2d6357546f48b422810148fdce1 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:47.161852 18142 raft_consensus.cc:374] T 0429b2d6357546f48b422810148fdce1 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:47.161886 18142 raft_consensus.cc:729] T 0429b2d6357546f48b422810148fdce1 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:47.162040 18142 consensus_queue.cc:260] T 0429b2d6357546f48b422810148fdce1 P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:47.162098 18148 tablet_bootstrap.cc:654] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:47.162297 18142 ts_tablet_manager.cc:1398] T 0429b2d6357546f48b422810148fdce1 P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:47.162617 18145 ts_tablet_manager.cc:1398] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:47.164113 18148 tablet_bootstrap.cc:492] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:47.164201 18148 ts_tablet_manager.cc:1367] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20240502 01:58:47.164575 18148 raft_consensus.cc:348] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:47.164652 18148 raft_consensus.cc:374] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:47.164671 18148 raft_consensus.cc:729] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:47.164762 18148 consensus_queue.cc:260] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:47.165004 18148 ts_tablet_manager.cc:1398] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:47.165177 18148 tablet_bootstrap.cc:492] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:47.165866 18148 tablet_bootstrap.cc:654] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:47.166765 18148 tablet_bootstrap.cc:492] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:47.166848 18148 ts_tablet_manager.cc:1367] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240502 01:58:47.167403 18148 raft_consensus.cc:348] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:47.167493 18148 raft_consensus.cc:374] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:47.167526 18148 raft_consensus.cc:729] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:47.167649 18148 consensus_queue.cc:260] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:47.167862 18148 ts_tablet_manager.cc:1398] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:47.224915 18087 raft_consensus.cc:482] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:47.225047 18087 raft_consensus.cc:504] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.225445 18087 leader_election.cc:288] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923), 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:47.225857 17192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "029dba0050a64bd4adb35e9815450450" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4" is_pre_election: true
I20240502 01:58:47.225898 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "029dba0050a64bd4adb35e9815450450" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee" is_pre_election: true
I20240502 01:58:47.226023 17192 raft_consensus.cc:2454] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 0.
I20240502 01:58:47.226074 17059 raft_consensus.cc:2454] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 0.
I20240502 01:58:47.226346 16857 leader_election.cc:302] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:47.226517 18087 raft_consensus.cc:2781] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:47.226598 18087 raft_consensus.cc:482] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:47.226631 18087 raft_consensus.cc:3037] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:47.227411 18087 raft_consensus.cc:504] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.227718 18087 leader_election.cc:288] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 election: Requested vote from peers a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923), 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:47.228020 17192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "029dba0050a64bd4adb35e9815450450" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:58:47.228055 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "029dba0050a64bd4adb35e9815450450" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee"
I20240502 01:58:47.228127 17192 raft_consensus.cc:3037] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:47.228169 17059 raft_consensus.cc:3037] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:47.228876 17192 raft_consensus.cc:2454] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 1.
I20240502 01:58:47.228884 17059 raft_consensus.cc:2454] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 1.
I20240502 01:58:47.229148 16857 leader_election.cc:302] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:47.229347 18087 raft_consensus.cc:2781] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:47.229426 18087 raft_consensus.cc:686] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Becoming Leader. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Running, Role: LEADER
I20240502 01:58:47.229564 18087 consensus_queue.cc:237] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.231190 16772 catalog_manager.cc:5484] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: term changed from 0 to 1, leader changed from <none> to 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193). New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } }
I20240502 01:58:47.387301 18075 raft_consensus.cc:482] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:47.387429 18075 raft_consensus.cc:504] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:47.387874 18075 leader_election.cc:288] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:47.388309 17192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "787b9b0227da4dd08df5aeb37f0d0468" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4" is_pre_election: true
I20240502 01:58:47.388468 17192 raft_consensus.cc:2454] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 0.
I20240502 01:58:47.388759 17259 leader_election.cc:302] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1c00c21761540dea7ddae8d0dd26df4, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:47.388939 18075 raft_consensus.cc:2781] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:47.389006 18075 raft_consensus.cc:482] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:47.389039 18075 raft_consensus.cc:3037] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:47.389897 18075 raft_consensus.cc:504] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:47.390254 18075 leader_election.cc:288] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 election: Requested vote from peers 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:47.390569 17192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "787b9b0227da4dd08df5aeb37f0d0468" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:58:47.390681 17192 raft_consensus.cc:3037] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:47.391527 17192 raft_consensus.cc:2454] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 1.
I20240502 01:58:47.391793 17259 leader_election.cc:302] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1c00c21761540dea7ddae8d0dd26df4, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:47.391927 16922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "787b9b0227da4dd08df5aeb37f0d0468" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc" is_pre_election: true
I20240502 01:58:47.392004 18075 raft_consensus.cc:2781] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:47.392046 16922 raft_consensus.cc:2454] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 0.
I20240502 01:58:47.392069 16923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "787b9b0227da4dd08df5aeb37f0d0468" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
I20240502 01:58:47.392210 16923 raft_consensus.cc:3037] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:47.392225 18075 raft_consensus.cc:686] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Becoming Leader. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Running, Role: LEADER
I20240502 01:58:47.392398 18075 consensus_queue.cc:237] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:47.393221 16923 raft_consensus.cc:2454] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 1.
I20240502 01:58:47.394292 16772 catalog_manager.cc:5484] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec11d4bb3a064a94a80084142637b441 (127.10.133.196). New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:47.486367 18075 raft_consensus.cc:482] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:47.486480 18075 raft_consensus.cc:504] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:47.486910 18075 leader_election.cc:288] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923), 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:47.487267 17192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0429b2d6357546f48b422810148fdce1" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4" is_pre_election: true
I20240502 01:58:47.487303 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0429b2d6357546f48b422810148fdce1" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee" is_pre_election: true
I20240502 01:58:47.487387 17192 raft_consensus.cc:2454] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 0.
I20240502 01:58:47.487433 17059 raft_consensus.cc:2454] T 0429b2d6357546f48b422810148fdce1 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 0.
I20240502 01:58:47.487720 17259 leader_election.cc:302] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, a1c00c21761540dea7ddae8d0dd26df4, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:47.487921 18075 raft_consensus.cc:2781] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:47.487978 18075 raft_consensus.cc:482] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:47.488026 18075 raft_consensus.cc:3037] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:47.488807 18075 raft_consensus.cc:504] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:47.489107 18075 leader_election.cc:288] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 election: Requested vote from peers a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923), 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:47.489391 17192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0429b2d6357546f48b422810148fdce1" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:58:47.489410 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0429b2d6357546f48b422810148fdce1" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee"
I20240502 01:58:47.489495 17059 raft_consensus.cc:3037] T 0429b2d6357546f48b422810148fdce1 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:47.489498 17192 raft_consensus.cc:3037] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:47.490270 17059 raft_consensus.cc:2454] T 0429b2d6357546f48b422810148fdce1 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 1.
I20240502 01:58:47.490332 17192 raft_consensus.cc:2454] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 1.
I20240502 01:58:47.490543 17258 leader_election.cc:302] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:47.490756 18075 raft_consensus.cc:2781] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:47.490842 18075 raft_consensus.cc:686] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Becoming Leader. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Running, Role: LEADER
I20240502 01:58:47.490998 18075 consensus_queue.cc:237] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:47.492655 16772 catalog_manager.cc:5484] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec11d4bb3a064a94a80084142637b441 (127.10.133.196). New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: UNKNOWN } } }
W20240502 01:58:47.611052 18159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:47.611272 18159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:47.614496 18159 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_3'
I20240502 01:58:47.639766 18087 consensus_queue.cc:1035] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:47.643307 18087 consensus_queue.cc:1035] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:47.691780 17192 raft_consensus.cc:1261] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:47.691793 17059 raft_consensus.cc:1261] T 0429b2d6357546f48b422810148fdce1 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:47.692260 18156 consensus_queue.cc:1035] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:47.692747 18075 consensus_queue.cc:1035] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:47.694397 17192 raft_consensus.cc:1261] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:47.695477 18075 consensus_queue.cc:1035] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:47.701815 16923 raft_consensus.cc:1261] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:47.704562 18156 consensus_queue.cc:1035] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 96.7817 ms
time per row: 0.0483908 ms
I20240502 01:58:47.755734 16777 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40394:
name: "rebalance_test_table_4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 01:58:47.761047 16901 tablet_service.cc:1467] Processing CreateTablet for tablet fe3333c0dfe048fda6cfc8b12bf0d5a9 (DEFAULT_TABLE table=rebalance_test_table_4 [id=ed83c8027ba34b24b41cae8d5a7a294c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:47.761123 17037 tablet_service.cc:1467] Processing CreateTablet for tablet fe3333c0dfe048fda6cfc8b12bf0d5a9 (DEFAULT_TABLE table=rebalance_test_table_4 [id=ed83c8027ba34b24b41cae8d5a7a294c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:47.761278 17170 tablet_service.cc:1467] Processing CreateTablet for tablet fe3333c0dfe048fda6cfc8b12bf0d5a9 (DEFAULT_TABLE table=rebalance_test_table_4 [id=ed83c8027ba34b24b41cae8d5a7a294c]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:47.761361 16901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe3333c0dfe048fda6cfc8b12bf0d5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:47.761408 17037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe3333c0dfe048fda6cfc8b12bf0d5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:47.761515 17170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe3333c0dfe048fda6cfc8b12bf0d5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:47.762480 17171 tablet_service.cc:1467] Processing CreateTablet for tablet a475490b83164ff3930aae5978e7845e (DEFAULT_TABLE table=rebalance_test_table_4 [id=ed83c8027ba34b24b41cae8d5a7a294c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:47.762619 16903 tablet_service.cc:1467] Processing CreateTablet for tablet a475490b83164ff3930aae5978e7845e (DEFAULT_TABLE table=rebalance_test_table_4 [id=ed83c8027ba34b24b41cae8d5a7a294c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:47.762619 17038 tablet_service.cc:1467] Processing CreateTablet for tablet 7c92206bbd4340d59a7ee7379f581bb7 (DEFAULT_TABLE table=rebalance_test_table_4 [id=ed83c8027ba34b24b41cae8d5a7a294c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:47.762719 17171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a475490b83164ff3930aae5978e7845e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:47.762840 17038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c92206bbd4340d59a7ee7379f581bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:47.762852 16903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a475490b83164ff3930aae5978e7845e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:47.763875 16902 tablet_service.cc:1467] Processing CreateTablet for tablet 7c92206bbd4340d59a7ee7379f581bb7 (DEFAULT_TABLE table=rebalance_test_table_4 [id=ed83c8027ba34b24b41cae8d5a7a294c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:47.764094 16902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c92206bbd4340d59a7ee7379f581bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:47.765395 17305 tablet_service.cc:1467] Processing CreateTablet for tablet 7c92206bbd4340d59a7ee7379f581bb7 (DEFAULT_TABLE table=rebalance_test_table_4 [id=ed83c8027ba34b24b41cae8d5a7a294c]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:47.765395 17306 tablet_service.cc:1467] Processing CreateTablet for tablet a475490b83164ff3930aae5978e7845e (DEFAULT_TABLE table=rebalance_test_table_4 [id=ed83c8027ba34b24b41cae8d5a7a294c]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:47.765700 17305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c92206bbd4340d59a7ee7379f581bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:47.765882 17306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a475490b83164ff3930aae5978e7845e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:47.766289 18223 tablet_bootstrap.cc:492] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:47.767267 18223 tablet_bootstrap.cc:654] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:47.767704 18221 tablet_bootstrap.cc:492] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:47.767900 18222 tablet_bootstrap.cc:492] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:47.768047 18225 tablet_bootstrap.cc:492] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:47.768615 18221 tablet_bootstrap.cc:654] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:47.768694 18222 tablet_bootstrap.cc:654] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:47.768925 18225 tablet_bootstrap.cc:654] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:47.769785 18222 tablet_bootstrap.cc:492] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:47.769877 18222 ts_tablet_manager.cc:1367] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:47.770082 18225 tablet_bootstrap.cc:492] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:47.770184 18225 ts_tablet_manager.cc:1367] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:47.770416 18222 raft_consensus.cc:348] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.770539 18221 tablet_bootstrap.cc:492] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:47.770531 18222 raft_consensus.cc:374] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:47.770576 18222 raft_consensus.cc:729] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:47.770632 18221 ts_tablet_manager.cc:1367] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:47.770633 18225 raft_consensus.cc:348] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.770746 18225 raft_consensus.cc:374] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:47.770699 18222 consensus_queue.cc:260] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.770788 18225 raft_consensus.cc:729] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:47.770916 18225 consensus_queue.cc:260] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.770979 18222 ts_tablet_manager.cc:1398] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:47.771133 18222 tablet_bootstrap.cc:492] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:47.771092 18221 raft_consensus.cc:348] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:47.771191 18221 raft_consensus.cc:374] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:47.771219 18225 ts_tablet_manager.cc:1398] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:47.771236 18221 raft_consensus.cc:729] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:47.771410 18225 tablet_bootstrap.cc:492] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:47.771374 18221 consensus_queue.cc:260] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:47.771662 18221 ts_tablet_manager.cc:1398] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:47.771816 18221 tablet_bootstrap.cc:492] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:47.772011 18222 tablet_bootstrap.cc:654] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:47.772203 18225 tablet_bootstrap.cc:654] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:47.772737 18221 tablet_bootstrap.cc:654] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:47.772934 18223 tablet_bootstrap.cc:492] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:47.773010 18223 ts_tablet_manager.cc:1367] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240502 01:58:47.773200 18225 tablet_bootstrap.cc:492] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:47.773267 18225 ts_tablet_manager.cc:1367] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:47.773548 18223 raft_consensus.cc:348] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.773662 18223 raft_consensus.cc:374] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:47.773698 18223 raft_consensus.cc:729] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:47.773681 18225 raft_consensus.cc:348] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.773797 18225 raft_consensus.cc:374] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:47.773841 18225 raft_consensus.cc:729] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:47.773850 18223 consensus_queue.cc:260] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.773953 18225 consensus_queue.cc:260] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.774168 18223 ts_tablet_manager.cc:1398] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:47.774220 18225 ts_tablet_manager.cc:1398] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:47.774346 18223 tablet_bootstrap.cc:492] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:47.775193 18223 tablet_bootstrap.cc:654] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:47.776439 18222 tablet_bootstrap.cc:492] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:47.776523 18222 ts_tablet_manager.cc:1367] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20240502 01:58:47.776973 18222 raft_consensus.cc:348] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.777069 18221 tablet_bootstrap.cc:492] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:47.777077 18222 raft_consensus.cc:374] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:47.777118 18222 raft_consensus.cc:729] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:47.777143 18221 ts_tablet_manager.cc:1367] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:58:47.777283 18222 consensus_queue.cc:260] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.777549 18222 ts_tablet_manager.cc:1398] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:47.777572 18221 raft_consensus.cc:348] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.777665 18221 raft_consensus.cc:374] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:47.777695 18221 raft_consensus.cc:729] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:47.777722 18222 tablet_bootstrap.cc:492] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:47.777805 18221 consensus_queue.cc:260] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.778112 18221 ts_tablet_manager.cc:1398] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:47.778689 18223 tablet_bootstrap.cc:492] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:47.778738 18222 tablet_bootstrap.cc:654] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:47.778849 18223 ts_tablet_manager.cc:1367] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:58:47.779659 18223 raft_consensus.cc:348] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:47.779806 18223 raft_consensus.cc:374] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:47.779886 18223 raft_consensus.cc:729] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:47.780040 18223 consensus_queue.cc:260] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:47.780421 18223 ts_tablet_manager.cc:1398] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:47.780462 18222 tablet_bootstrap.cc:492] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:47.780535 18222 ts_tablet_manager.cc:1367] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:47.780901 18222 raft_consensus.cc:348] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:47.781001 18222 raft_consensus.cc:374] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:47.781037 18222 raft_consensus.cc:729] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:47.781157 18222 consensus_queue.cc:260] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:47.781428 18222 ts_tablet_manager.cc:1398] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:47.858623 18185 raft_consensus.cc:482] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:47.858744 18185 raft_consensus.cc:504] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.859135 18185 leader_election.cc:288] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135), 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:47.859603 17326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a475490b83164ff3930aae5978e7845e" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441" is_pre_election: true
I20240502 01:58:47.859663 16923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a475490b83164ff3930aae5978e7845e" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc" is_pre_election: true
I20240502 01:58:47.859743 17326 raft_consensus.cc:2454] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 0.
I20240502 01:58:47.859784 16923 raft_consensus.cc:2454] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 0.
I20240502 01:58:47.860103 17125 leader_election.cc:302] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:47.860289 18185 raft_consensus.cc:2781] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:47.860344 18185 raft_consensus.cc:482] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:47.860369 18185 raft_consensus.cc:3037] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:47.861205 18185 raft_consensus.cc:504] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.861506 18185 leader_election.cc:288] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [CANDIDATE]: Term 1 election: Requested vote from peers ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135), 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:47.861828 17326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a475490b83164ff3930aae5978e7845e" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441"
I20240502 01:58:47.861884 16923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a475490b83164ff3930aae5978e7845e" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
I20240502 01:58:47.861953 17326 raft_consensus.cc:3037] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:47.861974 16923 raft_consensus.cc:3037] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:47.862681 16923 raft_consensus.cc:2454] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 1.
I20240502 01:58:47.862684 17326 raft_consensus.cc:2454] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 1.
I20240502 01:58:47.862939 17125 leader_election.cc:302] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:47.863168 18185 raft_consensus.cc:2781] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:47.863270 18185 raft_consensus.cc:686] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Becoming Leader. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Running, Role: LEADER
I20240502 01:58:47.863405 18185 consensus_queue.cc:237] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.865036 16775 catalog_manager.cc:5484] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195). New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:47.869325 18075 raft_consensus.cc:482] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:47.869418 18075 raft_consensus.cc:504] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.869741 18075 leader_election.cc:288] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6431e35365644aac943c07c97e370fee (127.10.133.194:37811), 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:47.870124 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c92206bbd4340d59a7ee7379f581bb7" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee" is_pre_election: true
I20240502 01:58:47.870158 16923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c92206bbd4340d59a7ee7379f581bb7" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc" is_pre_election: true
I20240502 01:58:47.870257 17059 raft_consensus.cc:2454] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 0.
I20240502 01:58:47.870288 16923 raft_consensus.cc:2454] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 0.
I20240502 01:58:47.870505 17258 leader_election.cc:302] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:47.870697 18075 raft_consensus.cc:2781] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:47.870750 18075 raft_consensus.cc:482] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:47.870797 18075 raft_consensus.cc:3037] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:47.871526 18075 raft_consensus.cc:504] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.871799 18075 leader_election.cc:288] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 election: Requested vote from peers 6431e35365644aac943c07c97e370fee (127.10.133.194:37811), 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:47.872110 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c92206bbd4340d59a7ee7379f581bb7" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee"
I20240502 01:58:47.872133 16923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c92206bbd4340d59a7ee7379f581bb7" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
I20240502 01:58:47.872207 17059 raft_consensus.cc:3037] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:47.872246 16923 raft_consensus.cc:3037] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:47.872936 17059 raft_consensus.cc:2454] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 1.
I20240502 01:58:47.873003 16923 raft_consensus.cc:2454] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 1.
I20240502 01:58:47.873306 17258 leader_election.cc:302] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:47.873457 18075 raft_consensus.cc:2781] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:47.873575 18075 raft_consensus.cc:686] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Becoming Leader. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Running, Role: LEADER
I20240502 01:58:47.873714 18075 consensus_queue.cc:237] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:47.875329 16775 catalog_manager.cc:5484] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec11d4bb3a064a94a80084142637b441 (127.10.133.196). New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:47.923731 18197 raft_consensus.cc:482] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:47.923866 18197 raft_consensus.cc:504] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:47.924218 18197 leader_election.cc:288] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6431e35365644aac943c07c97e370fee (127.10.133.194:37811), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:47.924559 17192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3333c0dfe048fda6cfc8b12bf0d5a9" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4" is_pre_election: true
I20240502 01:58:47.924620 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3333c0dfe048fda6cfc8b12bf0d5a9" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee" is_pre_election: true
I20240502 01:58:47.924719 17192 raft_consensus.cc:2454] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 0.
I20240502 01:58:47.924736 17059 raft_consensus.cc:2454] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 0.
I20240502 01:58:47.925004 16856 leader_election.cc:302] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, 6431e35365644aac943c07c97e370fee; no voters:
I20240502 01:58:47.925168 18197 raft_consensus.cc:2781] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:47.925226 18197 raft_consensus.cc:482] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:47.925252 18197 raft_consensus.cc:3037] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:47.926071 18197 raft_consensus.cc:504] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:47.926326 18197 leader_election.cc:288] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 election: Requested vote from peers 6431e35365644aac943c07c97e370fee (127.10.133.194:37811), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:47.926662 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3333c0dfe048fda6cfc8b12bf0d5a9" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee"
I20240502 01:58:47.926678 17192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe3333c0dfe048fda6cfc8b12bf0d5a9" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:58:47.926774 17059 raft_consensus.cc:3037] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:47.926793 17192 raft_consensus.cc:3037] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:47.927484 17059 raft_consensus.cc:2454] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 1.
I20240502 01:58:47.927551 17192 raft_consensus.cc:2454] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 1.
I20240502 01:58:47.927768 16856 leader_election.cc:302] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, 6431e35365644aac943c07c97e370fee; no voters:
I20240502 01:58:47.927922 18197 raft_consensus.cc:2781] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:47.928020 18197 raft_consensus.cc:686] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Becoming Leader. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Running, Role: LEADER
I20240502 01:58:47.928169 18197 consensus_queue.cc:237] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:47.929824 16775 catalog_manager.cc:5484] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: term changed from 0 to 1, leader changed from <none> to 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193). New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } }
W20240502 01:58:48.060658 18237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:48.060904 18237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:48.063885 18237 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_4'
I20240502 01:58:48.140129 16923 raft_consensus.cc:1261] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:48.140535 18185 consensus_queue.cc:1035] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:48.142161 16922 raft_consensus.cc:1261] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:48.142655 18075 consensus_queue.cc:1035] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:48.142840 17059 raft_consensus.cc:1261] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:48.143368 18075 consensus_queue.cc:1035] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:48.149507 17326 raft_consensus.cc:1261] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:48.150126 17192 raft_consensus.cc:1261] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:48.150138 17058 raft_consensus.cc:1261] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:48.150693 18197 consensus_queue.cc:1035] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:48.152266 18185 consensus_queue.cc:1035] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:48.153275 18197 consensus_queue.cc:1035] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:48.169381 18195 mvcc.cc:205] Tried to move back new op lower bound from 7023063564895277056 to 7023063563729563648. Current Snapshot: MvccSnapshot[applied={T|T < 7023063564857462784}]
INSERT report
rows total: 2000
time total: 103.064 ms
time per row: 0.0515319 ms
I20240502 01:58:48.205941 16779 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40394:
name: "rebalance_test_table_5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 01:58:48.210992 17038 tablet_service.cc:1467] Processing CreateTablet for tablet 086b486997ae4d15a4b070e79552807f (DEFAULT_TABLE table=rebalance_test_table_5 [id=2cbb40e4a59445dc9a1b5b4161e4c646]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:48.211069 17170 tablet_service.cc:1467] Processing CreateTablet for tablet 086b486997ae4d15a4b070e79552807f (DEFAULT_TABLE table=rebalance_test_table_5 [id=2cbb40e4a59445dc9a1b5b4161e4c646]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:48.211297 17038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 086b486997ae4d15a4b070e79552807f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:48.211369 17170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 086b486997ae4d15a4b070e79552807f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:48.212146 17037 tablet_service.cc:1467] Processing CreateTablet for tablet e03fff9bc743475d92ae26b85e7f39ff (DEFAULT_TABLE table=rebalance_test_table_5 [id=2cbb40e4a59445dc9a1b5b4161e4c646]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:48.212168 17039 tablet_service.cc:1467] Processing CreateTablet for tablet 0a30ab572eff4a1ebabf95be48e178e2 (DEFAULT_TABLE table=rebalance_test_table_5 [id=2cbb40e4a59445dc9a1b5b4161e4c646]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:48.212404 17037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e03fff9bc743475d92ae26b85e7f39ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:48.212545 17039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a30ab572eff4a1ebabf95be48e178e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:48.213676 17305 tablet_service.cc:1467] Processing CreateTablet for tablet 086b486997ae4d15a4b070e79552807f (DEFAULT_TABLE table=rebalance_test_table_5 [id=2cbb40e4a59445dc9a1b5b4161e4c646]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:48.213930 17305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 086b486997ae4d15a4b070e79552807f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:48.214607 16901 tablet_service.cc:1467] Processing CreateTablet for tablet 0a30ab572eff4a1ebabf95be48e178e2 (DEFAULT_TABLE table=rebalance_test_table_5 [id=2cbb40e4a59445dc9a1b5b4161e4c646]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:48.214761 18223 tablet_bootstrap.cc:492] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:48.214926 16901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a30ab572eff4a1ebabf95be48e178e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:48.215698 18223 tablet_bootstrap.cc:654] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:48.216109 18225 tablet_bootstrap.cc:492] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:48.216555 18221 tablet_bootstrap.cc:492] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:48.216856 18225 tablet_bootstrap.cc:654] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:48.217392 18221 tablet_bootstrap.cc:654] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:48.217831 18225 tablet_bootstrap.cc:492] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:48.217931 18225 ts_tablet_manager.cc:1367] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:48.218144 18222 tablet_bootstrap.cc:492] T 0a30ab572eff4a1ebabf95be48e178e2 P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:48.218372 18225 raft_consensus.cc:348] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.218472 18225 raft_consensus.cc:374] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:48.218508 18225 raft_consensus.cc:729] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:48.218631 18225 consensus_queue.cc:260] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.218955 18225 ts_tablet_manager.cc:1398] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:48.218987 18222 tablet_bootstrap.cc:654] T 0a30ab572eff4a1ebabf95be48e178e2 P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:48.219802 17306 tablet_service.cc:1467] Processing CreateTablet for tablet e03fff9bc743475d92ae26b85e7f39ff (DEFAULT_TABLE table=rebalance_test_table_5 [id=2cbb40e4a59445dc9a1b5b4161e4c646]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:48.219975 17306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e03fff9bc743475d92ae26b85e7f39ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:48.219993 18222 tablet_bootstrap.cc:492] T 0a30ab572eff4a1ebabf95be48e178e2 P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:48.220057 18222 ts_tablet_manager.cc:1367] T 0a30ab572eff4a1ebabf95be48e178e2 P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:48.220372 18222 raft_consensus.cc:348] T 0a30ab572eff4a1ebabf95be48e178e2 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:48.220453 18222 raft_consensus.cc:374] T 0a30ab572eff4a1ebabf95be48e178e2 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:48.220476 18222 raft_consensus.cc:729] T 0a30ab572eff4a1ebabf95be48e178e2 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:48.220583 18222 consensus_queue.cc:260] T 0a30ab572eff4a1ebabf95be48e178e2 P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:48.220794 18222 ts_tablet_manager.cc:1398] T 0a30ab572eff4a1ebabf95be48e178e2 P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:48.221424 18225 tablet_bootstrap.cc:492] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:48.222200 17170 tablet_service.cc:1467] Processing CreateTablet for tablet e03fff9bc743475d92ae26b85e7f39ff (DEFAULT_TABLE table=rebalance_test_table_5 [id=2cbb40e4a59445dc9a1b5b4161e4c646]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:48.222270 18225 tablet_bootstrap.cc:654] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:48.222474 17170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e03fff9bc743475d92ae26b85e7f39ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:48.224282 18221 tablet_bootstrap.cc:492] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:48.224382 18221 ts_tablet_manager.cc:1367] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20240502 01:58:48.224726 17171 tablet_service.cc:1467] Processing CreateTablet for tablet 0a30ab572eff4a1ebabf95be48e178e2 (DEFAULT_TABLE table=rebalance_test_table_5 [id=2cbb40e4a59445dc9a1b5b4161e4c646]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:48.224864 18221 raft_consensus.cc:348] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.224985 17171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a30ab572eff4a1ebabf95be48e178e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:48.224980 18221 raft_consensus.cc:374] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:48.225019 18221 raft_consensus.cc:729] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:48.225147 18221 consensus_queue.cc:260] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.225430 18221 ts_tablet_manager.cc:1398] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:48.226105 18223 tablet_bootstrap.cc:492] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:48.226197 18223 ts_tablet_manager.cc:1367] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20240502 01:58:48.226634 18223 raft_consensus.cc:348] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.226737 18223 raft_consensus.cc:374] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:48.226775 18223 raft_consensus.cc:729] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:48.226905 18223 consensus_queue.cc:260] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.227172 18223 ts_tablet_manager.cc:1398] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:48.227331 18223 tablet_bootstrap.cc:492] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:48.228163 18223 tablet_bootstrap.cc:654] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:48.229020 18221 tablet_bootstrap.cc:492] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:48.230101 18221 tablet_bootstrap.cc:654] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:48.231278 18223 tablet_bootstrap.cc:492] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:48.231390 18223 ts_tablet_manager.cc:1367] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240502 01:58:48.231791 18223 raft_consensus.cc:348] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:48.231890 18223 raft_consensus.cc:374] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:48.231925 18223 raft_consensus.cc:729] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:48.232055 18223 consensus_queue.cc:260] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:48.232510 18221 tablet_bootstrap.cc:492] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:48.232614 18221 ts_tablet_manager.cc:1367] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20240502 01:58:48.232996 18221 raft_consensus.cc:348] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:48.233078 18221 raft_consensus.cc:374] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:48.233099 18221 raft_consensus.cc:729] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:48.233217 18221 consensus_queue.cc:260] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:48.233450 18221 ts_tablet_manager.cc:1398] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:48.233681 18223 ts_tablet_manager.cc:1398] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:48.233879 18221 tablet_bootstrap.cc:492] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:48.234002 18223 tablet_bootstrap.cc:492] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:48.234886 18221 tablet_bootstrap.cc:654] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:48.235047 18223 tablet_bootstrap.cc:654] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:48.236516 18221 tablet_bootstrap.cc:492] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:48.236601 18221 ts_tablet_manager.cc:1367] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240502 01:58:48.236903 18225 tablet_bootstrap.cc:492] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:48.236984 18225 ts_tablet_manager.cc:1367] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20240502 01:58:48.237035 18221 raft_consensus.cc:348] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:48.237109 18221 raft_consensus.cc:374] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:48.237128 18221 raft_consensus.cc:729] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:48.237242 18221 consensus_queue.cc:260] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:48.237486 18221 ts_tablet_manager.cc:1398] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:48.237439 18225 raft_consensus.cc:348] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:48.237545 18225 raft_consensus.cc:374] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:48.237577 18225 raft_consensus.cc:729] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:48.237704 18225 consensus_queue.cc:260] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:48.237968 18225 ts_tablet_manager.cc:1398] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:48.238667 18223 tablet_bootstrap.cc:492] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:48.238749 18223 ts_tablet_manager.cc:1367] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20240502 01:58:48.239169 18223 raft_consensus.cc:348] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:48.239341 18223 raft_consensus.cc:374] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:48.239398 18223 raft_consensus.cc:729] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:48.239521 18223 consensus_queue.cc:260] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:48.239921 18223 ts_tablet_manager.cc:1398] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:48.296626 17944 raft_consensus.cc:482] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:48.296761 18284 raft_consensus.cc:482] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:48.296766 17944 raft_consensus.cc:504] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.296905 18284 raft_consensus.cc:504] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:48.297256 17944 leader_election.cc:288] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923), ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:48.297273 18284 leader_election.cc:288] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:48.297641 17192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "086b486997ae4d15a4b070e79552807f" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4" is_pre_election: true
I20240502 01:58:48.297680 17191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e03fff9bc743475d92ae26b85e7f39ff" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4" is_pre_election: true
I20240502 01:58:48.297680 17326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e03fff9bc743475d92ae26b85e7f39ff" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441" is_pre_election: true
I20240502 01:58:48.297762 17324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "086b486997ae4d15a4b070e79552807f" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441" is_pre_election: true
I20240502 01:58:48.297806 17326 raft_consensus.cc:2454] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:48.297792 17192 raft_consensus.cc:2454] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:48.297806 17191 raft_consensus.cc:2454] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:48.297885 17324 raft_consensus.cc:2454] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:48.298103 16989 leader_election.cc:302] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:48.298105 16990 leader_election.cc:302] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:48.298283 18284 raft_consensus.cc:2781] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:48.298341 18284 raft_consensus.cc:482] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:48.298388 18284 raft_consensus.cc:3037] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:48.298600 17944 raft_consensus.cc:2781] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:48.298660 17944 raft_consensus.cc:482] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:48.298709 17944 raft_consensus.cc:3037] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:48.299516 18284 raft_consensus.cc:504] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:48.299582 17944 raft_consensus.cc:504] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.299916 18284 leader_election.cc:288] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Requested vote from peers ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:48.299916 17944 leader_election.cc:288] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Requested vote from peers a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923), ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:48.300316 17192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "086b486997ae4d15a4b070e79552807f" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:58:48.300338 17324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e03fff9bc743475d92ae26b85e7f39ff" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441"
I20240502 01:58:48.300362 17191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e03fff9bc743475d92ae26b85e7f39ff" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:58:48.300362 17326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "086b486997ae4d15a4b070e79552807f" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441"
I20240502 01:58:48.300433 17192 raft_consensus.cc:3037] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:48.300433 17324 raft_consensus.cc:3037] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:48.300467 17191 raft_consensus.cc:3037] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:48.300467 17326 raft_consensus.cc:3037] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:48.301393 17192 raft_consensus.cc:2454] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:48.301393 17324 raft_consensus.cc:2454] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:48.301484 17191 raft_consensus.cc:2454] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:48.301484 17326 raft_consensus.cc:2454] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:48.301674 16989 leader_election.cc:302] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:48.301826 16990 leader_election.cc:302] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:48.301860 17944 raft_consensus.cc:2781] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:48.301944 17944 raft_consensus.cc:686] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Becoming Leader. State: Replica: 6431e35365644aac943c07c97e370fee, State: Running, Role: LEADER
I20240502 01:58:48.302138 17944 consensus_queue.cc:237] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:48.302345 18285 raft_consensus.cc:2781] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:48.302429 18285 raft_consensus.cc:686] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Becoming Leader. State: Replica: 6431e35365644aac943c07c97e370fee, State: Running, Role: LEADER
I20240502 01:58:48.302565 18285 consensus_queue.cc:237] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.303841 16771 catalog_manager.cc:5484] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee reported cstate change: term changed from 0 to 1, leader changed from <none> to 6431e35365644aac943c07c97e370fee (127.10.133.194). New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } }
I20240502 01:58:48.307000 16771 catalog_manager.cc:5484] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee reported cstate change: term changed from 0 to 1, leader changed from <none> to 6431e35365644aac943c07c97e370fee (127.10.133.194). New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:48.427019 18285 raft_consensus.cc:482] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:48.427167 18285 raft_consensus.cc:504] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:48.427585 18285 leader_election.cc:288] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:48.428012 16922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a30ab572eff4a1ebabf95be48e178e2" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc" is_pre_election: true
I20240502 01:58:48.428020 17191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a30ab572eff4a1ebabf95be48e178e2" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4" is_pre_election: true
I20240502 01:58:48.428153 16922 raft_consensus.cc:2454] T 0a30ab572eff4a1ebabf95be48e178e2 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:48.428164 17191 raft_consensus.cc:2454] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:48.428475 16990 leader_election.cc:302] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:48.428658 18285 raft_consensus.cc:2781] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:48.428718 18285 raft_consensus.cc:482] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:48.428745 18285 raft_consensus.cc:3037] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:48.429565 18285 raft_consensus.cc:504] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:48.429893 18285 leader_election.cc:288] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Requested vote from peers 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:48.430233 17191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a30ab572eff4a1ebabf95be48e178e2" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:58:48.430263 16922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a30ab572eff4a1ebabf95be48e178e2" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
I20240502 01:58:48.430343 17191 raft_consensus.cc:3037] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:48.430356 16922 raft_consensus.cc:3037] T 0a30ab572eff4a1ebabf95be48e178e2 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:48.431099 17191 raft_consensus.cc:2454] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:48.431105 16922 raft_consensus.cc:2454] T 0a30ab572eff4a1ebabf95be48e178e2 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:48.431387 16989 leader_election.cc:302] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, 6431e35365644aac943c07c97e370fee; no voters:
I20240502 01:58:48.431541 18285 raft_consensus.cc:2781] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:48.431638 18285 raft_consensus.cc:686] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Becoming Leader. State: Replica: 6431e35365644aac943c07c97e370fee, State: Running, Role: LEADER
I20240502 01:58:48.431773 18285 consensus_queue.cc:237] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:48.433562 16771 catalog_manager.cc:5484] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee reported cstate change: term changed from 0 to 1, leader changed from <none> to 6431e35365644aac943c07c97e370fee (127.10.133.194). New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } }
W20240502 01:58:48.567576 18289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:48.567819 18289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:48.570986 18289 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_5'
I20240502 01:58:48.660828 17192 raft_consensus.cc:1261] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:48.661324 17191 raft_consensus.cc:1261] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:48.661676 17193 raft_consensus.cc:1261] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:48.662181 17324 raft_consensus.cc:1261] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:48.662564 16922 raft_consensus.cc:1261] T 0a30ab572eff4a1ebabf95be48e178e2 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:48.662804 17944 consensus_queue.cc:1035] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:48.663420 17944 consensus_queue.cc:1035] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:48.663450 17326 raft_consensus.cc:1261] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:48.664012 18317 consensus_queue.cc:1035] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:48.664077 17944 consensus_queue.cc:1035] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:48.665746 18318 consensus_queue.cc:1035] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:48.666123 18318 consensus_queue.cc:1035] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:48.686914 18209 mvcc.cc:205] Tried to move back new op lower bound from 7023063566986133504 to 7023063566057861120. Current Snapshot: MvccSnapshot[applied={T|T < 7023063566986133504}]
I20240502 01:58:48.697575 18315 mvcc.cc:205] Tried to move back new op lower bound from 7023063567001731072 to 7023063565528825856. Current Snapshot: MvccSnapshot[applied={T|T < 7023063566987694080}]
I20240502 01:58:48.704005 18204 mvcc.cc:205] Tried to move back new op lower bound from 7023063567002599424 to 7023063565526904832. Current Snapshot: MvccSnapshot[applied={T|T < 7023063566985826304}]
INSERT report
rows total: 2000
time total: 107.598 ms
time per row: 0.0537992 ms
I20240502 01:58:48.720501 16776 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40394:
name: "rebalance_test_table_6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 01:58:48.727968 16901 tablet_service.cc:1467] Processing CreateTablet for tablet 8a386a1fd8ae4d70ae482b3ce958825b (DEFAULT_TABLE table=rebalance_test_table_6 [id=3b1319b666dc429cb0d33c9c55b7266e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:48.728016 17037 tablet_service.cc:1467] Processing CreateTablet for tablet 8a386a1fd8ae4d70ae482b3ce958825b (DEFAULT_TABLE table=rebalance_test_table_6 [id=3b1319b666dc429cb0d33c9c55b7266e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:48.728322 17037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a386a1fd8ae4d70ae482b3ce958825b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:48.728334 16901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a386a1fd8ae4d70ae482b3ce958825b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:48.730461 18221 tablet_bootstrap.cc:492] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:48.730792 17171 tablet_service.cc:1467] Processing CreateTablet for tablet 20f803864ef14f12a5ba3bafa3a3b0c3 (DEFAULT_TABLE table=rebalance_test_table_6 [id=3b1319b666dc429cb0d33c9c55b7266e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:48.730845 16903 tablet_service.cc:1467] Processing CreateTablet for tablet adf06dd039c4433890e31c1ad9b44e98 (DEFAULT_TABLE table=rebalance_test_table_6 [id=3b1319b666dc429cb0d33c9c55b7266e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:48.730958 16902 tablet_service.cc:1467] Processing CreateTablet for tablet 20f803864ef14f12a5ba3bafa3a3b0c3 (DEFAULT_TABLE table=rebalance_test_table_6 [id=3b1319b666dc429cb0d33c9c55b7266e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:48.731060 17171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20f803864ef14f12a5ba3bafa3a3b0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:48.731069 16903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adf06dd039c4433890e31c1ad9b44e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:48.731170 16902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20f803864ef14f12a5ba3bafa3a3b0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:48.731309 18221 tablet_bootstrap.cc:654] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:48.731751 17037 tablet_service.cc:1467] Processing CreateTablet for tablet adf06dd039c4433890e31c1ad9b44e98 (DEFAULT_TABLE table=rebalance_test_table_6 [id=3b1319b666dc429cb0d33c9c55b7266e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:48.731998 17037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adf06dd039c4433890e31c1ad9b44e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:48.732050 17306 tablet_service.cc:1467] Processing CreateTablet for tablet 8a386a1fd8ae4d70ae482b3ce958825b (DEFAULT_TABLE table=rebalance_test_table_6 [id=3b1319b666dc429cb0d33c9c55b7266e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:48.732131 17305 tablet_service.cc:1467] Processing CreateTablet for tablet 20f803864ef14f12a5ba3bafa3a3b0c3 (DEFAULT_TABLE table=rebalance_test_table_6 [id=3b1319b666dc429cb0d33c9c55b7266e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:48.732321 17306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a386a1fd8ae4d70ae482b3ce958825b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:48.732977 17305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20f803864ef14f12a5ba3bafa3a3b0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:48.733552 17304 tablet_service.cc:1467] Processing CreateTablet for tablet adf06dd039c4433890e31c1ad9b44e98 (DEFAULT_TABLE table=rebalance_test_table_6 [id=3b1319b666dc429cb0d33c9c55b7266e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:48.733842 17304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adf06dd039c4433890e31c1ad9b44e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:48.734283 18223 tablet_bootstrap.cc:492] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:48.734987 18223 tablet_bootstrap.cc:654] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:48.735129 18221 tablet_bootstrap.cc:492] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:48.735211 18221 ts_tablet_manager.cc:1367] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20240502 01:58:48.735687 18221 raft_consensus.cc:348] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.735803 18221 raft_consensus.cc:374] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:48.735844 18221 raft_consensus.cc:729] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:48.735960 18221 consensus_queue.cc:260] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.736052 18223 tablet_bootstrap.cc:492] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:48.736133 18223 ts_tablet_manager.cc:1367] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:48.736248 18221 ts_tablet_manager.cc:1398] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:48.736426 18221 tablet_bootstrap.cc:492] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:48.736536 18223 raft_consensus.cc:348] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.736639 18223 raft_consensus.cc:374] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:48.736675 18223 raft_consensus.cc:729] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:48.736794 18223 consensus_queue.cc:260] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.737010 18223 ts_tablet_manager.cc:1398] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:48.737250 18221 tablet_bootstrap.cc:654] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:48.740324 18221 tablet_bootstrap.cc:492] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:48.740404 18221 ts_tablet_manager.cc:1367] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240502 01:58:48.740747 18221 raft_consensus.cc:348] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.740836 18221 raft_consensus.cc:374] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:48.740869 18221 raft_consensus.cc:729] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:48.740988 18221 consensus_queue.cc:260] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.741231 18221 ts_tablet_manager.cc:1398] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:48.752192 18336 tablet_bootstrap.cc:492] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:48.752545 18337 tablet_bootstrap.cc:492] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:48.753096 18336 tablet_bootstrap.cc:654] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:48.753576 18337 tablet_bootstrap.cc:654] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:48.754323 18336 tablet_bootstrap.cc:492] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:48.754413 18336 ts_tablet_manager.cc:1367] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:48.754623 18337 tablet_bootstrap.cc:492] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:48.754693 18337 ts_tablet_manager.cc:1367] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:48.754767 18336 raft_consensus.cc:348] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.754859 18336 raft_consensus.cc:374] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:48.754901 18336 raft_consensus.cc:729] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:48.755025 18336 consensus_queue.cc:260] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.755061 18337 raft_consensus.cc:348] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.755154 18337 raft_consensus.cc:374] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:48.755183 18337 raft_consensus.cc:729] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:48.755306 18336 ts_tablet_manager.cc:1398] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:48.755324 18337 consensus_queue.cc:260] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.755530 18336 tablet_bootstrap.cc:492] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:48.756043 18337 ts_tablet_manager.cc:1398] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:48.756218 18337 tablet_bootstrap.cc:492] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:48.756397 18336 tablet_bootstrap.cc:654] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:48.757071 18337 tablet_bootstrap.cc:654] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:48.757683 18336 tablet_bootstrap.cc:492] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:48.757769 18336 ts_tablet_manager.cc:1367] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:48.758247 18336 raft_consensus.cc:348] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.758355 18336 raft_consensus.cc:374] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:48.758394 18336 raft_consensus.cc:729] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:48.758498 18336 consensus_queue.cc:260] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.758613 18337 tablet_bootstrap.cc:492] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:48.758697 18337 ts_tablet_manager.cc:1367] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:58:48.758757 18336 ts_tablet_manager.cc:1398] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:48.759025 18336 tablet_bootstrap.cc:492] T 20f803864ef14f12a5ba3bafa3a3b0c3 P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:48.759107 18337 raft_consensus.cc:348] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.759219 18337 raft_consensus.cc:374] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:48.759259 18337 raft_consensus.cc:729] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:48.759388 18337 consensus_queue.cc:260] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.759682 18337 ts_tablet_manager.cc:1398] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:48.759867 18337 tablet_bootstrap.cc:492] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:48.760685 18337 tablet_bootstrap.cc:654] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:48.760933 18336 tablet_bootstrap.cc:654] T 20f803864ef14f12a5ba3bafa3a3b0c3 P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:48.761714 18337 tablet_bootstrap.cc:492] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:48.761806 18337 ts_tablet_manager.cc:1367] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:48.762234 18337 raft_consensus.cc:348] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.762351 18337 raft_consensus.cc:374] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:48.762394 18337 raft_consensus.cc:729] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:48.762503 18337 consensus_queue.cc:260] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.762790 18337 ts_tablet_manager.cc:1398] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:48.763501 18336 tablet_bootstrap.cc:492] T 20f803864ef14f12a5ba3bafa3a3b0c3 P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:48.763592 18336 ts_tablet_manager.cc:1367] T 20f803864ef14f12a5ba3bafa3a3b0c3 P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:58:48.763954 18336 raft_consensus.cc:348] T 20f803864ef14f12a5ba3bafa3a3b0c3 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.764043 18336 raft_consensus.cc:374] T 20f803864ef14f12a5ba3bafa3a3b0c3 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:48.764063 18336 raft_consensus.cc:729] T 20f803864ef14f12a5ba3bafa3a3b0c3 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:48.764163 18336 consensus_queue.cc:260] T 20f803864ef14f12a5ba3bafa3a3b0c3 P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.764452 18336 ts_tablet_manager.cc:1398] T 20f803864ef14f12a5ba3bafa3a3b0c3 P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:48.835208 18330 raft_consensus.cc:482] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:48.835325 18330 raft_consensus.cc:504] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.835656 18330 leader_election.cc:288] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571), ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:48.836170 16922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f803864ef14f12a5ba3bafa3a3b0c3" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc" is_pre_election: true
I20240502 01:58:48.836184 17326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f803864ef14f12a5ba3bafa3a3b0c3" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441" is_pre_election: true
I20240502 01:58:48.836321 16922 raft_consensus.cc:2454] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 0.
I20240502 01:58:48.836321 17326 raft_consensus.cc:2454] T 20f803864ef14f12a5ba3bafa3a3b0c3 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 0.
I20240502 01:58:48.836603 17125 leader_election.cc:302] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1c00c21761540dea7ddae8d0dd26df4, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:48.836771 18330 raft_consensus.cc:2781] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:48.836835 18330 raft_consensus.cc:482] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:48.836881 18330 raft_consensus.cc:3037] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:48.837641 18330 raft_consensus.cc:504] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.837936 18330 leader_election.cc:288] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [CANDIDATE]: Term 1 election: Requested vote from peers 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571), ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:48.838285 16922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f803864ef14f12a5ba3bafa3a3b0c3" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
I20240502 01:58:48.838397 16922 raft_consensus.cc:3037] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:48.838397 17326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20f803864ef14f12a5ba3bafa3a3b0c3" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441"
I20240502 01:58:48.838536 17326 raft_consensus.cc:3037] T 20f803864ef14f12a5ba3bafa3a3b0c3 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:48.839162 16922 raft_consensus.cc:2454] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 1.
I20240502 01:58:48.839311 17326 raft_consensus.cc:2454] T 20f803864ef14f12a5ba3bafa3a3b0c3 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 1.
I20240502 01:58:48.839449 17125 leader_election.cc:302] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:48.839607 18330 raft_consensus.cc:2781] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:48.839706 18330 raft_consensus.cc:686] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Becoming Leader. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Running, Role: LEADER
I20240502 01:58:48.839855 18330 consensus_queue.cc:237] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.841418 16776 catalog_manager.cc:5484] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195). New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:48.845932 18316 raft_consensus.cc:482] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:48.846057 18316 raft_consensus.cc:504] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.846391 18316 leader_election.cc:288] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571), ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:48.846709 16922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a386a1fd8ae4d70ae482b3ce958825b" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc" is_pre_election: true
I20240502 01:58:48.846807 16922 raft_consensus.cc:2454] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:48.846767 17326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a386a1fd8ae4d70ae482b3ce958825b" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441" is_pre_election: true
I20240502 01:58:48.846911 17326 raft_consensus.cc:2454] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:48.847100 16989 leader_election.cc:302] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, 6431e35365644aac943c07c97e370fee; no voters:
I20240502 01:58:48.847266 18316 raft_consensus.cc:2781] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:48.847322 18316 raft_consensus.cc:482] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:48.847369 18316 raft_consensus.cc:3037] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:48.848076 18316 raft_consensus.cc:504] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.848399 18316 leader_election.cc:288] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Requested vote from peers 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571), ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:48.848688 16922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a386a1fd8ae4d70ae482b3ce958825b" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
I20240502 01:58:48.848778 16922 raft_consensus.cc:3037] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:48.848742 17326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a386a1fd8ae4d70ae482b3ce958825b" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441"
I20240502 01:58:48.848882 17326 raft_consensus.cc:3037] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:48.849520 16922 raft_consensus.cc:2454] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:48.849736 17326 raft_consensus.cc:2454] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:48.849823 16989 leader_election.cc:302] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, 6431e35365644aac943c07c97e370fee; no voters:
I20240502 01:58:48.850178 18316 raft_consensus.cc:2781] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:48.850275 18316 raft_consensus.cc:686] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Becoming Leader. State: Replica: 6431e35365644aac943c07c97e370fee, State: Running, Role: LEADER
I20240502 01:58:48.850422 18316 consensus_queue.cc:237] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.852070 16776 catalog_manager.cc:5484] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee reported cstate change: term changed from 0 to 1, leader changed from <none> to 6431e35365644aac943c07c97e370fee (127.10.133.194). New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:48.889729 18088 raft_consensus.cc:482] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:48.889863 18088 raft_consensus.cc:504] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.890293 18088 leader_election.cc:288] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6431e35365644aac943c07c97e370fee (127.10.133.194:37811), ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:48.890702 17058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf06dd039c4433890e31c1ad9b44e98" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee" is_pre_election: true
I20240502 01:58:48.890745 17326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf06dd039c4433890e31c1ad9b44e98" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441" is_pre_election: true
I20240502 01:58:48.890841 17058 raft_consensus.cc:2454] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 0.
I20240502 01:58:48.891007 17326 raft_consensus.cc:2454] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 0.
I20240502 01:58:48.891219 16856 leader_election.cc:302] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, 6431e35365644aac943c07c97e370fee; no voters:
I20240502 01:58:48.891414 18088 raft_consensus.cc:2781] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:48.891472 18088 raft_consensus.cc:482] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:48.891500 18088 raft_consensus.cc:3037] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:48.892427 18088 raft_consensus.cc:504] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.892735 18088 leader_election.cc:288] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 election: Requested vote from peers 6431e35365644aac943c07c97e370fee (127.10.133.194:37811), ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:48.893137 17326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf06dd039c4433890e31c1ad9b44e98" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441"
I20240502 01:58:48.893137 17058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adf06dd039c4433890e31c1ad9b44e98" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee"
I20240502 01:58:48.893253 17058 raft_consensus.cc:3037] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:48.893253 17326 raft_consensus.cc:3037] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:48.894227 17058 raft_consensus.cc:2454] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 1.
I20240502 01:58:48.894227 17326 raft_consensus.cc:2454] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 1.
I20240502 01:58:48.894519 16856 leader_election.cc:302] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:48.894680 18088 raft_consensus.cc:2781] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:48.894876 18088 raft_consensus.cc:686] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Becoming Leader. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Running, Role: LEADER
I20240502 01:58:48.895018 18088 consensus_queue.cc:237] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:48.896708 16776 catalog_manager.cc:5484] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: term changed from 0 to 1, leader changed from <none> to 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193). New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: UNKNOWN } } }
W20240502 01:58:49.026296 18348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:49.026551 18348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:49.029693 18348 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_6'
I20240502 01:58:49.107062 17326 raft_consensus.cc:1261] T 20f803864ef14f12a5ba3bafa3a3b0c3 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:49.107431 16922 raft_consensus.cc:1261] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:49.107574 17933 consensus_queue.cc:1035] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:49.107831 18330 consensus_queue.cc:1035] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:49.112924 16923 raft_consensus.cc:1261] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:49.112924 17324 raft_consensus.cc:1261] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:49.113394 18317 consensus_queue.cc:1035] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:49.113746 18317 consensus_queue.cc:1035] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:49.114241 17324 raft_consensus.cc:1261] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:49.114853 18088 consensus_queue.cc:1035] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:49.118206 17058 raft_consensus.cc:1261] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:49.119047 18088 consensus_queue.cc:1035] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 98.7687 ms
time per row: 0.0493843 ms
I20240502 01:58:49.174597 16776 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40394:
name: "rebalance_test_table_7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 01:58:49.180312 17171 tablet_service.cc:1467] Processing CreateTablet for tablet 47f0db0b9b7744758b9ca7f1e797bdb0 (DEFAULT_TABLE table=rebalance_test_table_7 [id=a8b80745166a46a9a386a8805718513d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:49.180361 16902 tablet_service.cc:1467] Processing CreateTablet for tablet 47f0db0b9b7744758b9ca7f1e797bdb0 (DEFAULT_TABLE table=rebalance_test_table_7 [id=a8b80745166a46a9a386a8805718513d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:49.180488 17037 tablet_service.cc:1467] Processing CreateTablet for tablet 47f0db0b9b7744758b9ca7f1e797bdb0 (DEFAULT_TABLE table=rebalance_test_table_7 [id=a8b80745166a46a9a386a8805718513d]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:49.180646 17171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47f0db0b9b7744758b9ca7f1e797bdb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:49.180663 16902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47f0db0b9b7744758b9ca7f1e797bdb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:49.180742 17037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47f0db0b9b7744758b9ca7f1e797bdb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:49.181229 17039 tablet_service.cc:1467] Processing CreateTablet for tablet 58924c2a9bf5433b86985bbde9d9ec33 (DEFAULT_TABLE table=rebalance_test_table_7 [id=a8b80745166a46a9a386a8805718513d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:49.181432 17039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58924c2a9bf5433b86985bbde9d9ec33. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:49.182956 18223 tablet_bootstrap.cc:492] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:49.183096 18337 tablet_bootstrap.cc:492] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:49.183713 18223 tablet_bootstrap.cc:654] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:49.183907 16902 tablet_service.cc:1467] Processing CreateTablet for tablet cc145366c6244010b42a07e961f9636f (DEFAULT_TABLE table=rebalance_test_table_7 [id=a8b80745166a46a9a386a8805718513d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:49.184049 18337 tablet_bootstrap.cc:654] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:49.184134 16902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc145366c6244010b42a07e961f9636f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:49.184201 17305 tablet_service.cc:1467] Processing CreateTablet for tablet cc145366c6244010b42a07e961f9636f (DEFAULT_TABLE table=rebalance_test_table_7 [id=a8b80745166a46a9a386a8805718513d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:49.184293 18221 tablet_bootstrap.cc:492] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:49.184492 17305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc145366c6244010b42a07e961f9636f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:49.185112 18221 tablet_bootstrap.cc:654] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:49.185866 18337 tablet_bootstrap.cc:492] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:49.185945 18337 ts_tablet_manager.cc:1367] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:49.186722 18336 tablet_bootstrap.cc:492] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:49.186733 18337 raft_consensus.cc:348] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.186853 18337 raft_consensus.cc:374] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:49.186893 18337 raft_consensus.cc:729] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:49.186933 17304 tablet_service.cc:1467] Processing CreateTablet for tablet 58924c2a9bf5433b86985bbde9d9ec33 (DEFAULT_TABLE table=rebalance_test_table_7 [id=a8b80745166a46a9a386a8805718513d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:49.187008 18337 consensus_queue.cc:260] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.187151 17304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58924c2a9bf5433b86985bbde9d9ec33. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:49.187275 18337 ts_tablet_manager.cc:1398] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:49.187454 18337 tablet_bootstrap.cc:492] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:49.187616 18336 tablet_bootstrap.cc:654] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:49.188329 18337 tablet_bootstrap.cc:654] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:49.188742 18336 tablet_bootstrap.cc:492] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:49.188829 18336 ts_tablet_manager.cc:1367] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:49.189275 18336 raft_consensus.cc:348] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:49.189391 18336 raft_consensus.cc:374] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:49.189435 18336 raft_consensus.cc:729] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:49.189567 18336 consensus_queue.cc:260] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:49.189860 18336 ts_tablet_manager.cc:1398] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:49.190210 17171 tablet_service.cc:1467] Processing CreateTablet for tablet cc145366c6244010b42a07e961f9636f (DEFAULT_TABLE table=rebalance_test_table_7 [id=a8b80745166a46a9a386a8805718513d]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:49.190301 17170 tablet_service.cc:1467] Processing CreateTablet for tablet 58924c2a9bf5433b86985bbde9d9ec33 (DEFAULT_TABLE table=rebalance_test_table_7 [id=a8b80745166a46a9a386a8805718513d]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:49.190475 17171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc145366c6244010b42a07e961f9636f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:49.191138 17170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58924c2a9bf5433b86985bbde9d9ec33. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:49.193365 18337 tablet_bootstrap.cc:492] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:49.193436 18337 ts_tablet_manager.cc:1367] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240502 01:58:49.193666 18221 tablet_bootstrap.cc:492] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:49.193756 18221 ts_tablet_manager.cc:1367] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20240502 01:58:49.193850 18337 raft_consensus.cc:348] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:49.193953 18337 raft_consensus.cc:374] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:49.194096 18337 raft_consensus.cc:729] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:49.194229 18337 consensus_queue.cc:260] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:49.194242 18221 raft_consensus.cc:348] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.194350 18221 raft_consensus.cc:374] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:49.194382 18221 raft_consensus.cc:729] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:49.194525 18337 ts_tablet_manager.cc:1398] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:49.194495 18221 consensus_queue.cc:260] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.194748 18221 ts_tablet_manager.cc:1398] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:49.194950 18221 tablet_bootstrap.cc:492] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:49.195806 18221 tablet_bootstrap.cc:654] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:49.197139 18223 tablet_bootstrap.cc:492] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:49.197227 18223 ts_tablet_manager.cc:1367] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20240502 01:58:49.197650 18223 raft_consensus.cc:348] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.197751 18223 raft_consensus.cc:374] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:49.197788 18223 raft_consensus.cc:729] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:49.197903 18223 consensus_queue.cc:260] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.198205 18223 ts_tablet_manager.cc:1398] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:49.198388 18223 tablet_bootstrap.cc:492] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:49.198535 18221 tablet_bootstrap.cc:492] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:49.198642 18221 ts_tablet_manager.cc:1367] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:58:49.199086 18221 raft_consensus.cc:348] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.199195 18221 raft_consensus.cc:374] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:49.199237 18221 raft_consensus.cc:729] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:49.199282 18223 tablet_bootstrap.cc:654] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:49.199375 18221 consensus_queue.cc:260] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.199662 18221 ts_tablet_manager.cc:1398] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:49.199929 18336 tablet_bootstrap.cc:492] T 58924c2a9bf5433b86985bbde9d9ec33 P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:49.200928 18336 tablet_bootstrap.cc:654] T 58924c2a9bf5433b86985bbde9d9ec33 P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:49.202589 18336 tablet_bootstrap.cc:492] T 58924c2a9bf5433b86985bbde9d9ec33 P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:49.202677 18336 ts_tablet_manager.cc:1367] T 58924c2a9bf5433b86985bbde9d9ec33 P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:58:49.203167 18336 raft_consensus.cc:348] T 58924c2a9bf5433b86985bbde9d9ec33 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.203279 18336 raft_consensus.cc:374] T 58924c2a9bf5433b86985bbde9d9ec33 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:49.203310 18336 raft_consensus.cc:729] T 58924c2a9bf5433b86985bbde9d9ec33 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:49.203421 18336 consensus_queue.cc:260] T 58924c2a9bf5433b86985bbde9d9ec33 P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.203701 18336 ts_tablet_manager.cc:1398] T 58924c2a9bf5433b86985bbde9d9ec33 P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:49.204002 18223 tablet_bootstrap.cc:492] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:49.204072 18223 ts_tablet_manager.cc:1367] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240502 01:58:49.204455 18223 raft_consensus.cc:348] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:49.204526 18223 raft_consensus.cc:374] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:49.204545 18223 raft_consensus.cc:729] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:49.204634 18223 consensus_queue.cc:260] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:49.204839 18223 ts_tablet_manager.cc:1398] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:49.204982 18223 tablet_bootstrap.cc:492] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:49.205819 18223 tablet_bootstrap.cc:654] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:49.207453 18223 tablet_bootstrap.cc:492] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:49.207535 18223 ts_tablet_manager.cc:1367] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:58:49.207921 18223 raft_consensus.cc:348] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.208000 18223 raft_consensus.cc:374] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:49.208020 18223 raft_consensus.cc:729] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:49.208124 18223 consensus_queue.cc:260] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.208365 18223 ts_tablet_manager.cc:1398] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:49.208601 18316 raft_consensus.cc:482] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:49.208673 18316 raft_consensus.cc:504] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.209017 18316 leader_election.cc:288] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:49.209278 17324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58924c2a9bf5433b86985bbde9d9ec33" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441" is_pre_election: true
I20240502 01:58:49.209339 17193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58924c2a9bf5433b86985bbde9d9ec33" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4" is_pre_election: true
I20240502 01:58:49.209406 17324 raft_consensus.cc:2454] T 58924c2a9bf5433b86985bbde9d9ec33 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:49.209468 17193 raft_consensus.cc:2454] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:49.209688 16989 leader_election.cc:302] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:49.209851 18316 raft_consensus.cc:2781] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:49.209915 18316 raft_consensus.cc:482] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:49.209969 18316 raft_consensus.cc:3037] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:49.210881 18316 raft_consensus.cc:504] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.211230 18316 leader_election.cc:288] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Requested vote from peers ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:49.211505 17324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58924c2a9bf5433b86985bbde9d9ec33" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441"
I20240502 01:58:49.211622 17324 raft_consensus.cc:3037] T 58924c2a9bf5433b86985bbde9d9ec33 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:49.211645 17193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58924c2a9bf5433b86985bbde9d9ec33" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:58:49.211743 17193 raft_consensus.cc:3037] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:49.212306 17324 raft_consensus.cc:2454] T 58924c2a9bf5433b86985bbde9d9ec33 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:49.212466 17193 raft_consensus.cc:2454] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:49.212551 16989 leader_election.cc:302] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:49.212849 18316 raft_consensus.cc:2781] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:49.212942 18316 raft_consensus.cc:686] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Becoming Leader. State: Replica: 6431e35365644aac943c07c97e370fee, State: Running, Role: LEADER
I20240502 01:58:49.213069 18316 consensus_queue.cc:237] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.219046 16771 catalog_manager.cc:5484] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee reported cstate change: term changed from 0 to 1, leader changed from <none> to 6431e35365644aac943c07c97e370fee (127.10.133.194). New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } }
I20240502 01:58:49.255275 18389 raft_consensus.cc:482] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:49.255401 18389 raft_consensus.cc:504] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:49.255843 18389 leader_election.cc:288] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923), ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:49.256211 17324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc145366c6244010b42a07e961f9636f" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441" is_pre_election: true
I20240502 01:58:49.256215 17193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc145366c6244010b42a07e961f9636f" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4" is_pre_election: true
I20240502 01:58:49.256338 17324 raft_consensus.cc:2454] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 0.
I20240502 01:58:49.256352 17193 raft_consensus.cc:2454] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 0.
I20240502 01:58:49.256665 16856 leader_election.cc:302] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:49.256875 18389 raft_consensus.cc:2781] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:49.256945 18389 raft_consensus.cc:482] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:49.256996 18389 raft_consensus.cc:3037] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:49.257848 18389 raft_consensus.cc:504] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:49.258189 18389 leader_election.cc:288] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 election: Requested vote from peers a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923), ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:49.258478 17193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc145366c6244010b42a07e961f9636f" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:58:49.258497 17324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc145366c6244010b42a07e961f9636f" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441"
I20240502 01:58:49.258592 17193 raft_consensus.cc:3037] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:49.258596 17324 raft_consensus.cc:3037] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:49.259266 17193 raft_consensus.cc:2454] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 1.
I20240502 01:58:49.259335 17324 raft_consensus.cc:2454] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 1.
I20240502 01:58:49.259536 16857 leader_election.cc:302] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:49.259727 18389 raft_consensus.cc:2781] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:49.259804 18389 raft_consensus.cc:686] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Becoming Leader. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Running, Role: LEADER
I20240502 01:58:49.259965 18389 consensus_queue.cc:237] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:49.261943 16771 catalog_manager.cc:5484] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: term changed from 0 to 1, leader changed from <none> to 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193). New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } }
I20240502 01:58:49.406883 17933 raft_consensus.cc:482] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:49.407027 17933 raft_consensus.cc:504] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.407505 17933 leader_election.cc:288] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571), 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:49.407972 16922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47f0db0b9b7744758b9ca7f1e797bdb0" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc" is_pre_election: true
I20240502 01:58:49.408123 16922 raft_consensus.cc:2454] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 0.
I20240502 01:58:49.408450 17125 leader_election.cc:302] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:49.408658 17933 raft_consensus.cc:2781] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:49.408713 17933 raft_consensus.cc:482] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:49.408740 17933 raft_consensus.cc:3037] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:49.409742 17933 raft_consensus.cc:504] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.410140 17933 leader_election.cc:288] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [CANDIDATE]: Term 1 election: Requested vote from peers 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571), 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:49.410507 16922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47f0db0b9b7744758b9ca7f1e797bdb0" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
I20240502 01:58:49.410622 16922 raft_consensus.cc:3037] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:49.411518 16922 raft_consensus.cc:2454] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 1.
I20240502 01:58:49.411728 17058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47f0db0b9b7744758b9ca7f1e797bdb0" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee" is_pre_election: true
I20240502 01:58:49.411734 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47f0db0b9b7744758b9ca7f1e797bdb0" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee"
I20240502 01:58:49.411815 17125 leader_election.cc:302] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:49.411890 17058 raft_consensus.cc:2454] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 0.
I20240502 01:58:49.411972 17933 raft_consensus.cc:2781] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:49.412062 17933 raft_consensus.cc:686] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Becoming Leader. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Running, Role: LEADER
I20240502 01:58:49.412195 17933 consensus_queue.cc:237] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.413937 16771 catalog_manager.cc:5484] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195). New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: UNKNOWN } } }
W20240502 01:58:49.541210 18404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:49.541457 18404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:49.544514 18404 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_7'
I20240502 01:58:49.631757 16922 raft_consensus.cc:1261] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:49.632261 17059 raft_consensus.cc:3037] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:49.632521 17933 consensus_queue.cc:1035] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:49.633404 17059 raft_consensus.cc:1261] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:49.634110 17324 raft_consensus.cc:1261] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:49.634363 17191 raft_consensus.cc:1261] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:49.634732 17324 raft_consensus.cc:1261] T 58924c2a9bf5433b86985bbde9d9ec33 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:49.634860 18389 consensus_queue.cc:1035] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:49.635038 18088 consensus_queue.cc:1035] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:49.635129 18285 consensus_queue.cc:1035] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:49.636463 18330 consensus_queue.cc:1035] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:49.636786 17193 raft_consensus.cc:1261] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:49.643589 18285 consensus_queue.cc:1035] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 126.884 ms
time per row: 0.0634421 ms
I20240502 01:58:49.711553 16780 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40394:
name: "rebalance_test_table_8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 01:58:49.716753 16902 tablet_service.cc:1467] Processing CreateTablet for tablet 2aeb35a29ea645288fe123b890452936 (DEFAULT_TABLE table=rebalance_test_table_8 [id=cd393e2f31fe436b87329907984e9dcd]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:49.717113 16902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2aeb35a29ea645288fe123b890452936. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:49.717229 17304 tablet_service.cc:1467] Processing CreateTablet for tablet 64b3111c603247ac8ff4a1eb9369086f (DEFAULT_TABLE table=rebalance_test_table_8 [id=cd393e2f31fe436b87329907984e9dcd]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:49.717433 17039 tablet_service.cc:1467] Processing CreateTablet for tablet 2aeb35a29ea645288fe123b890452936 (DEFAULT_TABLE table=rebalance_test_table_8 [id=cd393e2f31fe436b87329907984e9dcd]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:49.717516 17304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64b3111c603247ac8ff4a1eb9369086f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:49.717689 17039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2aeb35a29ea645288fe123b890452936. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:49.717793 16903 tablet_service.cc:1467] Processing CreateTablet for tablet c7f53fd60e7541f98c0e20f259a86b45 (DEFAULT_TABLE table=rebalance_test_table_8 [id=cd393e2f31fe436b87329907984e9dcd]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:49.718063 16903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7f53fd60e7541f98c0e20f259a86b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:49.718209 16901 tablet_service.cc:1467] Processing CreateTablet for tablet 64b3111c603247ac8ff4a1eb9369086f (DEFAULT_TABLE table=rebalance_test_table_8 [id=cd393e2f31fe436b87329907984e9dcd]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:49.718416 16901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64b3111c603247ac8ff4a1eb9369086f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:49.719689 17170 tablet_service.cc:1467] Processing CreateTablet for tablet 2aeb35a29ea645288fe123b890452936 (DEFAULT_TABLE table=rebalance_test_table_8 [id=cd393e2f31fe436b87329907984e9dcd]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:49.719949 17170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2aeb35a29ea645288fe123b890452936. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:49.720016 17037 tablet_service.cc:1467] Processing CreateTablet for tablet 64b3111c603247ac8ff4a1eb9369086f (DEFAULT_TABLE table=rebalance_test_table_8 [id=cd393e2f31fe436b87329907984e9dcd]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:49.720222 17037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64b3111c603247ac8ff4a1eb9369086f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:49.721709 18451 tablet_bootstrap.cc:492] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:49.722177 18452 tablet_bootstrap.cc:492] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:49.722359 17171 tablet_service.cc:1467] Processing CreateTablet for tablet c7f53fd60e7541f98c0e20f259a86b45 (DEFAULT_TABLE table=rebalance_test_table_8 [id=cd393e2f31fe436b87329907984e9dcd]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:49.722605 17171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7f53fd60e7541f98c0e20f259a86b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:49.722609 18451 tablet_bootstrap.cc:654] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:49.722707 18450 tablet_bootstrap.cc:492] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:49.723168 18452 tablet_bootstrap.cc:654] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:49.723526 18450 tablet_bootstrap.cc:654] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:49.723627 18451 tablet_bootstrap.cc:492] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:49.723709 18451 ts_tablet_manager.cc:1367] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:49.724256 18452 tablet_bootstrap.cc:492] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:49.724189 18451 raft_consensus.cc:348] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:49.724308 18451 raft_consensus.cc:374] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:49.724328 18452 ts_tablet_manager.cc:1367] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:49.724344 18451 raft_consensus.cc:729] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:49.724478 18451 consensus_queue.cc:260] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:49.724759 18451 ts_tablet_manager.cc:1398] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:49.724769 18452 raft_consensus.cc:348] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.724867 18452 raft_consensus.cc:374] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:49.724905 18452 raft_consensus.cc:729] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:49.725018 18452 consensus_queue.cc:260] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.725270 18452 ts_tablet_manager.cc:1398] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:49.725435 18452 tablet_bootstrap.cc:492] T c7f53fd60e7541f98c0e20f259a86b45 P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:49.725876 18449 tablet_bootstrap.cc:492] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:49.726150 18452 tablet_bootstrap.cc:654] T c7f53fd60e7541f98c0e20f259a86b45 P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:49.726826 18449 tablet_bootstrap.cc:654] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:49.726980 17304 tablet_service.cc:1467] Processing CreateTablet for tablet c7f53fd60e7541f98c0e20f259a86b45 (DEFAULT_TABLE table=rebalance_test_table_8 [id=cd393e2f31fe436b87329907984e9dcd]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:49.727133 18452 tablet_bootstrap.cc:492] T c7f53fd60e7541f98c0e20f259a86b45 P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:49.727207 18452 ts_tablet_manager.cc:1367] T c7f53fd60e7541f98c0e20f259a86b45 P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:49.727479 17304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7f53fd60e7541f98c0e20f259a86b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:49.727631 18452 raft_consensus.cc:348] T c7f53fd60e7541f98c0e20f259a86b45 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:49.727716 18452 raft_consensus.cc:374] T c7f53fd60e7541f98c0e20f259a86b45 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:49.727779 18452 raft_consensus.cc:729] T c7f53fd60e7541f98c0e20f259a86b45 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:49.727861 18450 tablet_bootstrap.cc:492] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:49.727941 18450 ts_tablet_manager.cc:1367] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20240502 01:58:49.727909 18452 consensus_queue.cc:260] T c7f53fd60e7541f98c0e20f259a86b45 P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:49.728133 18452 ts_tablet_manager.cc:1398] T c7f53fd60e7541f98c0e20f259a86b45 P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:49.728415 18450 raft_consensus.cc:348] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.728529 18450 raft_consensus.cc:374] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:49.728562 18450 raft_consensus.cc:729] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:49.728721 18450 consensus_queue.cc:260] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.729000 18450 ts_tablet_manager.cc:1398] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:49.729185 18450 tablet_bootstrap.cc:492] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:49.730103 18451 tablet_bootstrap.cc:492] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:49.730494 18450 tablet_bootstrap.cc:654] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:49.730968 18451 tablet_bootstrap.cc:654] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:49.731427 18450 tablet_bootstrap.cc:492] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:49.731524 18450 ts_tablet_manager.cc:1367] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240502 01:58:49.731943 18450 raft_consensus.cc:348] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:49.732267 18451 tablet_bootstrap.cc:492] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:49.732345 18451 ts_tablet_manager.cc:1367] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:49.732518 18449 tablet_bootstrap.cc:492] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:49.732609 18449 ts_tablet_manager.cc:1367] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240502 01:58:49.732789 18451 raft_consensus.cc:348] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:49.732889 18451 raft_consensus.cc:374] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:49.732921 18451 raft_consensus.cc:729] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:49.733036 18451 consensus_queue.cc:260] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:49.733017 18449 raft_consensus.cc:348] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.733107 18449 raft_consensus.cc:374] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:49.733160 18449 raft_consensus.cc:729] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:49.733299 18451 ts_tablet_manager.cc:1398] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:49.733273 18449 consensus_queue.cc:260] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.733556 18449 ts_tablet_manager.cc:1398] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:49.733747 18449 tablet_bootstrap.cc:492] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:49.734808 18449 tablet_bootstrap.cc:654] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:49.735361 18450 raft_consensus.cc:374] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:49.735460 18450 raft_consensus.cc:729] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:49.736110 18449 tablet_bootstrap.cc:492] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:49.736233 18449 ts_tablet_manager.cc:1367] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:49.736879 18449 raft_consensus.cc:348] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:49.736963 18449 raft_consensus.cc:374] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:49.736995 18449 raft_consensus.cc:729] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:49.737114 18449 consensus_queue.cc:260] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:49.737350 18449 ts_tablet_manager.cc:1398] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:49.737545 18449 tablet_bootstrap.cc:492] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:49.738401 18449 tablet_bootstrap.cc:654] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:49.739035 18450 consensus_queue.cc:260] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:49.739573 18449 tablet_bootstrap.cc:492] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:49.739647 18449 ts_tablet_manager.cc:1367] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:49.739980 18449 raft_consensus.cc:348] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:49.740072 18449 raft_consensus.cc:374] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:49.740110 18449 raft_consensus.cc:729] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:49.740212 18449 consensus_queue.cc:260] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:49.740476 18449 ts_tablet_manager.cc:1398] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:49.740798 18450 ts_tablet_manager.cc:1398] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.009s user 0.000s sys 0.001s
I20240502 01:58:49.765815 18156 raft_consensus.cc:482] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:49.765921 18156 raft_consensus.cc:504] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:49.766320 18156 leader_election.cc:288] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6431e35365644aac943c07c97e370fee (127.10.133.194:37811), 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:49.766652 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64b3111c603247ac8ff4a1eb9369086f" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee" is_pre_election: true
I20240502 01:58:49.766685 16922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64b3111c603247ac8ff4a1eb9369086f" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc" is_pre_election: true
I20240502 01:58:49.766801 17059 raft_consensus.cc:2454] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 0.
I20240502 01:58:49.766819 16922 raft_consensus.cc:2454] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 0.
I20240502 01:58:49.767097 17258 leader_election.cc:302] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:49.767262 18156 raft_consensus.cc:2781] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:49.767315 18156 raft_consensus.cc:482] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:49.767364 18156 raft_consensus.cc:3037] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:49.768128 18156 raft_consensus.cc:504] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:49.768431 18156 leader_election.cc:288] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 election: Requested vote from peers 6431e35365644aac943c07c97e370fee (127.10.133.194:37811), 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:49.768739 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64b3111c603247ac8ff4a1eb9369086f" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee"
I20240502 01:58:49.768764 16922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64b3111c603247ac8ff4a1eb9369086f" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
I20240502 01:58:49.768848 17059 raft_consensus.cc:3037] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:49.768872 16922 raft_consensus.cc:3037] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:49.769583 17059 raft_consensus.cc:2454] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 1.
I20240502 01:58:49.769667 16922 raft_consensus.cc:2454] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 1.
I20240502 01:58:49.769881 17258 leader_election.cc:302] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:49.770059 18156 raft_consensus.cc:2781] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:49.770246 18156 raft_consensus.cc:686] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Becoming Leader. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Running, Role: LEADER
I20240502 01:58:49.770388 18156 consensus_queue.cc:237] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } }
I20240502 01:58:49.771919 16772 catalog_manager.cc:5484] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec11d4bb3a064a94a80084142637b441 (127.10.133.196). New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:49.903226 18389 raft_consensus.cc:482] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:49.903371 18389 raft_consensus.cc:504] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.903867 18389 leader_election.cc:288] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923), 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:49.904258 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2aeb35a29ea645288fe123b890452936" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee" is_pre_election: true
I20240502 01:58:49.904261 17191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2aeb35a29ea645288fe123b890452936" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4" is_pre_election: true
I20240502 01:58:49.904392 17059 raft_consensus.cc:2454] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 0.
I20240502 01:58:49.904408 17191 raft_consensus.cc:2454] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 0.
I20240502 01:58:49.904672 16856 leader_election.cc:302] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, 6431e35365644aac943c07c97e370fee; no voters:
I20240502 01:58:49.904839 18389 raft_consensus.cc:2781] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:49.904901 18389 raft_consensus.cc:482] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:49.904947 18389 raft_consensus.cc:3037] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:49.905747 18389 raft_consensus.cc:504] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.906134 18389 leader_election.cc:288] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 election: Requested vote from peers a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923), 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:49.906437 17191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2aeb35a29ea645288fe123b890452936" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:58:49.906458 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2aeb35a29ea645288fe123b890452936" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee"
I20240502 01:58:49.906561 17059 raft_consensus.cc:3037] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:49.906574 17191 raft_consensus.cc:3037] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:49.907480 17191 raft_consensus.cc:2454] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 1.
I20240502 01:58:49.907483 17059 raft_consensus.cc:2454] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 1.
I20240502 01:58:49.907783 16857 leader_election.cc:302] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:49.907966 18389 raft_consensus.cc:2781] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:49.908051 18389 raft_consensus.cc:686] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Becoming Leader. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Running, Role: LEADER
I20240502 01:58:49.908218 18389 consensus_queue.cc:237] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } }
I20240502 01:58:49.908443 18346 raft_consensus.cc:482] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:49.908524 18346 raft_consensus.cc:504] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:49.908843 18346 leader_election.cc:288] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:49.909209 17324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7f53fd60e7541f98c0e20f259a86b45" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441" is_pre_election: true
I20240502 01:58:49.909373 17324 raft_consensus.cc:2454] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 0.
I20240502 01:58:49.909452 17191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7f53fd60e7541f98c0e20f259a86b45" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4" is_pre_election: true
I20240502 01:58:49.909574 17191 raft_consensus.cc:2454] T c7f53fd60e7541f98c0e20f259a86b45 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 0.
I20240502 01:58:49.909812 16857 leader_election.cc:302] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:49.909969 18389 raft_consensus.cc:2781] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:49.910038 18389 raft_consensus.cc:482] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:49.910072 18389 raft_consensus.cc:3037] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:49.910485 16772 catalog_manager.cc:5484] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: term changed from 0 to 1, leader changed from <none> to 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193). New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:49.910678 18389 raft_consensus.cc:504] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:49.911039 18389 leader_election.cc:288] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 election: Requested vote from peers ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:49.911239 17324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7f53fd60e7541f98c0e20f259a86b45" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441"
I20240502 01:58:49.911329 17324 raft_consensus.cc:3037] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:49.911806 17191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7f53fd60e7541f98c0e20f259a86b45" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:58:49.911916 17191 raft_consensus.cc:3037] T c7f53fd60e7541f98c0e20f259a86b45 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:49.912217 17324 raft_consensus.cc:2454] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 1.
I20240502 01:58:49.912499 16856 leader_election.cc:302] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:49.912817 17191 raft_consensus.cc:2454] T c7f53fd60e7541f98c0e20f259a86b45 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 1.
I20240502 01:58:49.913547 18389 raft_consensus.cc:2781] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:49.913633 18389 raft_consensus.cc:686] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Becoming Leader. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Running, Role: LEADER
I20240502 01:58:49.913750 18389 consensus_queue.cc:237] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:49.915343 16772 catalog_manager.cc:5484] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: term changed from 0 to 1, leader changed from <none> to 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193). New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } }
W20240502 01:58:50.068907 18466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:50.069139 18466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:50.072438 18466 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_8'
I20240502 01:58:50.159185 17059 raft_consensus.cc:1261] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:50.159672 16922 raft_consensus.cc:1261] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:50.159639 18156 consensus_queue.cc:1035] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:50.160285 18156 consensus_queue.cc:1035] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:50.160739 17191 raft_consensus.cc:1261] T c7f53fd60e7541f98c0e20f259a86b45 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:50.161180 18346 consensus_queue.cc:1035] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:50.161957 17058 raft_consensus.cc:1261] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:50.163331 18346 consensus_queue.cc:1035] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:50.163811 17324 raft_consensus.cc:1261] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:50.164487 18389 consensus_queue.cc:1035] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:50.165453 17193 raft_consensus.cc:1261] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:50.165870 18389 consensus_queue.cc:1035] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 111.749 ms
time per row: 0.0558746 ms
I20240502 01:58:50.229494 16779 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40394:
name: "rebalance_test_table_9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 01:58:50.235116 17171 tablet_service.cc:1467] Processing CreateTablet for tablet d9de883c491f43378a26c5a370062555 (DEFAULT_TABLE table=rebalance_test_table_9 [id=dbf980acd7c44315a784f2bc19c4a4a1]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:50.235392 17171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9de883c491f43378a26c5a370062555. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:50.236274 17037 tablet_service.cc:1467] Processing CreateTablet for tablet d9de883c491f43378a26c5a370062555 (DEFAULT_TABLE table=rebalance_test_table_9 [id=dbf980acd7c44315a784f2bc19c4a4a1]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:50.236476 16901 tablet_service.cc:1467] Processing CreateTablet for tablet cd6925b06dd64a028757d8527f896d10 (DEFAULT_TABLE table=rebalance_test_table_9 [id=dbf980acd7c44315a784f2bc19c4a4a1]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:50.236538 17037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9de883c491f43378a26c5a370062555. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:50.236760 16901 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd6925b06dd64a028757d8527f896d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:50.237808 17038 tablet_service.cc:1467] Processing CreateTablet for tablet cd6925b06dd64a028757d8527f896d10 (DEFAULT_TABLE table=rebalance_test_table_9 [id=dbf980acd7c44315a784f2bc19c4a4a1]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:50.238109 17038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd6925b06dd64a028757d8527f896d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:50.238679 17170 tablet_service.cc:1467] Processing CreateTablet for tablet cd6925b06dd64a028757d8527f896d10 (DEFAULT_TABLE table=rebalance_test_table_9 [id=dbf980acd7c44315a784f2bc19c4a4a1]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:50.238919 17170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd6925b06dd64a028757d8527f896d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:50.238888 17039 tablet_service.cc:1467] Processing CreateTablet for tablet 56450521850a4afbbee4587c351b9ca1 (DEFAULT_TABLE table=rebalance_test_table_9 [id=dbf980acd7c44315a784f2bc19c4a4a1]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:50.239089 17039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56450521850a4afbbee4587c351b9ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:50.239091 18449 tablet_bootstrap.cc:492] T cd6925b06dd64a028757d8527f896d10 P 191fe00ca08b44c9aef6646e86aecebc: Bootstrap starting.
I20240502 01:58:50.240024 18449 tablet_bootstrap.cc:654] T cd6925b06dd64a028757d8527f896d10 P 191fe00ca08b44c9aef6646e86aecebc: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:50.240152 17171 tablet_service.cc:1467] Processing CreateTablet for tablet 56450521850a4afbbee4587c351b9ca1 (DEFAULT_TABLE table=rebalance_test_table_9 [id=dbf980acd7c44315a784f2bc19c4a4a1]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:50.240373 17171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56450521850a4afbbee4587c351b9ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:50.240917 18450 tablet_bootstrap.cc:492] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:50.241780 18450 tablet_bootstrap.cc:654] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:50.242451 18449 tablet_bootstrap.cc:492] T cd6925b06dd64a028757d8527f896d10 P 191fe00ca08b44c9aef6646e86aecebc: No bootstrap required, opened a new log
I20240502 01:58:50.242542 18449 ts_tablet_manager.cc:1367] T cd6925b06dd64a028757d8527f896d10 P 191fe00ca08b44c9aef6646e86aecebc: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:58:50.242779 18512 tablet_bootstrap.cc:492] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:50.242796 17304 tablet_service.cc:1467] Processing CreateTablet for tablet d9de883c491f43378a26c5a370062555 (DEFAULT_TABLE table=rebalance_test_table_9 [id=dbf980acd7c44315a784f2bc19c4a4a1]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:50.242837 17305 tablet_service.cc:1467] Processing CreateTablet for tablet 56450521850a4afbbee4587c351b9ca1 (DEFAULT_TABLE table=rebalance_test_table_9 [id=dbf980acd7c44315a784f2bc19c4a4a1]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:58:50.242962 18449 raft_consensus.cc:348] T cd6925b06dd64a028757d8527f896d10 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:50.243074 18449 raft_consensus.cc:374] T cd6925b06dd64a028757d8527f896d10 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:50.243089 17304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9de883c491f43378a26c5a370062555. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:50.243119 18449 raft_consensus.cc:729] T cd6925b06dd64a028757d8527f896d10 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Initialized, Role: FOLLOWER
I20240502 01:58:50.243263 17305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56450521850a4afbbee4587c351b9ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:50.243228 18449 consensus_queue.cc:260] T cd6925b06dd64a028757d8527f896d10 P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:50.243518 18449 ts_tablet_manager.cc:1398] T cd6925b06dd64a028757d8527f896d10 P 191fe00ca08b44c9aef6646e86aecebc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:50.244271 18512 tablet_bootstrap.cc:654] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:50.245276 18515 tablet_bootstrap.cc:492] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:50.246492 18512 tablet_bootstrap.cc:492] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:50.246600 18450 tablet_bootstrap.cc:492] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:50.246624 18512 ts_tablet_manager.cc:1367] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240502 01:58:50.246680 18450 ts_tablet_manager.cc:1367] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20240502 01:58:50.247074 18512 raft_consensus.cc:348] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:50.247180 18512 raft_consensus.cc:374] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:50.247123 18450 raft_consensus.cc:348] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:50.247213 18512 raft_consensus.cc:729] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:50.247239 18450 raft_consensus.cc:374] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:50.247268 18450 raft_consensus.cc:729] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:50.247335 18512 consensus_queue.cc:260] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:50.247390 18450 consensus_queue.cc:260] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:50.247687 18450 ts_tablet_manager.cc:1398] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:50.247859 18450 tablet_bootstrap.cc:492] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:50.248096 18512 ts_tablet_manager.cc:1398] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:50.248247 18512 tablet_bootstrap.cc:492] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:50.248380 18515 tablet_bootstrap.cc:654] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:50.248710 18450 tablet_bootstrap.cc:654] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:50.249121 18512 tablet_bootstrap.cc:654] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:50.250207 18450 tablet_bootstrap.cc:492] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:50.250340 18450 ts_tablet_manager.cc:1367] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240502 01:58:50.250555 18512 tablet_bootstrap.cc:492] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:50.250653 18512 ts_tablet_manager.cc:1367] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:50.250931 18450 raft_consensus.cc:348] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:50.251084 18450 raft_consensus.cc:374] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:50.251050 18512 raft_consensus.cc:348] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:50.251138 18512 raft_consensus.cc:374] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:50.251174 18512 raft_consensus.cc:729] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:50.251269 18512 consensus_queue.cc:260] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:50.251535 18512 ts_tablet_manager.cc:1398] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:50.251681 18515 tablet_bootstrap.cc:492] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:50.251683 18512 tablet_bootstrap.cc:492] T 56450521850a4afbbee4587c351b9ca1 P a1c00c21761540dea7ddae8d0dd26df4: Bootstrap starting.
I20240502 01:58:50.251742 18515 ts_tablet_manager.cc:1367] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20240502 01:58:50.251875 18450 raft_consensus.cc:729] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:50.252084 18450 consensus_queue.cc:260] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:50.252174 18515 raft_consensus.cc:348] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:50.252354 18515 raft_consensus.cc:374] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:50.252449 18515 raft_consensus.cc:729] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:50.252533 18512 tablet_bootstrap.cc:654] T 56450521850a4afbbee4587c351b9ca1 P a1c00c21761540dea7ddae8d0dd26df4: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:50.252595 18450 ts_tablet_manager.cc:1398] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:50.252746 18515 consensus_queue.cc:260] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:50.252825 18450 tablet_bootstrap.cc:492] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee: Bootstrap starting.
I20240502 01:58:50.253110 18515 ts_tablet_manager.cc:1398] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:50.253337 18515 tablet_bootstrap.cc:492] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441: Bootstrap starting.
I20240502 01:58:50.254262 18512 tablet_bootstrap.cc:492] T 56450521850a4afbbee4587c351b9ca1 P a1c00c21761540dea7ddae8d0dd26df4: No bootstrap required, opened a new log
I20240502 01:58:50.254348 18512 ts_tablet_manager.cc:1367] T 56450521850a4afbbee4587c351b9ca1 P a1c00c21761540dea7ddae8d0dd26df4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:50.254652 18515 tablet_bootstrap.cc:654] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:50.254789 18512 raft_consensus.cc:348] T 56450521850a4afbbee4587c351b9ca1 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:50.254890 18512 raft_consensus.cc:374] T 56450521850a4afbbee4587c351b9ca1 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:50.254927 18512 raft_consensus.cc:729] T 56450521850a4afbbee4587c351b9ca1 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Initialized, Role: FOLLOWER
I20240502 01:58:50.255057 18512 consensus_queue.cc:260] T 56450521850a4afbbee4587c351b9ca1 P a1c00c21761540dea7ddae8d0dd26df4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:50.255134 18450 tablet_bootstrap.cc:654] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee: Neither blocks nor log segments found. Creating new log.
I20240502 01:58:50.255352 18512 ts_tablet_manager.cc:1398] T 56450521850a4afbbee4587c351b9ca1 P a1c00c21761540dea7ddae8d0dd26df4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:50.256124 18450 tablet_bootstrap.cc:492] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee: No bootstrap required, opened a new log
I20240502 01:58:50.256210 18450 ts_tablet_manager.cc:1367] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:58:50.256590 18450 raft_consensus.cc:348] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:50.256685 18450 raft_consensus.cc:374] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:50.256724 18450 raft_consensus.cc:729] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Initialized, Role: FOLLOWER
I20240502 01:58:50.256842 18450 consensus_queue.cc:260] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:50.257098 18450 ts_tablet_manager.cc:1398] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:50.258416 18515 tablet_bootstrap.cc:492] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441: No bootstrap required, opened a new log
I20240502 01:58:50.258517 18515 ts_tablet_manager.cc:1367] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:58:50.259034 18515 raft_consensus.cc:348] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:50.259181 18515 raft_consensus.cc:374] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:58:50.259230 18515 raft_consensus.cc:729] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Initialized, Role: FOLLOWER
I20240502 01:58:50.259353 18515 consensus_queue.cc:260] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:50.259670 18515 ts_tablet_manager.cc:1398] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:50.296514 18285 raft_consensus.cc:482] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:50.296638 18285 raft_consensus.cc:504] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:50.297066 18285 leader_election.cc:288] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923), ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:50.297297 17193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9de883c491f43378a26c5a370062555" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4" is_pre_election: true
I20240502 01:58:50.297430 17193 raft_consensus.cc:2454] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:50.297408 17325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9de883c491f43378a26c5a370062555" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441" is_pre_election: true
I20240502 01:58:50.297546 17325 raft_consensus.cc:2454] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:50.297710 16990 leader_election.cc:302] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:50.297925 18285 raft_consensus.cc:2781] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:50.298008 18285 raft_consensus.cc:482] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:50.298061 18285 raft_consensus.cc:3037] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:50.298851 18285 raft_consensus.cc:504] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:50.299160 18285 leader_election.cc:288] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Requested vote from peers a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923), ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:50.299443 17193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9de883c491f43378a26c5a370062555" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:58:50.299515 17325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9de883c491f43378a26c5a370062555" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec11d4bb3a064a94a80084142637b441"
I20240502 01:58:50.299547 17193 raft_consensus.cc:3037] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:50.299623 17325 raft_consensus.cc:3037] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:50.300333 17193 raft_consensus.cc:2454] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:50.300469 17325 raft_consensus.cc:2454] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:50.300635 16990 leader_election.cc:302] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:50.300789 18285 raft_consensus.cc:2781] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:50.300865 18285 raft_consensus.cc:686] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Becoming Leader. State: Replica: 6431e35365644aac943c07c97e370fee, State: Running, Role: LEADER
I20240502 01:58:50.301008 18285 consensus_queue.cc:237] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } }
I20240502 01:58:50.302583 16778 catalog_manager.cc:5484] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee reported cstate change: term changed from 0 to 1, leader changed from <none> to 6431e35365644aac943c07c97e370fee (127.10.133.194). New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:50.374115 18156 raft_consensus.cc:482] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:50.374258 18156 raft_consensus.cc:504] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:50.374689 18156 leader_election.cc:288] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6431e35365644aac943c07c97e370fee (127.10.133.194:37811), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:50.375077 17193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56450521850a4afbbee4587c351b9ca1" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4" is_pre_election: true
I20240502 01:58:50.375078 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56450521850a4afbbee4587c351b9ca1" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee" is_pre_election: true
I20240502 01:58:50.375216 17193 raft_consensus.cc:2454] T 56450521850a4afbbee4587c351b9ca1 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 0.
I20240502 01:58:50.375238 17059 raft_consensus.cc:2454] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 0.
I20240502 01:58:50.375605 17259 leader_election.cc:302] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1c00c21761540dea7ddae8d0dd26df4, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:50.375802 18156 raft_consensus.cc:2781] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:50.375873 18156 raft_consensus.cc:482] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:50.375921 18156 raft_consensus.cc:3037] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:50.376827 18156 raft_consensus.cc:504] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:50.377161 18156 leader_election.cc:288] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 election: Requested vote from peers 6431e35365644aac943c07c97e370fee (127.10.133.194:37811), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:50.377519 17193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56450521850a4afbbee4587c351b9ca1" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:58:50.377518 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56450521850a4afbbee4587c351b9ca1" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6431e35365644aac943c07c97e370fee"
I20240502 01:58:50.377625 17193 raft_consensus.cc:3037] T 56450521850a4afbbee4587c351b9ca1 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:50.377632 17059 raft_consensus.cc:3037] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:50.378417 17059 raft_consensus.cc:2454] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 1.
I20240502 01:58:50.378423 17193 raft_consensus.cc:2454] T 56450521850a4afbbee4587c351b9ca1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 1.
I20240502 01:58:50.378661 17259 leader_election.cc:302] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1c00c21761540dea7ddae8d0dd26df4, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:50.378820 18156 raft_consensus.cc:2781] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:50.378909 18156 raft_consensus.cc:686] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Becoming Leader. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Running, Role: LEADER
I20240502 01:58:50.379073 18156 consensus_queue.cc:237] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:50.380923 16778 catalog_manager.cc:5484] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec11d4bb3a064a94a80084142637b441 (127.10.133.196). New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:50.437587 18285 raft_consensus.cc:482] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:58:50.437711 18285 raft_consensus.cc:504] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:50.438131 18285 leader_election.cc:288] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:50.438477 16922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd6925b06dd64a028757d8527f896d10" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc" is_pre_election: true
I20240502 01:58:50.438629 16922 raft_consensus.cc:2454] T cd6925b06dd64a028757d8527f896d10 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:50.438603 17193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd6925b06dd64a028757d8527f896d10" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4" is_pre_election: true
I20240502 01:58:50.438728 17193 raft_consensus.cc:2454] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 0.
I20240502 01:58:50.438935 16989 leader_election.cc:302] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, 6431e35365644aac943c07c97e370fee; no voters:
I20240502 01:58:50.439149 18285 raft_consensus.cc:2781] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:58:50.439208 18285 raft_consensus.cc:482] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:58:50.439257 18285 raft_consensus.cc:3037] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:50.440078 18285 raft_consensus.cc:504] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:50.440397 18285 leader_election.cc:288] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Requested vote from peers 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:50.440719 17193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd6925b06dd64a028757d8527f896d10" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:58:50.440845 17193 raft_consensus.cc:3037] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:50.440934 16922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd6925b06dd64a028757d8527f896d10" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
I20240502 01:58:50.441061 16922 raft_consensus.cc:3037] T cd6925b06dd64a028757d8527f896d10 P 191fe00ca08b44c9aef6646e86aecebc [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:58:50.441643 17193 raft_consensus.cc:2454] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:50.441854 16922 raft_consensus.cc:2454] T cd6925b06dd64a028757d8527f896d10 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 1.
I20240502 01:58:50.441933 16990 leader_election.cc:302] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:58:50.442134 18285 raft_consensus.cc:2781] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:58:50.442224 18285 raft_consensus.cc:686] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Becoming Leader. State: Replica: 6431e35365644aac943c07c97e370fee, State: Running, Role: LEADER
I20240502 01:58:50.442387 18285 consensus_queue.cc:237] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } }
I20240502 01:58:50.444151 16778 catalog_manager.cc:5484] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee reported cstate change: term changed from 0 to 1, leader changed from <none> to 6431e35365644aac943c07c97e370fee (127.10.133.194). New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } }
W20240502 01:58:50.577901 18526 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:50.578148 18526 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:50.581260 18526 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_9'
I20240502 01:58:50.674703 17059 raft_consensus.cc:1261] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:50.674758 17193 raft_consensus.cc:1261] T 56450521850a4afbbee4587c351b9ca1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:50.675165 18156 consensus_queue.cc:1035] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:50.675484 18462 consensus_queue.cc:1035] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:50.675637 17325 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:50.676496 18505 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:50.677314 16923 raft_consensus.cc:1261] T cd6925b06dd64a028757d8527f896d10 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:50.681591 17191 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:50.681908 17192 raft_consensus.cc:1261] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:58:50.682215 18505 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:50.682906 18285 consensus_queue.cc:1035] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:50.683748 18505 consensus_queue.cc:1035] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:58:50.724534 18447 mvcc.cc:205] Tried to move back new op lower bound from 7023063575234789376 to 7023063573713969152. Current Snapshot: MvccSnapshot[applied={T|T < 7023063575234789376}]
INSERT report
rows total: 2000
time total: 130.975 ms
time per row: 0.0654872 ms
I20240502 01:58:50.755369 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.197:45213
--local_ip_for_outbound_sockets=127.10.133.197
--tserver_master_addrs=127.10.133.254:37275
--webserver_port=34457
--webserver_interface=127.10.133.197
--builtin_ntp_servers=127.10.133.212:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
W20240502 01:58:50.863996 18569 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:50.864216 18569 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:50.864281 18569 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:50.867431 18569 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:50.867494 18569 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:50.867597 18569 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.197
I20240502 01:58:50.871253 18569 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.197:45213
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.10.133.197
--webserver_port=34457
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.10.133.254:37275
--never_fsync=true
--heap_profile_path=/tmp/kudu.18569
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.197
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:50.872148 18569 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:50.873675 18569 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:50.883589 18575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:50.884050 18577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:50.884970 18574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:50.885739 18569 server_base.cc:1034] running on GCE node
I20240502 01:58:50.886279 18569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:50.886957 18569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:50.888119 18569 hybrid_clock.cc:648] HybridClock initialized: now 1714615130888062 us; error 73 us; skew 500 ppm
I20240502 01:58:50.890380 18569 webserver.cc:460] Webserver started at http://127.10.133.197:34457/ using document root <none> and password file <none>
I20240502 01:58:50.891129 18569 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:50.891233 18569 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:50.895789 18569 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20240502 01:58:50.898264 18583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:50.899559 18569 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20240502 01:58:50.899735 18569 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "436e7859396c42a6b60714873cb60495"
format_stamp: "Formatted at 2024-05-02 01:58:41 on dist-test-slave-dr9f"
I20240502 01:58:50.900178 18569 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:50.914671 18569 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:50.915297 18569 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:50.915472 18569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:50.915992 18569 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:50.916829 18569 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:50.916879 18569 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:50.916935 18569 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:50.916960 18569 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:50.925262 18569 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.197:45213
I20240502 01:58:50.925277 18698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.197:45213 every 8 connection(s)
I20240502 01:58:50.926306 18569 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20240502 01:58:50.931191 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 18569
I20240502 01:58:50.931720 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.198:45549
--local_ip_for_outbound_sockets=127.10.133.198
--tserver_master_addrs=127.10.133.254:37275
--webserver_port=41611
--webserver_interface=127.10.133.198
--builtin_ntp_servers=127.10.133.212:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 01:58:50.936164 18699 heartbeater.cc:347] Connected to a master server at 127.10.133.254:37275
I20240502 01:58:50.936415 18699 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:50.937114 18699 heartbeater.cc:511] Master 127.10.133.254:37275 requested a full tablet report, sending...
I20240502 01:58:50.938297 16779 ts_manager.cc:194] Re-registered known tserver with Master: 436e7859396c42a6b60714873cb60495 (127.10.133.197:45213)
I20240502 01:58:50.938871 16779 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.197:43577
W20240502 01:58:51.042474 18702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:51.042685 18702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:51.042752 18702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:51.045889 18702 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:51.045948 18702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:51.046080 18702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.198
I20240502 01:58:51.049788 18702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.198:45549
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.10.133.198
--webserver_port=41611
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.10.133.254:37275
--never_fsync=true
--heap_profile_path=/tmp/kudu.18702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.198
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:51.050637 18702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:51.051724 18702 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:51.060218 18707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:51.060703 18708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:51.061540 18710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:51.062315 18702 server_base.cc:1034] running on GCE node
I20240502 01:58:51.062667 18702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:51.063163 18702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:51.064311 18702 hybrid_clock.cc:648] HybridClock initialized: now 1714615131064301 us; error 26 us; skew 500 ppm
I20240502 01:58:51.072131 18702 webserver.cc:460] Webserver started at http://127.10.133.198:41611/ using document root <none> and password file <none>
I20240502 01:58:51.072676 18702 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:51.072754 18702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:51.076431 18702 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20240502 01:58:51.078286 18716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:51.079275 18702 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:51.079385 18702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "d7989bd96de94be4a94995fcfcd6b16b"
format_stamp: "Formatted at 2024-05-02 01:58:41 on dist-test-slave-dr9f"
I20240502 01:58:51.079861 18702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:51.102279 18702 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:51.102802 18702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:51.102926 18702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:51.103374 18702 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:51.104218 18702 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:51.104277 18702 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:51.104334 18702 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:51.104373 18702 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:51.112219 18702 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.198:45549
I20240502 01:58:51.112280 18831 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.198:45549 every 8 connection(s)
I20240502 01:58:51.113175 18702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/info.pb
I20240502 01:58:51.118026 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 18702
I20240502 01:58:51.118499 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.199:34045
--local_ip_for_outbound_sockets=127.10.133.199
--tserver_master_addrs=127.10.133.254:37275
--webserver_port=46497
--webserver_interface=127.10.133.199
--builtin_ntp_servers=127.10.133.212:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 01:58:51.122292 18832 heartbeater.cc:347] Connected to a master server at 127.10.133.254:37275
I20240502 01:58:51.122536 18832 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:51.123260 18832 heartbeater.cc:511] Master 127.10.133.254:37275 requested a full tablet report, sending...
I20240502 01:58:51.124403 16779 ts_manager.cc:194] Re-registered known tserver with Master: d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198:45549)
I20240502 01:58:51.124938 16779 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.198:38385
W20240502 01:58:51.232446 18835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:51.232679 18835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:51.232760 18835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:51.236191 18835 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:51.236264 18835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:51.236357 18835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.199
I20240502 01:58:51.240342 18835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.199:34045
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--webserver_interface=127.10.133.199
--webserver_port=46497
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.10.133.254:37275
--never_fsync=true
--heap_profile_path=/tmp/kudu.18835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.199
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:51.241189 18835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:51.242296 18835 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:51.250752 18840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:51.251516 18843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:51.252256 18841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:51.253132 18835 server_base.cc:1034] running on GCE node
I20240502 01:58:51.253470 18835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:51.254033 18835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:51.256011 18835 hybrid_clock.cc:648] HybridClock initialized: now 1714615131255966 us; error 34 us; skew 500 ppm
I20240502 01:58:51.259038 18835 webserver.cc:460] Webserver started at http://127.10.133.199:46497/ using document root <none> and password file <none>
I20240502 01:58:51.259718 18835 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:51.259855 18835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:51.263476 18835 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20240502 01:58:51.265316 18849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:51.266316 18835 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:51.266422 18835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
uuid: "b7ec79239ce64b38a1d55f66a95407c0"
format_stamp: "Formatted at 2024-05-02 01:58:41 on dist-test-slave-dr9f"
I20240502 01:58:51.266829 18835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:51.286891 18835 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:51.287456 18835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:51.287597 18835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:51.288105 18835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:51.288949 18835 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:51.288996 18835 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:51.289057 18835 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:51.289083 18835 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:51.297904 18835 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.199:34045
I20240502 01:58:51.297921 18964 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.199:34045 every 8 connection(s)
I20240502 01:58:51.298946 18835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/info.pb
I20240502 01:58:51.304634 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 18835
I20240502 01:58:51.305179 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.200:46021
--local_ip_for_outbound_sockets=127.10.133.200
--tserver_master_addrs=127.10.133.254:37275
--webserver_port=37847
--webserver_interface=127.10.133.200
--builtin_ntp_servers=127.10.133.212:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 01:58:51.307747 18965 heartbeater.cc:347] Connected to a master server at 127.10.133.254:37275
I20240502 01:58:51.307941 18965 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:51.308401 18965 heartbeater.cc:511] Master 127.10.133.254:37275 requested a full tablet report, sending...
I20240502 01:58:51.309389 16779 ts_manager.cc:194] Re-registered known tserver with Master: b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199:34045)
I20240502 01:58:51.309935 16779 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.199:38547
W20240502 01:58:51.415915 18968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:51.416170 18968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:51.416245 18968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:51.419291 18968 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:51.419360 18968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:51.419467 18968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.200
I20240502 01:58:51.423074 18968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.200:46021
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--webserver_interface=127.10.133.200
--webserver_port=37847
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.10.133.254:37275
--never_fsync=true
--heap_profile_path=/tmp/kudu.18968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.200
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:51.424005 18968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:51.425187 18968 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:51.434046 18973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:51.434557 18974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:51.435441 18976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:51.436259 18968 server_base.cc:1034] running on GCE node
I20240502 01:58:51.436666 18968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:51.437316 18968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:51.438481 18968 hybrid_clock.cc:648] HybridClock initialized: now 1714615131438455 us; error 39 us; skew 500 ppm
I20240502 01:58:51.440317 18968 webserver.cc:460] Webserver started at http://127.10.133.200:37847/ using document root <none> and password file <none>
I20240502 01:58:51.440886 18968 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:51.440964 18968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:51.444134 18968 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:51.446180 18982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:51.447150 18968 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:51.447247 18968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
uuid: "b6aa9ef40e50468ca7a9742c21140d24"
format_stamp: "Formatted at 2024-05-02 01:58:41 on dist-test-slave-dr9f"
I20240502 01:58:51.447647 18968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:51.467496 18968 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:51.468016 18968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:51.468158 18968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:51.468653 18968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:51.469491 18968 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:51.469542 18968 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:51.469607 18968 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:51.469631 18968 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:51.477713 18968 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.200:46021
I20240502 01:58:51.477767 19096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.200:46021 every 8 connection(s)
I20240502 01:58:51.478729 18968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/info.pb
I20240502 01:58:51.481343 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 18968
I20240502 01:58:51.488041 19097 heartbeater.cc:347] Connected to a master server at 127.10.133.254:37275
I20240502 01:58:51.488229 19097 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:51.488713 19097 heartbeater.cc:511] Master 127.10.133.254:37275 requested a full tablet report, sending...
I20240502 01:58:51.489661 16779 ts_manager.cc:194] Re-registered known tserver with Master: b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200:46021)
I20240502 01:58:51.490242 16779 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.200:56637
W20240502 01:58:51.594555 19101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:51.594812 19101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:51.598232 19101 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20240502 01:58:51.726233 18632 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:51.732856 17171 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:58:51.747141 16901 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:51.747524 16901 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:51.753484 19030 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:51.757187 18632 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:51.757803 17171 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:58:51.758338 17039 tablet_service.cc:1429] Tablet server has 11 leaders and 0 scanners
I20240502 01:58:51.777977 19030 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:51.779227 18898 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:51.791182 18898 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:51.799806 17039 tablet_service.cc:1429] Tablet server has 11 leaders and 0 scanners
I20240502 01:58:51.801059 18765 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:51.819402 17304 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:58:51.821934 18765 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:51.831128 17304 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:58:51.941236 18699 heartbeater.cc:503] Master 127.10.133.254:37275 was elected leader, sending a full tablet report...
I20240502 01:58:51.952240 18632 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:51.960757 19030 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:51.963939 16901 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:51.969218 18765 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:51.971716 18898 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:51.975611 17171 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:58:51.977978 17304 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:58:52.001946 17039 tablet_service.cc:1429] Tablet server has 11 leaders and 0 scanners
W20240502 01:58:52.052193 19220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:52.052410 19220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:52.055783 19220 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20240502 01:58:52.117254 18632 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:52.119858 17039 tablet_service.cc:1429] Tablet server has 11 leaders and 0 scanners
I20240502 01:58:52.122051 17171 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:58:52.124574 16901 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:52.127255 18832 heartbeater.cc:503] Master 127.10.133.254:37275 was elected leader, sending a full tablet report...
I20240502 01:58:52.135835 18765 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:52.144091 18898 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:52.146688 19030 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:52.155653 17304 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:58:52.208547 17193 consensus_queue.cc:237] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:58:52.212234 16922 raft_consensus.cc:1261] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.212323 17324 raft_consensus.cc:1261] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.212697 18558 consensus_queue.cc:1035] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.213063 18558 consensus_queue.cc:1035] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.216223 18558 raft_consensus.cc:2932] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:58:52.220131 16772 catalog_manager.cc:5484] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:52.221329 17324 raft_consensus.cc:2932] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
W20240502 01:58:52.221899 17127 consensus_peers.cc:485] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 -> Peer 436e7859396c42a6b60714873cb60495 (127.10.133.197:45213): Couldn't send request to peer 436e7859396c42a6b60714873cb60495. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a475490b83164ff3930aae5978e7845e. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:52.225041 16922 raft_consensus.cc:2932] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:58:52.234874 18632 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:52.237787 18765 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:52.238158 18898 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:52.239238 17039 tablet_service.cc:1429] Tablet server has 11 leaders and 0 scanners
I20240502 01:58:52.242424 16901 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:52.253952 17059 consensus_queue.cc:237] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:52.254544 19030 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:52.255649 17324 raft_consensus.cc:1261] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.256381 18285 consensus_queue.cc:1035] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.257812 17193 raft_consensus.cc:1261] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.258950 17304 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:58:52.259488 18285 consensus_queue.cc:1035] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.261502 19242 raft_consensus.cc:2932] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:58:52.263482 17171 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:58:52.278185 17193 raft_consensus.cc:2932] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:58:52.282591 16772 catalog_manager.cc:5484] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:52.287951 17324 raft_consensus.cc:2932] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
W20240502 01:58:52.292632 16992 consensus_peers.cc:485] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee -> Peer b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200:46021): Couldn't send request to peer b6aa9ef40e50468ca7a9742c21140d24. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a396235bc534141bcd180430c51e7e1. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:52.308485 17325 consensus_queue.cc:237] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:52.310501 17059 raft_consensus.cc:1261] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.310622 16922 raft_consensus.cc:1261] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.311017 19369 consensus_queue.cc:1035] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.311347 19369 consensus_queue.cc:1035] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.312347 18965 heartbeater.cc:503] Master 127.10.133.254:37275 was elected leader, sending a full tablet report...
I20240502 01:58:52.314815 19370 raft_consensus.cc:2932] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
Runtime error: ksck discovered errors
W20240502 01:58:52.316004 17259 consensus_peers.cc:485] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 -> Peer d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198:45549): Couldn't send request to peer d7989bd96de94be4a94995fcfcd6b16b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c92206bbd4340d59a7ee7379f581bb7. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:52.316295 17059 raft_consensus.cc:2932] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:52.317534 16922 raft_consensus.cc:2932] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:52.318881 16771 catalog_manager.cc:5484] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:52.329021 17325 consensus_queue.cc:237] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:52.330302 17059 raft_consensus.cc:1261] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.330359 16922 raft_consensus.cc:1261] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.330745 19369 consensus_queue.cc:1035] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.330948 19202 consensus_queue.cc:1035] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.333737 17059 raft_consensus.cc:2932] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:52.333768 16922 raft_consensus.cc:2932] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:52.333315 19369 raft_consensus.cc:2932] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
W20240502 01:58:52.336093 17260 consensus_peers.cc:485] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 -> Peer b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199:34045): Couldn't send request to peer b7ec79239ce64b38a1d55f66a95407c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64b3111c603247ac8ff4a1eb9369086f. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:52.338063 16772 catalog_manager.cc:5484] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:52.348269 16922 consensus_queue.cc:237] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:58:52.349720 17059 raft_consensus.cc:1261] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.349720 17325 raft_consensus.cc:1261] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.350152 18389 consensus_queue.cc:1035] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.350370 19389 consensus_queue.cc:1035] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.352963 19389 raft_consensus.cc:2932] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:58:52.353461 17325 raft_consensus.cc:2932] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
W20240502 01:58:52.355234 16858 consensus_peers.cc:485] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc -> Peer 436e7859396c42a6b60714873cb60495 (127.10.133.197:45213): Couldn't send request to peer 436e7859396c42a6b60714873cb60495. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6fb89894cf594139aecab491957f96c9. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:52.355716 16780 catalog_manager.cc:5484] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:52.357064 17059 raft_consensus.cc:2932] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:58:52.365156 17059 consensus_queue.cc:237] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:52.366456 17325 raft_consensus.cc:1261] T 58924c2a9bf5433b86985bbde9d9ec33 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.366683 17193 raft_consensus.cc:1261] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 01:58:52.367084 16992 consensus_peers.cc:485] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee -> Peer b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200:46021): Couldn't send request to peer b6aa9ef40e50468ca7a9742c21140d24. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58924c2a9bf5433b86985bbde9d9ec33. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:52.367169 19359 consensus_queue.cc:1035] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.367616 19359 consensus_queue.cc:1035] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.368955 19242 raft_consensus.cc:2932] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:58:52.369385 17325 raft_consensus.cc:2932] T 58924c2a9bf5433b86985bbde9d9ec33 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:58:52.369725 17193 raft_consensus.cc:2932] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:58:52.372026 16772 catalog_manager.cc:5484] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:52.380329 17059 consensus_queue.cc:237] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:52.381817 17325 raft_consensus.cc:1261] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.382021 17193 raft_consensus.cc:1261] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.382161 19359 consensus_queue.cc:1035] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.382392 19242 consensus_queue.cc:1035] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.384182 18285 raft_consensus.cc:2932] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:52.384552 17325 raft_consensus.cc:2932] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:52.386178 17193 raft_consensus.cc:2932] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:52.386977 16774 catalog_manager.cc:5484] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20240502 01:58:52.389114 16991 consensus_peers.cc:485] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee -> Peer b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199:34045): Couldn't send request to peer b7ec79239ce64b38a1d55f66a95407c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 086b486997ae4d15a4b070e79552807f. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:52.397607 16922 consensus_queue.cc:237] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:52.399055 17059 raft_consensus.cc:1261] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.399138 17325 raft_consensus.cc:1261] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.399583 19389 consensus_queue.cc:1035] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.399930 19389 consensus_queue.cc:1035] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.401615 19389 raft_consensus.cc:2932] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:52.402065 17059 raft_consensus.cc:2932] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
W20240502 01:58:52.404852 16857 consensus_peers.cc:485] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc -> Peer d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198:45549): Couldn't send request to peer d7989bd96de94be4a94995fcfcd6b16b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: adf06dd039c4433890e31c1ad9b44e98. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:52.405201 16771 catalog_manager.cc:5484] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:52.406195 17325 raft_consensus.cc:2932] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:52.413692 17193 consensus_queue.cc:237] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:52.415123 16922 raft_consensus.cc:1261] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.415544 19342 consensus_queue.cc:1035] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.416128 17325 raft_consensus.cc:1261] T 20f803864ef14f12a5ba3bafa3a3b0c3 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.416503 19342 consensus_queue.cc:1035] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.418519 19342 raft_consensus.cc:2932] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
W20240502 01:58:52.418875 17128 consensus_peers.cc:485] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 -> Peer b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200:46021): Couldn't send request to peer b6aa9ef40e50468ca7a9742c21140d24. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 20f803864ef14f12a5ba3bafa3a3b0c3. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:52.420876 17325 raft_consensus.cc:2932] T 20f803864ef14f12a5ba3bafa3a3b0c3 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:58:52.421155 16922 raft_consensus.cc:2932] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:58:52.423458 16772 catalog_manager.cc:5484] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:52.433432 16922 consensus_queue.cc:237] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:58:52.434970 17193 raft_consensus.cc:1261] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.435252 17325 raft_consensus.cc:1261] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 01:58:52.435387 16858 consensus_peers.cc:485] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc -> Peer 436e7859396c42a6b60714873cb60495 (127.10.133.197:45213): Couldn't send request to peer 436e7859396c42a6b60714873cb60495. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cc145366c6244010b42a07e961f9636f. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:52.435429 19389 consensus_queue.cc:1035] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.435973 19389 consensus_queue.cc:1035] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.437202 19390 raft_consensus.cc:2932] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:58:52.437669 17193 raft_consensus.cc:2932] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:58:52.438252 17324 raft_consensus.cc:2932] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:58:52.440975 16771 catalog_manager.cc:5484] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:58:52.449215 16922 consensus_queue.cc:237] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:52.450758 17193 raft_consensus.cc:1261] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.450987 17059 raft_consensus.cc:1261] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.451510 19389 consensus_queue.cc:1035] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.451974 18389 consensus_queue.cc:1035] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.453980 19389 raft_consensus.cc:2932] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:52.454557 17059 raft_consensus.cc:2932] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:52.454557 17193 raft_consensus.cc:2932] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:52.457051 16772 catalog_manager.cc:5484] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20240502 01:58:52.460124 16858 consensus_peers.cc:485] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc -> Peer b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199:34045): Couldn't send request to peer b7ec79239ce64b38a1d55f66a95407c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 029dba0050a64bd4adb35e9815450450. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:52.470163 16922 consensus_queue.cc:237] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:52.471971 17193 raft_consensus.cc:1261] T c7f53fd60e7541f98c0e20f259a86b45 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.472322 17324 raft_consensus.cc:1261] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 01:58:52.472587 16857 consensus_peers.cc:485] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc -> Peer d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198:45549): Couldn't send request to peer d7989bd96de94be4a94995fcfcd6b16b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f53fd60e7541f98c0e20f259a86b45. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:52.472708 19389 consensus_queue.cc:1035] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.473412 19389 consensus_queue.cc:1035] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.475278 19389 raft_consensus.cc:2932] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:52.477541 17193 raft_consensus.cc:2932] T c7f53fd60e7541f98c0e20f259a86b45 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:52.479300 17324 raft_consensus.cc:2932] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:52.481671 16771 catalog_manager.cc:5484] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20240502 01:58:52.485823 19382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:52.486097 19382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:52.490149 19382 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20240502 01:58:52.491966 19097 heartbeater.cc:503] Master 127.10.133.254:37275 was elected leader, sending a full tablet report...
I20240502 01:58:52.494285 17059 consensus_queue.cc:237] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:52.495963 17324 raft_consensus.cc:1261] T 4965b4399f744b67807d2d5361bc1bd5 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 01:58:52.495999 16991 consensus_peers.cc:485] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee -> Peer b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199:34045): Couldn't send request to peer b7ec79239ce64b38a1d55f66a95407c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4965b4399f744b67807d2d5361bc1bd5. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:52.496320 16922 raft_consensus.cc:1261] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.496348 19242 consensus_queue.cc:1035] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.496748 19359 consensus_queue.cc:1035] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.498320 19410 raft_consensus.cc:2932] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:52.498812 17324 raft_consensus.cc:2932] T 4965b4399f744b67807d2d5361bc1bd5 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:52.500941 16774 catalog_manager.cc:5484] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:52.502305 16922 raft_consensus.cc:2932] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:52.510499 17324 consensus_queue.cc:237] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:52.512004 17059 raft_consensus.cc:1261] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.512123 17193 raft_consensus.cc:1261] T 56450521850a4afbbee4587c351b9ca1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.512562 19369 consensus_queue.cc:1035] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.512746 19370 consensus_queue.cc:1035] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.515416 19370 raft_consensus.cc:2932] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:58:52.515775 17193 raft_consensus.cc:2932] T 56450521850a4afbbee4587c351b9ca1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
W20240502 01:58:52.516711 17261 consensus_peers.cc:485] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 -> Peer b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200:46021): Couldn't send request to peer b6aa9ef40e50468ca7a9742c21140d24. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 56450521850a4afbbee4587c351b9ca1. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:52.517328 17059 raft_consensus.cc:2932] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:58:52.518335 16772 catalog_manager.cc:5484] T 56450521850a4afbbee4587c351b9ca1 P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:58:52.526448 17059 consensus_queue.cc:237] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:58:52.528203 16922 raft_consensus.cc:1261] T 0a30ab572eff4a1ebabf95be48e178e2 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.528227 17193 raft_consensus.cc:1261] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.528577 19242 consensus_queue.cc:1035] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.528740 19359 consensus_queue.cc:1035] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.530587 18285 raft_consensus.cc:2932] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:58:52.531323 16922 raft_consensus.cc:2932] T 0a30ab572eff4a1ebabf95be48e178e2 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:58:52.532677 17193 raft_consensus.cc:2932] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:58:52.533484 16772 catalog_manager.cc:5484] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20240502 01:58:52.535604 16991 consensus_peers.cc:485] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee -> Peer 436e7859396c42a6b60714873cb60495 (127.10.133.197:45213): Couldn't send request to peer 436e7859396c42a6b60714873cb60495. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a30ab572eff4a1ebabf95be48e178e2. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:52.543669 16922 consensus_queue.cc:237] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:52.545122 17324 raft_consensus.cc:1261] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.545195 17059 raft_consensus.cc:1261] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.545593 18389 consensus_queue.cc:1035] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20240502 01:58:52.545753 16857 consensus_peers.cc:485] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc -> Peer d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198:45549): Couldn't send request to peer d7989bd96de94be4a94995fcfcd6b16b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df21aa40548c4f49bae79294085c80f4. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:52.545778 19389 consensus_queue.cc:1035] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.547713 18389 raft_consensus.cc:2932] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:52.549283 17059 raft_consensus.cc:2932] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:52.549266 17324 raft_consensus.cc:2932] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:52.551652 16774 catalog_manager.cc:5484] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:52.559430 17059 consensus_queue.cc:237] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:52.560885 17324 raft_consensus.cc:1261] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.561009 16922 raft_consensus.cc:1261] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.561280 18285 consensus_queue.cc:1035] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20240502 01:58:52.561436 16991 consensus_peers.cc:485] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee -> Peer b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199:34045): Couldn't send request to peer b7ec79239ce64b38a1d55f66a95407c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a386a1fd8ae4d70ae482b3ce958825b. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:52.561795 18285 consensus_queue.cc:1035] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.563611 19410 raft_consensus.cc:2932] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:52.564040 17324 raft_consensus.cc:2932] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:52.566547 16771 catalog_manager.cc:5484] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:52.576274 16922 raft_consensus.cc:2932] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:52.577850 17059 consensus_queue.cc:237] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:52.579612 17193 raft_consensus.cc:1261] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.579697 17324 raft_consensus.cc:1261] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 01:58:52.580017 16992 consensus_peers.cc:485] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee -> Peer b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200:46021): Couldn't send request to peer b6aa9ef40e50468ca7a9742c21140d24. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e03fff9bc743475d92ae26b85e7f39ff. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:52.580083 19242 consensus_queue.cc:1035] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.580430 18285 consensus_queue.cc:1035] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.582051 19359 raft_consensus.cc:2932] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:58:52.583377 17193 raft_consensus.cc:2932] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:58:52.585234 16771 catalog_manager.cc:5484] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:52.585441 17324 raft_consensus.cc:2932] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:58:52.598397 16922 consensus_queue.cc:237] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:58:52.599947 17059 raft_consensus.cc:1261] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.600454 18389 consensus_queue.cc:1035] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20240502 01:58:52.600621 16858 consensus_peers.cc:485] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc -> Peer 436e7859396c42a6b60714873cb60495 (127.10.133.197:45213): Couldn't send request to peer 436e7859396c42a6b60714873cb60495. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2aeb35a29ea645288fe123b890452936. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:52.601894 17193 raft_consensus.cc:1261] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:52.602306 18389 consensus_queue.cc:1035] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:52.602902 18389 raft_consensus.cc:2932] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:58:52.605482 16776 catalog_manager.cc:5484] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:52.605533 17193 raft_consensus.cc:2932] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:58:52.606727 17058 raft_consensus.cc:2932] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:58:52.630923 17039 tablet_service.cc:1429] Tablet server has 11 leaders and 0 scanners
I20240502 01:58:52.633430 18632 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:52.634428 19030 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:52.643479 18898 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:52.644259 16901 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:52.655436 17304 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:58:52.658228 17171 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:58:52.675556 18765 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Runtime error: ksck discovered errors
I20240502 01:58:52.733884 19605 ts_tablet_manager.cc:902] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495: Initiating tablet copy from peer a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:52.734939 19605 tablet_copy_client.cc:308] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.195:35923
I20240502 01:58:52.739785 17214 tablet_copy_service.cc:140] P a1c00c21761540dea7ddae8d0dd26df4: Received BeginTabletCopySession request for tablet a475490b83164ff3930aae5978e7845e from peer 436e7859396c42a6b60714873cb60495 ({username='slave'} at 127.10.133.197:53483)
I20240502 01:58:52.739941 17214 tablet_copy_service.cc:161] P a1c00c21761540dea7ddae8d0dd26df4: Beginning new tablet copy session on tablet a475490b83164ff3930aae5978e7845e from peer 436e7859396c42a6b60714873cb60495 at {username='slave'} at 127.10.133.197:53483: session id = 436e7859396c42a6b60714873cb60495-a475490b83164ff3930aae5978e7845e
I20240502 01:58:52.741427 17214 tablet_copy_source_session.cc:205] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:52.741855 19616 ts_tablet_manager.cc:902] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b: Initiating tablet copy from peer ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:52.742667 19616 tablet_copy_client.cc:308] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.196:38135
I20240502 01:58:52.745568 19605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a475490b83164ff3930aae5978e7845e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:52.747893 17345 tablet_copy_service.cc:140] P ec11d4bb3a064a94a80084142637b441: Received BeginTabletCopySession request for tablet 7c92206bbd4340d59a7ee7379f581bb7 from peer d7989bd96de94be4a94995fcfcd6b16b ({username='slave'} at 127.10.133.198:57185)
I20240502 01:58:52.748006 17345 tablet_copy_service.cc:161] P ec11d4bb3a064a94a80084142637b441: Beginning new tablet copy session on tablet 7c92206bbd4340d59a7ee7379f581bb7 from peer d7989bd96de94be4a94995fcfcd6b16b at {username='slave'} at 127.10.133.198:57185: session id = d7989bd96de94be4a94995fcfcd6b16b-7c92206bbd4340d59a7ee7379f581bb7
I20240502 01:58:52.749258 17345 tablet_copy_source_session.cc:205] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:52.753155 19616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c92206bbd4340d59a7ee7379f581bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:52.755613 19605 tablet_copy_client.cc:783] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:52.755847 19605 tablet_copy_client.cc:647] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:52.757581 19613 tablet_copy_client.cc:1002] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:52.759375 19616 tablet_copy_client.cc:783] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:52.759613 19616 tablet_copy_client.cc:647] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:52.761412 19617 tablet_copy_client.cc:1002] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:52.809914 19663 ts_tablet_manager.cc:902] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24: Initiating tablet copy from peer 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:52.810657 19663 tablet_copy_client.cc:308] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37811
I20240502 01:58:52.814831 17079 tablet_copy_service.cc:140] P 6431e35365644aac943c07c97e370fee: Received BeginTabletCopySession request for tablet 1a396235bc534141bcd180430c51e7e1 from peer b6aa9ef40e50468ca7a9742c21140d24 ({username='slave'} at 127.10.133.200:46059)
I20240502 01:58:52.814972 17079 tablet_copy_service.cc:161] P 6431e35365644aac943c07c97e370fee: Beginning new tablet copy session on tablet 1a396235bc534141bcd180430c51e7e1 from peer b6aa9ef40e50468ca7a9742c21140d24 at {username='slave'} at 127.10.133.200:46059: session id = b6aa9ef40e50468ca7a9742c21140d24-1a396235bc534141bcd180430c51e7e1
I20240502 01:58:52.816052 17079 tablet_copy_source_session.cc:205] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:52.819118 19663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a396235bc534141bcd180430c51e7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:52.824260 19663 tablet_copy_client.cc:783] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:52.824437 19663 tablet_copy_client.cc:647] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:52.825829 19667 tablet_copy_client.cc:1002] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:52.832018 19669 ts_tablet_manager.cc:902] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0: Initiating tablet copy from peer 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:52.832762 19669 tablet_copy_client.cc:308] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:45571
I20240502 01:58:52.837764 16944 tablet_copy_service.cc:140] P 191fe00ca08b44c9aef6646e86aecebc: Received BeginTabletCopySession request for tablet 029dba0050a64bd4adb35e9815450450 from peer b7ec79239ce64b38a1d55f66a95407c0 ({username='slave'} at 127.10.133.199:51555)
I20240502 01:58:52.837893 16944 tablet_copy_service.cc:161] P 191fe00ca08b44c9aef6646e86aecebc: Beginning new tablet copy session on tablet 029dba0050a64bd4adb35e9815450450 from peer b7ec79239ce64b38a1d55f66a95407c0 at {username='slave'} at 127.10.133.199:51555: session id = b7ec79239ce64b38a1d55f66a95407c0-029dba0050a64bd4adb35e9815450450
I20240502 01:58:52.839188 16944 tablet_copy_source_session.cc:205] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:52.842057 19669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 029dba0050a64bd4adb35e9815450450. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:52.847198 19675 ts_tablet_manager.cc:902] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495: Initiating tablet copy from peer 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:52.847848 19675 tablet_copy_client.cc:308] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:45571
I20240502 01:58:52.848132 19669 tablet_copy_client.cc:783] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:52.848322 19669 tablet_copy_client.cc:647] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:52.849879 19672 tablet_copy_client.cc:1002] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:52.850139 19680 ts_tablet_manager.cc:902] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495: Initiating tablet copy from peer 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:52.850627 19680 tablet_copy_client.cc:308] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:45571
I20240502 01:58:52.852289 16944 tablet_copy_service.cc:140] P 191fe00ca08b44c9aef6646e86aecebc: Received BeginTabletCopySession request for tablet cc145366c6244010b42a07e961f9636f from peer 436e7859396c42a6b60714873cb60495 ({username='slave'} at 127.10.133.197:36399)
I20240502 01:58:52.852401 16944 tablet_copy_service.cc:161] P 191fe00ca08b44c9aef6646e86aecebc: Beginning new tablet copy session on tablet cc145366c6244010b42a07e961f9636f from peer 436e7859396c42a6b60714873cb60495 at {username='slave'} at 127.10.133.197:36399: session id = 436e7859396c42a6b60714873cb60495-cc145366c6244010b42a07e961f9636f
I20240502 01:58:52.853266 16944 tablet_copy_source_session.cc:205] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:52.853561 16943 tablet_copy_service.cc:140] P 191fe00ca08b44c9aef6646e86aecebc: Received BeginTabletCopySession request for tablet 6fb89894cf594139aecab491957f96c9 from peer 436e7859396c42a6b60714873cb60495 ({username='slave'} at 127.10.133.197:36399)
I20240502 01:58:52.853648 16943 tablet_copy_service.cc:161] P 191fe00ca08b44c9aef6646e86aecebc: Beginning new tablet copy session on tablet 6fb89894cf594139aecab491957f96c9 from peer 436e7859396c42a6b60714873cb60495 at {username='slave'} at 127.10.133.197:36399: session id = 436e7859396c42a6b60714873cb60495-6fb89894cf594139aecab491957f96c9
I20240502 01:58:52.854141 19675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc145366c6244010b42a07e961f9636f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:52.854542 16943 tablet_copy_source_session.cc:205] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:52.855454 19680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fb89894cf594139aecab491957f96c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:52.856540 19675 tablet_copy_client.cc:783] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:52.856668 19675 tablet_copy_client.cc:647] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:52.857223 19680 tablet_copy_client.cc:783] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:52.857352 19680 tablet_copy_client.cc:647] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:52.858337 19678 tablet_copy_client.cc:1002] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:52.858417 19682 tablet_copy_client.cc:1002] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495: tablet copy: Injecting latency into file download: 1500
W20240502 01:58:52.858600 19599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:52.858784 19599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:52.861945 19599 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
I20240502 01:58:52.878188 19695 ts_tablet_manager.cc:902] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b: Initiating tablet copy from peer 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:52.878784 19695 tablet_copy_client.cc:308] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:45571
I20240502 01:58:52.882216 16943 tablet_copy_service.cc:140] P 191fe00ca08b44c9aef6646e86aecebc: Received BeginTabletCopySession request for tablet adf06dd039c4433890e31c1ad9b44e98 from peer d7989bd96de94be4a94995fcfcd6b16b ({username='slave'} at 127.10.133.198:43977)
I20240502 01:58:52.882324 16943 tablet_copy_service.cc:161] P 191fe00ca08b44c9aef6646e86aecebc: Beginning new tablet copy session on tablet adf06dd039c4433890e31c1ad9b44e98 from peer d7989bd96de94be4a94995fcfcd6b16b at {username='slave'} at 127.10.133.198:43977: session id = d7989bd96de94be4a94995fcfcd6b16b-adf06dd039c4433890e31c1ad9b44e98
I20240502 01:58:52.883275 16943 tablet_copy_source_session.cc:205] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:52.884171 19695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adf06dd039c4433890e31c1ad9b44e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:52.885905 19695 tablet_copy_client.cc:783] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:52.886085 19695 tablet_copy_client.cc:647] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:52.887051 19699 tablet_copy_client.cc:1002] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:52.934489 19721 ts_tablet_manager.cc:902] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0: Initiating tablet copy from peer ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:52.935143 19721 tablet_copy_client.cc:308] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.196:38135
I20240502 01:58:52.938385 19720 ts_tablet_manager.cc:902] T 56450521850a4afbbee4587c351b9ca1 P b6aa9ef40e50468ca7a9742c21140d24: Initiating tablet copy from peer ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:52.939141 19720 tablet_copy_client.cc:308] T 56450521850a4afbbee4587c351b9ca1 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.196:38135
I20240502 01:58:52.939447 17345 tablet_copy_service.cc:140] P ec11d4bb3a064a94a80084142637b441: Received BeginTabletCopySession request for tablet 64b3111c603247ac8ff4a1eb9369086f from peer b7ec79239ce64b38a1d55f66a95407c0 ({username='slave'} at 127.10.133.199:53189)
I20240502 01:58:52.939553 17345 tablet_copy_service.cc:161] P ec11d4bb3a064a94a80084142637b441: Beginning new tablet copy session on tablet 64b3111c603247ac8ff4a1eb9369086f from peer b7ec79239ce64b38a1d55f66a95407c0 at {username='slave'} at 127.10.133.199:53189: session id = b7ec79239ce64b38a1d55f66a95407c0-64b3111c603247ac8ff4a1eb9369086f
I20240502 01:58:52.940457 17345 tablet_copy_source_session.cc:205] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:52.941311 19721 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64b3111c603247ac8ff4a1eb9369086f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:52.943694 19721 tablet_copy_client.cc:783] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:52.943878 19721 tablet_copy_client.cc:647] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:52.945688 19722 tablet_copy_client.cc:1002] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:52.945782 17346 tablet_copy_service.cc:140] P ec11d4bb3a064a94a80084142637b441: Received BeginTabletCopySession request for tablet 56450521850a4afbbee4587c351b9ca1 from peer b6aa9ef40e50468ca7a9742c21140d24 ({username='slave'} at 127.10.133.200:54049)
I20240502 01:58:52.945890 17346 tablet_copy_service.cc:161] P ec11d4bb3a064a94a80084142637b441: Beginning new tablet copy session on tablet 56450521850a4afbbee4587c351b9ca1 from peer b6aa9ef40e50468ca7a9742c21140d24 at {username='slave'} at 127.10.133.200:54049: session id = b6aa9ef40e50468ca7a9742c21140d24-56450521850a4afbbee4587c351b9ca1
I20240502 01:58:52.947424 17346 tablet_copy_source_session.cc:205] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:52.948231 19720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56450521850a4afbbee4587c351b9ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:52.950189 19720 tablet_copy_client.cc:783] T 56450521850a4afbbee4587c351b9ca1 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:52.950376 19720 tablet_copy_client.cc:647] T 56450521850a4afbbee4587c351b9ca1 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:52.951418 19730 tablet_copy_client.cc:1002] T 56450521850a4afbbee4587c351b9ca1 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:52.962664 19030 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:52.966418 16901 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:58:52.967092 17171 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:58:52.967247 18898 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:52.967455 17039 tablet_service.cc:1429] Tablet server has 11 leaders and 0 scanners
I20240502 01:58:52.971307 18632 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:52.971997 18765 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:58:52.990456 19742 ts_tablet_manager.cc:902] T 58924c2a9bf5433b86985bbde9d9ec33 P b6aa9ef40e50468ca7a9742c21140d24: Initiating tablet copy from peer 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:52.991060 19742 tablet_copy_client.cc:308] T 58924c2a9bf5433b86985bbde9d9ec33 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37811
I20240502 01:58:52.991688 19747 ts_tablet_manager.cc:902] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0: Initiating tablet copy from peer 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:52.992213 19747 tablet_copy_client.cc:308] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37811
I20240502 01:58:52.992508 17079 tablet_copy_service.cc:140] P 6431e35365644aac943c07c97e370fee: Received BeginTabletCopySession request for tablet 58924c2a9bf5433b86985bbde9d9ec33 from peer b6aa9ef40e50468ca7a9742c21140d24 ({username='slave'} at 127.10.133.200:46059)
I20240502 01:58:52.992611 17079 tablet_copy_service.cc:161] P 6431e35365644aac943c07c97e370fee: Beginning new tablet copy session on tablet 58924c2a9bf5433b86985bbde9d9ec33 from peer b6aa9ef40e50468ca7a9742c21140d24 at {username='slave'} at 127.10.133.200:46059: session id = b6aa9ef40e50468ca7a9742c21140d24-58924c2a9bf5433b86985bbde9d9ec33
I20240502 01:58:52.993575 17079 tablet_copy_source_session.cc:205] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:52.995123 19742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58924c2a9bf5433b86985bbde9d9ec33. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:52.998746 19742 tablet_copy_client.cc:783] T 58924c2a9bf5433b86985bbde9d9ec33 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:52.998955 19742 tablet_copy_client.cc:647] T 58924c2a9bf5433b86985bbde9d9ec33 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:53.006526 17079 tablet_copy_service.cc:140] P 6431e35365644aac943c07c97e370fee: Received BeginTabletCopySession request for tablet 086b486997ae4d15a4b070e79552807f from peer b7ec79239ce64b38a1d55f66a95407c0 ({username='slave'} at 127.10.133.199:45123)
I20240502 01:58:53.006644 17079 tablet_copy_service.cc:161] P 6431e35365644aac943c07c97e370fee: Beginning new tablet copy session on tablet 086b486997ae4d15a4b070e79552807f from peer b7ec79239ce64b38a1d55f66a95407c0 at {username='slave'} at 127.10.133.199:45123: session id = b7ec79239ce64b38a1d55f66a95407c0-086b486997ae4d15a4b070e79552807f
I20240502 01:58:53.007668 17079 tablet_copy_source_session.cc:205] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:53.008606 19747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 086b486997ae4d15a4b070e79552807f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:53.010985 19747 tablet_copy_client.cc:783] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:53.011147 19747 tablet_copy_client.cc:647] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:53.011286 19757 ts_tablet_manager.cc:902] T c7f53fd60e7541f98c0e20f259a86b45 P d7989bd96de94be4a94995fcfcd6b16b: Initiating tablet copy from peer 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:53.012398 19757 tablet_copy_client.cc:308] T c7f53fd60e7541f98c0e20f259a86b45 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:45571
I20240502 01:58:53.012862 16943 tablet_copy_service.cc:140] P 191fe00ca08b44c9aef6646e86aecebc: Received BeginTabletCopySession request for tablet c7f53fd60e7541f98c0e20f259a86b45 from peer d7989bd96de94be4a94995fcfcd6b16b ({username='slave'} at 127.10.133.198:43977)
I20240502 01:58:53.012965 16943 tablet_copy_service.cc:161] P 191fe00ca08b44c9aef6646e86aecebc: Beginning new tablet copy session on tablet c7f53fd60e7541f98c0e20f259a86b45 from peer d7989bd96de94be4a94995fcfcd6b16b at {username='slave'} at 127.10.133.198:43977: session id = d7989bd96de94be4a94995fcfcd6b16b-c7f53fd60e7541f98c0e20f259a86b45
I20240502 01:58:53.013911 16943 tablet_copy_source_session.cc:205] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:53.014842 19757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7f53fd60e7541f98c0e20f259a86b45. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:53.017688 19757 tablet_copy_client.cc:783] T c7f53fd60e7541f98c0e20f259a86b45 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:53.017885 19757 tablet_copy_client.cc:647] T c7f53fd60e7541f98c0e20f259a86b45 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:53.018857 19766 tablet_copy_client.cc:1002] T c7f53fd60e7541f98c0e20f259a86b45 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:53.019670 19743 tablet_copy_client.cc:1002] T 58924c2a9bf5433b86985bbde9d9ec33 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:53.023133 19749 tablet_copy_client.cc:1002] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:53.029805 17304 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:58:53.033866 19772 ts_tablet_manager.cc:902] T 20f803864ef14f12a5ba3bafa3a3b0c3 P b6aa9ef40e50468ca7a9742c21140d24: Initiating tablet copy from peer a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:53.035218 19772 tablet_copy_client.cc:308] T 20f803864ef14f12a5ba3bafa3a3b0c3 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.195:35923
I20240502 01:58:53.035390 19782 ts_tablet_manager.cc:902] T 4965b4399f744b67807d2d5361bc1bd5 P b7ec79239ce64b38a1d55f66a95407c0: Initiating tablet copy from peer 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:53.035929 19782 tablet_copy_client.cc:308] T 4965b4399f744b67807d2d5361bc1bd5 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37811
I20240502 01:58:53.038101 17079 tablet_copy_service.cc:140] P 6431e35365644aac943c07c97e370fee: Received BeginTabletCopySession request for tablet 4965b4399f744b67807d2d5361bc1bd5 from peer b7ec79239ce64b38a1d55f66a95407c0 ({username='slave'} at 127.10.133.199:45123)
I20240502 01:58:53.038199 17079 tablet_copy_service.cc:161] P 6431e35365644aac943c07c97e370fee: Beginning new tablet copy session on tablet 4965b4399f744b67807d2d5361bc1bd5 from peer b7ec79239ce64b38a1d55f66a95407c0 at {username='slave'} at 127.10.133.199:45123: session id = b7ec79239ce64b38a1d55f66a95407c0-4965b4399f744b67807d2d5361bc1bd5
I20240502 01:58:53.039197 17079 tablet_copy_source_session.cc:205] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:53.039471 17214 tablet_copy_service.cc:140] P a1c00c21761540dea7ddae8d0dd26df4: Received BeginTabletCopySession request for tablet 20f803864ef14f12a5ba3bafa3a3b0c3 from peer b6aa9ef40e50468ca7a9742c21140d24 ({username='slave'} at 127.10.133.200:44867)
I20240502 01:58:53.039579 17214 tablet_copy_service.cc:161] P a1c00c21761540dea7ddae8d0dd26df4: Beginning new tablet copy session on tablet 20f803864ef14f12a5ba3bafa3a3b0c3 from peer b6aa9ef40e50468ca7a9742c21140d24 at {username='slave'} at 127.10.133.200:44867: session id = b6aa9ef40e50468ca7a9742c21140d24-20f803864ef14f12a5ba3bafa3a3b0c3
I20240502 01:58:53.040468 17214 tablet_copy_source_session.cc:205] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:53.041251 19782 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4965b4399f744b67807d2d5361bc1bd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:53.041255 19772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20f803864ef14f12a5ba3bafa3a3b0c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:53.043315 19772 tablet_copy_client.cc:783] T 20f803864ef14f12a5ba3bafa3a3b0c3 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:53.043444 19772 tablet_copy_client.cc:647] T 20f803864ef14f12a5ba3bafa3a3b0c3 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:53.043469 19782 tablet_copy_client.cc:783] T 4965b4399f744b67807d2d5361bc1bd5 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:53.043623 19782 tablet_copy_client.cc:647] T 4965b4399f744b67807d2d5361bc1bd5 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:53.044770 19786 tablet_copy_client.cc:1002] T 4965b4399f744b67807d2d5361bc1bd5 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:53.044791 19779 tablet_copy_client.cc:1002] T 20f803864ef14f12a5ba3bafa3a3b0c3 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Injecting latency into file download: 1500
Runtime error: ksck discovered errors
I20240502 01:58:53.077844 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.201:0
--local_ip_for_outbound_sockets=127.10.133.201
--webserver_interface=127.10.133.201
--webserver_port=0
--tserver_master_addrs=127.10.133.254:37275
--builtin_ntp_servers=127.10.133.212:45535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true
--tablet_copy_download_file_inject_latency_ms=1500
--follower_unavailable_considered_failed_sec=30 with env {}
I20240502 01:58:53.083442 19808 ts_tablet_manager.cc:902] T 0a30ab572eff4a1ebabf95be48e178e2 P 436e7859396c42a6b60714873cb60495: Initiating tablet copy from peer 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:53.083959 19808 tablet_copy_client.cc:308] T 0a30ab572eff4a1ebabf95be48e178e2 P 436e7859396c42a6b60714873cb60495: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37811
I20240502 01:58:53.088661 17079 tablet_copy_service.cc:140] P 6431e35365644aac943c07c97e370fee: Received BeginTabletCopySession request for tablet 0a30ab572eff4a1ebabf95be48e178e2 from peer 436e7859396c42a6b60714873cb60495 ({username='slave'} at 127.10.133.197:58823)
I20240502 01:58:53.088768 17079 tablet_copy_service.cc:161] P 6431e35365644aac943c07c97e370fee: Beginning new tablet copy session on tablet 0a30ab572eff4a1ebabf95be48e178e2 from peer 436e7859396c42a6b60714873cb60495 at {username='slave'} at 127.10.133.197:58823: session id = 436e7859396c42a6b60714873cb60495-0a30ab572eff4a1ebabf95be48e178e2
I20240502 01:58:53.089792 17079 tablet_copy_source_session.cc:205] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:53.090741 19808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a30ab572eff4a1ebabf95be48e178e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:53.092589 19808 tablet_copy_client.cc:783] T 0a30ab572eff4a1ebabf95be48e178e2 P 436e7859396c42a6b60714873cb60495: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:53.092721 19808 tablet_copy_client.cc:647] T 0a30ab572eff4a1ebabf95be48e178e2 P 436e7859396c42a6b60714873cb60495: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:53.093878 19811 tablet_copy_client.cc:1002] T 0a30ab572eff4a1ebabf95be48e178e2 P 436e7859396c42a6b60714873cb60495: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:53.098521 19823 ts_tablet_manager.cc:902] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495: Initiating tablet copy from peer 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:53.099066 19823 tablet_copy_client.cc:308] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:45571
I20240502 01:58:53.099560 16943 tablet_copy_service.cc:140] P 191fe00ca08b44c9aef6646e86aecebc: Received BeginTabletCopySession request for tablet 2aeb35a29ea645288fe123b890452936 from peer 436e7859396c42a6b60714873cb60495 ({username='slave'} at 127.10.133.197:36399)
I20240502 01:58:53.099664 16943 tablet_copy_service.cc:161] P 191fe00ca08b44c9aef6646e86aecebc: Beginning new tablet copy session on tablet 2aeb35a29ea645288fe123b890452936 from peer 436e7859396c42a6b60714873cb60495 at {username='slave'} at 127.10.133.197:36399: session id = 436e7859396c42a6b60714873cb60495-2aeb35a29ea645288fe123b890452936
I20240502 01:58:53.100529 16943 tablet_copy_source_session.cc:205] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:53.101444 19823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2aeb35a29ea645288fe123b890452936. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:53.103789 19823 tablet_copy_client.cc:783] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:53.103965 19823 tablet_copy_client.cc:647] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:53.105013 19826 tablet_copy_client.cc:1002] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:53.109619 19838 ts_tablet_manager.cc:902] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0: Initiating tablet copy from peer 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:53.110205 19838 tablet_copy_client.cc:308] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37811
I20240502 01:58:53.110653 17079 tablet_copy_service.cc:140] P 6431e35365644aac943c07c97e370fee: Received BeginTabletCopySession request for tablet 8a386a1fd8ae4d70ae482b3ce958825b from peer b7ec79239ce64b38a1d55f66a95407c0 ({username='slave'} at 127.10.133.199:45123)
I20240502 01:58:53.110750 17079 tablet_copy_service.cc:161] P 6431e35365644aac943c07c97e370fee: Beginning new tablet copy session on tablet 8a386a1fd8ae4d70ae482b3ce958825b from peer b7ec79239ce64b38a1d55f66a95407c0 at {username='slave'} at 127.10.133.199:45123: session id = b7ec79239ce64b38a1d55f66a95407c0-8a386a1fd8ae4d70ae482b3ce958825b
I20240502 01:58:53.111555 17079 tablet_copy_source_session.cc:205] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:53.112360 19838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a386a1fd8ae4d70ae482b3ce958825b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:53.115645 19838 tablet_copy_client.cc:783] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:53.115942 19838 tablet_copy_client.cc:647] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:53.123183 19848 ts_tablet_manager.cc:902] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24: Initiating tablet copy from peer 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:53.123718 19842 tablet_copy_client.cc:1002] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:53.123755 19848 tablet_copy_client.cc:308] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37811
I20240502 01:58:53.124193 17079 tablet_copy_service.cc:140] P 6431e35365644aac943c07c97e370fee: Received BeginTabletCopySession request for tablet e03fff9bc743475d92ae26b85e7f39ff from peer b6aa9ef40e50468ca7a9742c21140d24 ({username='slave'} at 127.10.133.200:46059)
I20240502 01:58:53.124289 17079 tablet_copy_service.cc:161] P 6431e35365644aac943c07c97e370fee: Beginning new tablet copy session on tablet e03fff9bc743475d92ae26b85e7f39ff from peer b6aa9ef40e50468ca7a9742c21140d24 at {username='slave'} at 127.10.133.200:46059: session id = b6aa9ef40e50468ca7a9742c21140d24-e03fff9bc743475d92ae26b85e7f39ff
I20240502 01:58:53.125115 17079 tablet_copy_source_session.cc:205] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:53.125890 19848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e03fff9bc743475d92ae26b85e7f39ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:53.128284 19848 tablet_copy_client.cc:783] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:53.128471 19848 tablet_copy_client.cc:647] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:53.129499 19855 tablet_copy_client.cc:1002] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:53.142164 19868 ts_tablet_manager.cc:902] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b: Initiating tablet copy from peer 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:53.142735 19868 tablet_copy_client.cc:308] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:45571
I20240502 01:58:53.143266 16943 tablet_copy_service.cc:140] P 191fe00ca08b44c9aef6646e86aecebc: Received BeginTabletCopySession request for tablet df21aa40548c4f49bae79294085c80f4 from peer d7989bd96de94be4a94995fcfcd6b16b ({username='slave'} at 127.10.133.198:43977)
I20240502 01:58:53.143359 16943 tablet_copy_service.cc:161] P 191fe00ca08b44c9aef6646e86aecebc: Beginning new tablet copy session on tablet df21aa40548c4f49bae79294085c80f4 from peer d7989bd96de94be4a94995fcfcd6b16b at {username='slave'} at 127.10.133.198:43977: session id = d7989bd96de94be4a94995fcfcd6b16b-df21aa40548c4f49bae79294085c80f4
I20240502 01:58:53.144085 16943 tablet_copy_source_session.cc:205] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:53.144910 19868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df21aa40548c4f49bae79294085c80f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:53.146946 19868 tablet_copy_client.cc:783] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:53.147189 19868 tablet_copy_client.cc:647] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:53.148574 19872 tablet_copy_client.cc:1002] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Injecting latency into file download: 1500
W20240502 01:58:53.204918 19802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:58:53.205143 19802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:58:53.205209 19802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:58:53.208276 19802 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:58:53.208341 19802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:58:53.208432 19802 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.201
I20240502 01:58:53.211901 19802 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:45535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=30
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.201:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data/info.pb
--webserver_interface=127.10.133.201
--webserver_port=0
--tablet_copy_download_file_inject_latency_ms=1500
--tserver_master_addrs=127.10.133.254:37275
--never_fsync=true
--heap_profile_path=/tmp/kudu.19802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.201
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:58:53.212682 19802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:58:53.213776 19802 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:58:53.222571 19893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:53.223222 19892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:58:53.224007 19895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:58:53.224720 19802 server_base.cc:1034] running on GCE node
I20240502 01:58:53.225147 19802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:58:53.225693 19802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:58:53.226855 19802 hybrid_clock.cc:648] HybridClock initialized: now 1714615133226830 us; error 32 us; skew 500 ppm
I20240502 01:58:53.228864 19802 webserver.cc:460] Webserver started at http://127.10.133.201:37899/ using document root <none> and password file <none>
I20240502 01:58:53.229385 19802 fs_manager.cc:359] Metadata directory not provided
I20240502 01:58:53.229436 19802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:58:53.229606 19802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:58:53.231245 19802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data/instance:
uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9"
format_stamp: "Formatted at 2024-05-02 01:58:53 on dist-test-slave-dr9f"
I20240502 01:58:53.231729 19802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal/instance:
uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9"
format_stamp: "Formatted at 2024-05-02 01:58:53 on dist-test-slave-dr9f"
I20240502 01:58:53.235306 19802 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 01:58:53.238313 19902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:53.239300 19802 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 01:58:53.239400 19802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal
uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9"
format_stamp: "Formatted at 2024-05-02 01:58:53 on dist-test-slave-dr9f"
I20240502 01:58:53.239488 19802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:58:53.254237 19802 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:58:53.254745 19802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:58:53.254933 19802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:58:53.255465 19802 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:58:53.256275 19802 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:58:53.256319 19802 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:53.256362 19802 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:58:53.256390 19802 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:58:53.265013 19802 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.201:36215
I20240502 01:58:53.265040 20016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.201:36215 every 8 connection(s)
I20240502 01:58:53.265825 19802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data/info.pb
I20240502 01:58:53.273721 20017 heartbeater.cc:347] Connected to a master server at 127.10.133.254:37275
I20240502 01:58:53.273919 20017 heartbeater.cc:464] Registering TS with master...
I20240502 01:58:53.274515 20017 heartbeater.cc:511] Master 127.10.133.254:37275 requested a full tablet report, sending...
I20240502 01:58:53.274570 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 19802
I20240502 01:58:53.274703 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal/instance
I20240502 01:58:53.275511 16774 ts_manager.cc:194] Registered new tserver with Master: 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201:36215)
I20240502 01:58:53.276093 16774 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.201:57907
I20240502 01:58:54.258092 19605 tablet_copy_client.cc:523] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:54.259912 19605 tablet_bootstrap.cc:492] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495: Bootstrap starting.
I20240502 01:58:54.261798 19616 tablet_copy_client.cc:523] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:54.263432 19616 tablet_bootstrap.cc:492] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap starting.
I20240502 01:58:54.267691 19605 log.cc:824] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:54.273293 19616 log.cc:824] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:54.278915 20017 heartbeater.cc:503] Master 127.10.133.254:37275 was elected leader, sending a full tablet report...
I20240502 01:58:54.303138 19616 tablet_bootstrap.cc:492] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:54.303138 19605 tablet_bootstrap.cc:492] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:54.303555 19605 tablet_bootstrap.cc:492] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495: Bootstrap complete.
I20240502 01:58:54.303555 19616 tablet_bootstrap.cc:492] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap complete.
I20240502 01:58:54.303908 19616 ts_tablet_manager.cc:1367] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b: Time spent bootstrapping tablet: real 0.041s user 0.034s sys 0.000s
I20240502 01:58:54.303908 19605 ts_tablet_manager.cc:1367] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495: Time spent bootstrapping tablet: real 0.044s user 0.035s sys 0.002s
I20240502 01:58:54.306483 19605 raft_consensus.cc:348] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:58:54.306483 19616 raft_consensus.cc:348] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:54.306763 19605 raft_consensus.cc:729] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 436e7859396c42a6b60714873cb60495, State: Initialized, Role: LEARNER
I20240502 01:58:54.306756 19616 raft_consensus.cc:729] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d7989bd96de94be4a94995fcfcd6b16b, State: Initialized, Role: LEARNER
I20240502 01:58:54.307133 19605 consensus_queue.cc:260] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:58:54.307133 19616 consensus_queue.cc:260] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:54.308015 19616 ts_tablet_manager.cc:1398] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20240502 01:58:54.308015 19605 ts_tablet_manager.cc:1398] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20240502 01:58:54.308928 17346 tablet_copy_service.cc:342] P ec11d4bb3a064a94a80084142637b441: Request end of tablet copy session d7989bd96de94be4a94995fcfcd6b16b-7c92206bbd4340d59a7ee7379f581bb7 received from {username='slave'} at 127.10.133.198:57185
I20240502 01:58:54.309039 17346 tablet_copy_service.cc:433] P ec11d4bb3a064a94a80084142637b441: ending tablet copy session d7989bd96de94be4a94995fcfcd6b16b-7c92206bbd4340d59a7ee7379f581bb7 on tablet 7c92206bbd4340d59a7ee7379f581bb7 with peer d7989bd96de94be4a94995fcfcd6b16b
I20240502 01:58:54.309597 17214 tablet_copy_service.cc:342] P a1c00c21761540dea7ddae8d0dd26df4: Request end of tablet copy session 436e7859396c42a6b60714873cb60495-a475490b83164ff3930aae5978e7845e received from {username='slave'} at 127.10.133.197:53483
I20240502 01:58:54.309684 17214 tablet_copy_service.cc:433] P a1c00c21761540dea7ddae8d0dd26df4: ending tablet copy session 436e7859396c42a6b60714873cb60495-a475490b83164ff3930aae5978e7845e on tablet a475490b83164ff3930aae5978e7845e with peer 436e7859396c42a6b60714873cb60495
I20240502 01:58:54.326318 19663 tablet_copy_client.cc:523] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:54.328444 19663 tablet_bootstrap.cc:492] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap starting.
I20240502 01:58:54.335661 19663 log.cc:824] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:54.350272 19669 tablet_copy_client.cc:523] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:54.352275 19669 tablet_bootstrap.cc:492] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap starting.
I20240502 01:58:54.358503 19669 log.cc:824] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0: Log is configured to *not* fsync() on all Append() calls
I20240502 01:58:54.358778 19680 tablet_copy_client.cc:523] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:54.358781 19675 tablet_copy_client.cc:523] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:54.360252 19680 tablet_bootstrap.cc:492] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495: Bootstrap starting.
I20240502 01:58:54.360311 19675 tablet_bootstrap.cc:492] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495: Bootstrap starting.
I20240502 01:58:54.369390 19663 tablet_bootstrap.cc:492] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:54.370178 19663 tablet_bootstrap.cc:492] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap complete.
I20240502 01:58:54.370507 19663 ts_tablet_manager.cc:1367] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24: Time spent bootstrapping tablet: real 0.042s user 0.030s sys 0.007s
I20240502 01:58:54.370963 18785 raft_consensus.cc:1203] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:54.375563 19663 raft_consensus.cc:348] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:54.375943 19663 raft_consensus.cc:729] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b6aa9ef40e50468ca7a9742c21140d24, State: Initialized, Role: LEARNER
I20240502 01:58:54.376437 19663 consensus_queue.cc:260] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:54.377650 19663 ts_tablet_manager.cc:1398] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24: Time spent starting tablet: real 0.006s user 0.003s sys 0.001s
I20240502 01:58:54.378476 17079 tablet_copy_service.cc:342] P 6431e35365644aac943c07c97e370fee: Request end of tablet copy session b6aa9ef40e50468ca7a9742c21140d24-1a396235bc534141bcd180430c51e7e1 received from {username='slave'} at 127.10.133.200:46059
I20240502 01:58:54.378583 17079 tablet_copy_service.cc:433] P 6431e35365644aac943c07c97e370fee: ending tablet copy session b6aa9ef40e50468ca7a9742c21140d24-1a396235bc534141bcd180430c51e7e1 on tablet 1a396235bc534141bcd180430c51e7e1 with peer b6aa9ef40e50468ca7a9742c21140d24
I20240502 01:58:54.386520 19669 tablet_bootstrap.cc:492] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:54.386857 19669 tablet_bootstrap.cc:492] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap complete.
I20240502 01:58:54.387135 19669 ts_tablet_manager.cc:1367] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0: Time spent bootstrapping tablet: real 0.035s user 0.029s sys 0.004s
I20240502 01:58:54.387305 19695 tablet_copy_client.cc:523] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:54.388697 19695 tablet_bootstrap.cc:492] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap starting.
I20240502 01:58:54.390158 19669 raft_consensus.cc:348] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:54.390404 19669 raft_consensus.cc:729] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b7ec79239ce64b38a1d55f66a95407c0, State: Initialized, Role: LEARNER
I20240502 01:58:54.390729 19669 consensus_queue.cc:260] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:54.392194 19669 ts_tablet_manager.cc:1398] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:58:54.394066 19675 tablet_bootstrap.cc:492] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:54.394281 16943 tablet_copy_service.cc:342] P 191fe00ca08b44c9aef6646e86aecebc: Request end of tablet copy session b7ec79239ce64b38a1d55f66a95407c0-029dba0050a64bd4adb35e9815450450 received from {username='slave'} at 127.10.133.199:51555
I20240502 01:58:54.394383 19675 tablet_bootstrap.cc:492] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495: Bootstrap complete.
I20240502 01:58:54.394381 16943 tablet_copy_service.cc:433] P 191fe00ca08b44c9aef6646e86aecebc: ending tablet copy session b7ec79239ce64b38a1d55f66a95407c0-029dba0050a64bd4adb35e9815450450 on tablet 029dba0050a64bd4adb35e9815450450 with peer b7ec79239ce64b38a1d55f66a95407c0
I20240502 01:58:54.394554 19675 ts_tablet_manager.cc:1367] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495: Time spent bootstrapping tablet: real 0.034s user 0.019s sys 0.004s
I20240502 01:58:54.395207 19675 raft_consensus.cc:348] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:58:54.395354 19675 raft_consensus.cc:729] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 436e7859396c42a6b60714873cb60495, State: Initialized, Role: LEARNER
I20240502 01:58:54.395483 19675 consensus_queue.cc:260] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:58:54.395795 19680 tablet_bootstrap.cc:492] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:54.395797 19675 ts_tablet_manager.cc:1398] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:58:54.396123 19680 tablet_bootstrap.cc:492] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495: Bootstrap complete.
I20240502 01:58:54.396478 19680 ts_tablet_manager.cc:1367] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495: Time spent bootstrapping tablet: real 0.036s user 0.020s sys 0.006s
I20240502 01:58:54.396549 16943 tablet_copy_service.cc:342] P 191fe00ca08b44c9aef6646e86aecebc: Request end of tablet copy session 436e7859396c42a6b60714873cb60495-cc145366c6244010b42a07e961f9636f received from {username='slave'} at 127.10.133.197:36399
I20240502 01:58:54.396639 16943 tablet_copy_service.cc:433] P 191fe00ca08b44c9aef6646e86aecebc: ending tablet copy session 436e7859396c42a6b60714873cb60495-cc145366c6244010b42a07e961f9636f on tablet cc145366c6244010b42a07e961f9636f with peer 436e7859396c42a6b60714873cb60495
I20240502 01:58:54.396891 19680 raft_consensus.cc:348] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:58:54.397033 19680 raft_consensus.cc:729] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 436e7859396c42a6b60714873cb60495, State: Initialized, Role: LEARNER
I20240502 01:58:54.397147 19680 consensus_queue.cc:260] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:58:54.397420 19680 ts_tablet_manager.cc:1398] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:54.398067 16943 tablet_copy_service.cc:342] P 191fe00ca08b44c9aef6646e86aecebc: Request end of tablet copy session 436e7859396c42a6b60714873cb60495-6fb89894cf594139aecab491957f96c9 received from {username='slave'} at 127.10.133.197:36399
I20240502 01:58:54.398136 16943 tablet_copy_service.cc:433] P 191fe00ca08b44c9aef6646e86aecebc: ending tablet copy session 436e7859396c42a6b60714873cb60495-6fb89894cf594139aecab491957f96c9 on tablet 6fb89894cf594139aecab491957f96c9 with peer 436e7859396c42a6b60714873cb60495
I20240502 01:58:54.419194 19695 tablet_bootstrap.cc:492] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:54.419482 19695 tablet_bootstrap.cc:492] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap complete.
I20240502 01:58:54.419675 19695 ts_tablet_manager.cc:1367] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b: Time spent bootstrapping tablet: real 0.031s user 0.017s sys 0.005s
I20240502 01:58:54.420652 19695 raft_consensus.cc:348] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:54.420780 19695 raft_consensus.cc:729] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d7989bd96de94be4a94995fcfcd6b16b, State: Initialized, Role: LEARNER
I20240502 01:58:54.420884 19695 consensus_queue.cc:260] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:54.421211 19695 ts_tablet_manager.cc:1398] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:54.421828 16943 tablet_copy_service.cc:342] P 191fe00ca08b44c9aef6646e86aecebc: Request end of tablet copy session d7989bd96de94be4a94995fcfcd6b16b-adf06dd039c4433890e31c1ad9b44e98 received from {username='slave'} at 127.10.133.198:43977
I20240502 01:58:54.421906 16943 tablet_copy_service.cc:433] P 191fe00ca08b44c9aef6646e86aecebc: ending tablet copy session d7989bd96de94be4a94995fcfcd6b16b-adf06dd039c4433890e31c1ad9b44e98 on tablet adf06dd039c4433890e31c1ad9b44e98 with peer d7989bd96de94be4a94995fcfcd6b16b
I20240502 01:58:54.446084 19721 tablet_copy_client.cc:523] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:54.447624 19721 tablet_bootstrap.cc:492] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap starting.
I20240502 01:58:54.451711 19720 tablet_copy_client.cc:523] T 56450521850a4afbbee4587c351b9ca1 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:54.453034 19720 tablet_bootstrap.cc:492] T 56450521850a4afbbee4587c351b9ca1 P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap starting.
I20240502 01:58:54.456975 18919 raft_consensus.cc:1203] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:54.469755 19721 tablet_bootstrap.cc:492] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:54.470124 19721 tablet_bootstrap.cc:492] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap complete.
I20240502 01:58:54.470340 19721 ts_tablet_manager.cc:1367] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0: Time spent bootstrapping tablet: real 0.023s user 0.017s sys 0.004s
I20240502 01:58:54.470795 19721 raft_consensus.cc:348] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:54.470916 19721 raft_consensus.cc:729] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b7ec79239ce64b38a1d55f66a95407c0, State: Initialized, Role: LEARNER
I20240502 01:58:54.471012 19721 consensus_queue.cc:260] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:54.471275 19721 ts_tablet_manager.cc:1398] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:54.471865 19720 tablet_bootstrap.cc:492] T 56450521850a4afbbee4587c351b9ca1 P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:54.471864 17346 tablet_copy_service.cc:342] P ec11d4bb3a064a94a80084142637b441: Request end of tablet copy session b7ec79239ce64b38a1d55f66a95407c0-64b3111c603247ac8ff4a1eb9369086f received from {username='slave'} at 127.10.133.199:53189
I20240502 01:58:54.471949 17346 tablet_copy_service.cc:433] P ec11d4bb3a064a94a80084142637b441: ending tablet copy session b7ec79239ce64b38a1d55f66a95407c0-64b3111c603247ac8ff4a1eb9369086f on tablet 64b3111c603247ac8ff4a1eb9369086f with peer b7ec79239ce64b38a1d55f66a95407c0
I20240502 01:58:54.472157 19720 tablet_bootstrap.cc:492] T 56450521850a4afbbee4587c351b9ca1 P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap complete.
I20240502 01:58:54.472347 19720 ts_tablet_manager.cc:1367] T 56450521850a4afbbee4587c351b9ca1 P b6aa9ef40e50468ca7a9742c21140d24: Time spent bootstrapping tablet: real 0.019s user 0.014s sys 0.004s
I20240502 01:58:54.472879 19720 raft_consensus.cc:348] T 56450521850a4afbbee4587c351b9ca1 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:54.472975 19720 raft_consensus.cc:729] T 56450521850a4afbbee4587c351b9ca1 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b6aa9ef40e50468ca7a9742c21140d24, State: Initialized, Role: LEARNER
I20240502 01:58:54.473054 19720 consensus_queue.cc:260] T 56450521850a4afbbee4587c351b9ca1 P b6aa9ef40e50468ca7a9742c21140d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:54.473315 19720 ts_tablet_manager.cc:1398] T 56450521850a4afbbee4587c351b9ca1 P b6aa9ef40e50468ca7a9742c21140d24: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:54.473809 17346 tablet_copy_service.cc:342] P ec11d4bb3a064a94a80084142637b441: Request end of tablet copy session b6aa9ef40e50468ca7a9742c21140d24-56450521850a4afbbee4587c351b9ca1 received from {username='slave'} at 127.10.133.200:54049
I20240502 01:58:54.473886 17346 tablet_copy_service.cc:433] P ec11d4bb3a064a94a80084142637b441: ending tablet copy session b6aa9ef40e50468ca7a9742c21140d24-56450521850a4afbbee4587c351b9ca1 on tablet 56450521850a4afbbee4587c351b9ca1 with peer b6aa9ef40e50468ca7a9742c21140d24
I20240502 01:58:54.505020 18652 raft_consensus.cc:1203] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:54.519182 19757 tablet_copy_client.cc:523] T c7f53fd60e7541f98c0e20f259a86b45 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:54.519944 19742 tablet_copy_client.cc:523] T 58924c2a9bf5433b86985bbde9d9ec33 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:54.520560 19757 tablet_bootstrap.cc:492] T c7f53fd60e7541f98c0e20f259a86b45 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap starting.
I20240502 01:58:54.521289 19742 tablet_bootstrap.cc:492] T 58924c2a9bf5433b86985bbde9d9ec33 P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap starting.
I20240502 01:58:54.523443 19747 tablet_copy_client.cc:523] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:54.524837 19747 tablet_bootstrap.cc:492] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap starting.
I20240502 01:58:54.545065 19772 tablet_copy_client.cc:523] T 20f803864ef14f12a5ba3bafa3a3b0c3 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:54.545091 19782 tablet_copy_client.cc:523] T 4965b4399f744b67807d2d5361bc1bd5 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:54.546455 19782 tablet_bootstrap.cc:492] T 4965b4399f744b67807d2d5361bc1bd5 P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap starting.
I20240502 01:58:54.546468 19772 tablet_bootstrap.cc:492] T 20f803864ef14f12a5ba3bafa3a3b0c3 P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap starting.
I20240502 01:58:54.546818 19747 tablet_bootstrap.cc:492] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:54.547155 19747 tablet_bootstrap.cc:492] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap complete.
I20240502 01:58:54.547314 19747 ts_tablet_manager.cc:1367] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0: Time spent bootstrapping tablet: real 0.023s user 0.021s sys 0.000s
I20240502 01:58:54.547930 19747 raft_consensus.cc:348] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:54.548259 19742 tablet_bootstrap.cc:492] T 58924c2a9bf5433b86985bbde9d9ec33 P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:54.548498 19742 tablet_bootstrap.cc:492] T 58924c2a9bf5433b86985bbde9d9ec33 P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap complete.
I20240502 01:58:54.548647 19742 ts_tablet_manager.cc:1367] T 58924c2a9bf5433b86985bbde9d9ec33 P b6aa9ef40e50468ca7a9742c21140d24: Time spent bootstrapping tablet: real 0.027s user 0.026s sys 0.000s
I20240502 01:58:54.548940 18652 raft_consensus.cc:1203] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:54.549089 19742 raft_consensus.cc:348] T 58924c2a9bf5433b86985bbde9d9ec33 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:54.549212 19742 raft_consensus.cc:729] T 58924c2a9bf5433b86985bbde9d9ec33 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b6aa9ef40e50468ca7a9742c21140d24, State: Initialized, Role: LEARNER
I20240502 01:58:54.549316 19742 consensus_queue.cc:260] T 58924c2a9bf5433b86985bbde9d9ec33 P b6aa9ef40e50468ca7a9742c21140d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:54.551653 19742 ts_tablet_manager.cc:1398] T 58924c2a9bf5433b86985bbde9d9ec33 P b6aa9ef40e50468ca7a9742c21140d24: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 01:58:54.548069 19747 raft_consensus.cc:729] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b7ec79239ce64b38a1d55f66a95407c0, State: Initialized, Role: LEARNER
I20240502 01:58:54.553062 19747 consensus_queue.cc:260] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:54.553642 17079 tablet_copy_service.cc:342] P 6431e35365644aac943c07c97e370fee: Request end of tablet copy session b6aa9ef40e50468ca7a9742c21140d24-58924c2a9bf5433b86985bbde9d9ec33 received from {username='slave'} at 127.10.133.200:46059
I20240502 01:58:54.553742 17079 tablet_copy_service.cc:433] P 6431e35365644aac943c07c97e370fee: ending tablet copy session b6aa9ef40e50468ca7a9742c21140d24-58924c2a9bf5433b86985bbde9d9ec33 on tablet 58924c2a9bf5433b86985bbde9d9ec33 with peer b6aa9ef40e50468ca7a9742c21140d24
I20240502 01:58:54.553431 19747 ts_tablet_manager.cc:1398] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20240502 01:58:54.555125 19757 tablet_bootstrap.cc:492] T c7f53fd60e7541f98c0e20f259a86b45 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:54.555466 19757 tablet_bootstrap.cc:492] T c7f53fd60e7541f98c0e20f259a86b45 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap complete.
I20240502 01:58:54.555644 19757 ts_tablet_manager.cc:1367] T c7f53fd60e7541f98c0e20f259a86b45 P d7989bd96de94be4a94995fcfcd6b16b: Time spent bootstrapping tablet: real 0.035s user 0.022s sys 0.006s
I20240502 01:58:54.556094 19757 raft_consensus.cc:348] T c7f53fd60e7541f98c0e20f259a86b45 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:54.556213 19757 raft_consensus.cc:729] T c7f53fd60e7541f98c0e20f259a86b45 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d7989bd96de94be4a94995fcfcd6b16b, State: Initialized, Role: LEARNER
I20240502 01:58:54.556298 19757 consensus_queue.cc:260] T c7f53fd60e7541f98c0e20f259a86b45 P d7989bd96de94be4a94995fcfcd6b16b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:54.556636 19757 ts_tablet_manager.cc:1398] T c7f53fd60e7541f98c0e20f259a86b45 P d7989bd96de94be4a94995fcfcd6b16b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:54.557260 16943 tablet_copy_service.cc:342] P 191fe00ca08b44c9aef6646e86aecebc: Request end of tablet copy session d7989bd96de94be4a94995fcfcd6b16b-c7f53fd60e7541f98c0e20f259a86b45 received from {username='slave'} at 127.10.133.198:43977
I20240502 01:58:54.557343 16943 tablet_copy_service.cc:433] P 191fe00ca08b44c9aef6646e86aecebc: ending tablet copy session d7989bd96de94be4a94995fcfcd6b16b-c7f53fd60e7541f98c0e20f259a86b45 on tablet c7f53fd60e7541f98c0e20f259a86b45 with peer d7989bd96de94be4a94995fcfcd6b16b
I20240502 01:58:54.557696 17079 tablet_copy_service.cc:342] P 6431e35365644aac943c07c97e370fee: Request end of tablet copy session b7ec79239ce64b38a1d55f66a95407c0-086b486997ae4d15a4b070e79552807f received from {username='slave'} at 127.10.133.199:45123
I20240502 01:58:54.557765 17079 tablet_copy_service.cc:433] P 6431e35365644aac943c07c97e370fee: ending tablet copy session b7ec79239ce64b38a1d55f66a95407c0-086b486997ae4d15a4b070e79552807f on tablet 086b486997ae4d15a4b070e79552807f with peer b7ec79239ce64b38a1d55f66a95407c0
I20240502 01:58:54.561447 19050 raft_consensus.cc:1203] T 56450521850a4afbbee4587c351b9ca1 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:54.577843 19782 tablet_bootstrap.cc:492] T 4965b4399f744b67807d2d5361bc1bd5 P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:54.578183 19782 tablet_bootstrap.cc:492] T 4965b4399f744b67807d2d5361bc1bd5 P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap complete.
I20240502 01:58:54.578372 19782 ts_tablet_manager.cc:1367] T 4965b4399f744b67807d2d5361bc1bd5 P b7ec79239ce64b38a1d55f66a95407c0: Time spent bootstrapping tablet: real 0.032s user 0.021s sys 0.006s
I20240502 01:58:54.578855 19782 raft_consensus.cc:348] T 4965b4399f744b67807d2d5361bc1bd5 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:54.578965 19772 tablet_bootstrap.cc:492] T 20f803864ef14f12a5ba3bafa3a3b0c3 P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:54.578994 19782 raft_consensus.cc:729] T 4965b4399f744b67807d2d5361bc1bd5 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b7ec79239ce64b38a1d55f66a95407c0, State: Initialized, Role: LEARNER
I20240502 01:58:54.579108 19782 consensus_queue.cc:260] T 4965b4399f744b67807d2d5361bc1bd5 P b7ec79239ce64b38a1d55f66a95407c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:54.579239 19772 tablet_bootstrap.cc:492] T 20f803864ef14f12a5ba3bafa3a3b0c3 P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap complete.
I20240502 01:58:54.579407 19772 ts_tablet_manager.cc:1367] T 20f803864ef14f12a5ba3bafa3a3b0c3 P b6aa9ef40e50468ca7a9742c21140d24: Time spent bootstrapping tablet: real 0.033s user 0.020s sys 0.004s
I20240502 01:58:54.579427 19782 ts_tablet_manager.cc:1398] T 4965b4399f744b67807d2d5361bc1bd5 P b7ec79239ce64b38a1d55f66a95407c0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:54.580016 17079 tablet_copy_service.cc:342] P 6431e35365644aac943c07c97e370fee: Request end of tablet copy session b7ec79239ce64b38a1d55f66a95407c0-4965b4399f744b67807d2d5361bc1bd5 received from {username='slave'} at 127.10.133.199:45123
I20240502 01:58:54.580106 17079 tablet_copy_service.cc:433] P 6431e35365644aac943c07c97e370fee: ending tablet copy session b7ec79239ce64b38a1d55f66a95407c0-4965b4399f744b67807d2d5361bc1bd5 on tablet 4965b4399f744b67807d2d5361bc1bd5 with peer b7ec79239ce64b38a1d55f66a95407c0
I20240502 01:58:54.580083 19772 raft_consensus.cc:348] T 20f803864ef14f12a5ba3bafa3a3b0c3 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:54.580238 19772 raft_consensus.cc:729] T 20f803864ef14f12a5ba3bafa3a3b0c3 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b6aa9ef40e50468ca7a9742c21140d24, State: Initialized, Role: LEARNER
I20240502 01:58:54.580344 19772 consensus_queue.cc:260] T 20f803864ef14f12a5ba3bafa3a3b0c3 P b6aa9ef40e50468ca7a9742c21140d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:54.580711 19772 ts_tablet_manager.cc:1398] T 20f803864ef14f12a5ba3bafa3a3b0c3 P b6aa9ef40e50468ca7a9742c21140d24: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:54.581306 17214 tablet_copy_service.cc:342] P a1c00c21761540dea7ddae8d0dd26df4: Request end of tablet copy session b6aa9ef40e50468ca7a9742c21140d24-20f803864ef14f12a5ba3bafa3a3b0c3 received from {username='slave'} at 127.10.133.200:44867
I20240502 01:58:54.581424 17214 tablet_copy_service.cc:433] P a1c00c21761540dea7ddae8d0dd26df4: ending tablet copy session b6aa9ef40e50468ca7a9742c21140d24-20f803864ef14f12a5ba3bafa3a3b0c3 on tablet 20f803864ef14f12a5ba3bafa3a3b0c3 with peer b6aa9ef40e50468ca7a9742c21140d24
I20240502 01:58:54.594205 19808 tablet_copy_client.cc:523] T 0a30ab572eff4a1ebabf95be48e178e2 P 436e7859396c42a6b60714873cb60495: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:54.595466 19808 tablet_bootstrap.cc:492] T 0a30ab572eff4a1ebabf95be48e178e2 P 436e7859396c42a6b60714873cb60495: Bootstrap starting.
I20240502 01:58:54.605260 19823 tablet_copy_client.cc:523] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:54.606709 19823 tablet_bootstrap.cc:492] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495: Bootstrap starting.
I20240502 01:58:54.609107 18919 raft_consensus.cc:1203] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:54.618652 19808 tablet_bootstrap.cc:492] T 0a30ab572eff4a1ebabf95be48e178e2 P 436e7859396c42a6b60714873cb60495: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:54.618948 19808 tablet_bootstrap.cc:492] T 0a30ab572eff4a1ebabf95be48e178e2 P 436e7859396c42a6b60714873cb60495: Bootstrap complete.
I20240502 01:58:54.619113 19808 ts_tablet_manager.cc:1367] T 0a30ab572eff4a1ebabf95be48e178e2 P 436e7859396c42a6b60714873cb60495: Time spent bootstrapping tablet: real 0.024s user 0.020s sys 0.004s
I20240502 01:58:54.619539 19808 raft_consensus.cc:348] T 0a30ab572eff4a1ebabf95be48e178e2 P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:58:54.619669 19808 raft_consensus.cc:729] T 0a30ab572eff4a1ebabf95be48e178e2 P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 436e7859396c42a6b60714873cb60495, State: Initialized, Role: LEARNER
I20240502 01:58:54.619784 19808 consensus_queue.cc:260] T 0a30ab572eff4a1ebabf95be48e178e2 P 436e7859396c42a6b60714873cb60495 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:58:54.620096 19808 ts_tablet_manager.cc:1398] T 0a30ab572eff4a1ebabf95be48e178e2 P 436e7859396c42a6b60714873cb60495: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240502 01:58:54.620625 17079 tablet_copy_service.cc:342] P 6431e35365644aac943c07c97e370fee: Request end of tablet copy session 436e7859396c42a6b60714873cb60495-0a30ab572eff4a1ebabf95be48e178e2 received from {username='slave'} at 127.10.133.197:58823
I20240502 01:58:54.620707 17079 tablet_copy_service.cc:433] P 6431e35365644aac943c07c97e370fee: ending tablet copy session 436e7859396c42a6b60714873cb60495-0a30ab572eff4a1ebabf95be48e178e2 on tablet 0a30ab572eff4a1ebabf95be48e178e2 with peer 436e7859396c42a6b60714873cb60495
I20240502 01:58:54.623980 19838 tablet_copy_client.cc:523] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:54.625372 19838 tablet_bootstrap.cc:492] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap starting.
I20240502 01:58:54.629860 19848 tablet_copy_client.cc:523] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:54.631187 19848 tablet_bootstrap.cc:492] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap starting.
I20240502 01:58:54.632300 19823 tablet_bootstrap.cc:492] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:54.632562 19823 tablet_bootstrap.cc:492] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495: Bootstrap complete.
I20240502 01:58:54.632746 19823 ts_tablet_manager.cc:1367] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495: Time spent bootstrapping tablet: real 0.026s user 0.023s sys 0.000s
I20240502 01:58:54.633152 19823 raft_consensus.cc:348] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:58:54.633260 19823 raft_consensus.cc:729] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 436e7859396c42a6b60714873cb60495, State: Initialized, Role: LEARNER
I20240502 01:58:54.633342 19823 consensus_queue.cc:260] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:58:54.633980 19823 ts_tablet_manager.cc:1398] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240502 01:58:54.634227 18652 raft_consensus.cc:1203] T 0a30ab572eff4a1ebabf95be48e178e2 P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:54.634711 16943 tablet_copy_service.cc:342] P 191fe00ca08b44c9aef6646e86aecebc: Request end of tablet copy session 436e7859396c42a6b60714873cb60495-2aeb35a29ea645288fe123b890452936 received from {username='slave'} at 127.10.133.197:36399
I20240502 01:58:54.634799 16943 tablet_copy_service.cc:433] P 191fe00ca08b44c9aef6646e86aecebc: ending tablet copy session 436e7859396c42a6b60714873cb60495-2aeb35a29ea645288fe123b890452936 on tablet 2aeb35a29ea645288fe123b890452936 with peer 436e7859396c42a6b60714873cb60495
I20240502 01:58:54.649528 19868 tablet_copy_client.cc:523] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:54.651012 19868 tablet_bootstrap.cc:492] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap starting.
I20240502 01:58:54.658911 19848 tablet_bootstrap.cc:492] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:54.658977 19838 tablet_bootstrap.cc:492] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:54.659183 19848 tablet_bootstrap.cc:492] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap complete.
I20240502 01:58:54.659229 19838 tablet_bootstrap.cc:492] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap complete.
I20240502 01:58:54.659344 19848 ts_tablet_manager.cc:1367] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24: Time spent bootstrapping tablet: real 0.028s user 0.022s sys 0.002s
I20240502 01:58:54.659389 19838 ts_tablet_manager.cc:1367] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0: Time spent bootstrapping tablet: real 0.034s user 0.021s sys 0.001s
I20240502 01:58:54.659711 19848 raft_consensus.cc:348] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:54.659811 19848 raft_consensus.cc:729] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b6aa9ef40e50468ca7a9742c21140d24, State: Initialized, Role: LEARNER
I20240502 01:58:54.659757 19838 raft_consensus.cc:348] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:54.659869 19838 raft_consensus.cc:729] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b7ec79239ce64b38a1d55f66a95407c0, State: Initialized, Role: LEARNER
I20240502 01:58:54.659896 19848 consensus_queue.cc:260] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:54.660018 19838 consensus_queue.cc:260] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:54.660179 19848 ts_tablet_manager.cc:1398] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:54.660643 17079 tablet_copy_service.cc:342] P 6431e35365644aac943c07c97e370fee: Request end of tablet copy session b6aa9ef40e50468ca7a9742c21140d24-e03fff9bc743475d92ae26b85e7f39ff received from {username='slave'} at 127.10.133.200:46059
I20240502 01:58:54.660717 17079 tablet_copy_service.cc:433] P 6431e35365644aac943c07c97e370fee: ending tablet copy session b6aa9ef40e50468ca7a9742c21140d24-e03fff9bc743475d92ae26b85e7f39ff on tablet e03fff9bc743475d92ae26b85e7f39ff with peer b6aa9ef40e50468ca7a9742c21140d24
I20240502 01:58:54.661058 19838 ts_tablet_manager.cc:1398] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:58:54.666750 17079 tablet_copy_service.cc:342] P 6431e35365644aac943c07c97e370fee: Request end of tablet copy session b7ec79239ce64b38a1d55f66a95407c0-8a386a1fd8ae4d70ae482b3ce958825b received from {username='slave'} at 127.10.133.199:45123
I20240502 01:58:54.666837 17079 tablet_copy_service.cc:433] P 6431e35365644aac943c07c97e370fee: ending tablet copy session b7ec79239ce64b38a1d55f66a95407c0-8a386a1fd8ae4d70ae482b3ce958825b on tablet 8a386a1fd8ae4d70ae482b3ce958825b with peer b7ec79239ce64b38a1d55f66a95407c0
I20240502 01:58:54.670147 19050 raft_consensus.cc:1203] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:54.680747 19868 tablet_bootstrap.cc:492] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:54.681066 19868 tablet_bootstrap.cc:492] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap complete.
I20240502 01:58:54.681301 19868 ts_tablet_manager.cc:1367] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b: Time spent bootstrapping tablet: real 0.030s user 0.022s sys 0.001s
I20240502 01:58:54.681805 19868 raft_consensus.cc:348] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:54.681918 19868 raft_consensus.cc:729] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d7989bd96de94be4a94995fcfcd6b16b, State: Initialized, Role: LEARNER
I20240502 01:58:54.682016 19868 consensus_queue.cc:260] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:54.682299 19868 ts_tablet_manager.cc:1398] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:54.682950 16943 tablet_copy_service.cc:342] P 191fe00ca08b44c9aef6646e86aecebc: Request end of tablet copy session d7989bd96de94be4a94995fcfcd6b16b-df21aa40548c4f49bae79294085c80f4 received from {username='slave'} at 127.10.133.198:43977
I20240502 01:58:54.683044 16943 tablet_copy_service.cc:433] P 191fe00ca08b44c9aef6646e86aecebc: ending tablet copy session d7989bd96de94be4a94995fcfcd6b16b-df21aa40548c4f49bae79294085c80f4 on tablet df21aa40548c4f49bae79294085c80f4 with peer d7989bd96de94be4a94995fcfcd6b16b
I20240502 01:58:54.694499 18785 raft_consensus.cc:1203] T c7f53fd60e7541f98c0e20f259a86b45 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:54.700486 18652 raft_consensus.cc:1203] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:54.722379 19050 raft_consensus.cc:1203] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:54.781234 20528 raft_consensus.cc:1050] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441: attempting to promote NON_VOTER d7989bd96de94be4a94995fcfcd6b16b to VOTER
I20240502 01:58:54.781796 20528 consensus_queue.cc:237] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } }
I20240502 01:58:54.783782 16923 raft_consensus.cc:1261] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:54.784029 18785 raft_consensus.cc:1261] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:54.784346 20528 consensus_queue.cc:1035] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:54.784564 17058 raft_consensus.cc:1261] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:54.784883 19370 consensus_queue.cc:1035] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:54.785182 20528 consensus_queue.cc:1035] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:54.787590 20531 raft_consensus.cc:2932] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:54.787962 16923 raft_consensus.cc:2932] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:54.788290 18785 raft_consensus.cc:2932] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:54.790699 16772 catalog_manager.cc:5484] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:54.792016 17058 raft_consensus.cc:2932] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:54.794616 17324 consensus_queue.cc:237] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } }
I20240502 01:58:54.795619 18785 raft_consensus.cc:1261] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:54.795951 16923 raft_consensus.cc:1261] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:54.796306 20531 consensus_queue.cc:1035] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:54.796494 20528 consensus_queue.cc:1035] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:54.797839 20531 raft_consensus.cc:2932] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:54.798267 16923 raft_consensus.cc:2932] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:54.798480 18785 raft_consensus.cc:2932] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:54.800284 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 7c92206bbd4340d59a7ee7379f581bb7 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:54.800848 16776 catalog_manager.cc:5484] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b reported cstate change: config changed from index 5 to 6, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:54.802923 17039 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c92206bbd4340d59a7ee7379f581bb7 with delete_type TABLET_DATA_TOMBSTONED (TS 6431e35365644aac943c07c97e370fee not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:58394
I20240502 01:58:54.803361 20540 tablet_replica.cc:330] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee: stopping tablet replica
I20240502 01:58:54.803628 20540 raft_consensus.cc:2229] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:54.803804 20540 raft_consensus.cc:2258] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:54.804782 20540 ts_tablet_manager.cc:1875] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:54.806964 20540 ts_tablet_manager.cc:1888] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:54.807045 20540 log.cc:1196] T 7c92206bbd4340d59a7ee7379f581bb7 P 6431e35365644aac943c07c97e370fee: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/7c92206bbd4340d59a7ee7379f581bb7
I20240502 01:58:54.807554 16764 catalog_manager.cc:4830] TS 6431e35365644aac943c07c97e370fee (127.10.133.194:37811): tablet 7c92206bbd4340d59a7ee7379f581bb7 (table rebalance_test_table_4 [id=ed83c8027ba34b24b41cae8d5a7a294c]) successfully deleted
I20240502 01:58:54.821689 18785 raft_consensus.cc:1203] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:54.850279 18652 raft_consensus.cc:1203] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:54.867168 18919 raft_consensus.cc:1203] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:54.924333 20024 raft_consensus.cc:1050] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc: attempting to promote NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 to VOTER
I20240502 01:58:54.924918 20024 consensus_queue.cc:237] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:58:54.927194 17192 raft_consensus.cc:1261] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:54.927654 19389 consensus_queue.cc:1035] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:54.928789 18919 raft_consensus.cc:1261] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:54.929291 17058 raft_consensus.cc:1261] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:54.929304 20544 consensus_queue.cc:1035] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:54.929841 19389 consensus_queue.cc:1035] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:54.931792 19389 raft_consensus.cc:2932] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:54.934489 17193 raft_consensus.cc:2932] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:54.934788 18919 raft_consensus.cc:2932] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:54.935052 16772 catalog_manager.cc:5484] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:54.936568 17058 raft_consensus.cc:2932] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:54.942564 16923 consensus_queue.cc:237] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:58:54.943603 18919 raft_consensus.cc:1261] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:54.943698 17193 raft_consensus.cc:1261] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:54.944005 19389 consensus_queue.cc:1035] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:54.944170 20544 consensus_queue.cc:1035] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:54.945622 20542 raft_consensus.cc:2932] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:54.946143 18919 raft_consensus.cc:2932] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:54.946156 17193 raft_consensus.cc:2932] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:54.947129 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 029dba0050a64bd4adb35e9815450450 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:54.948519 16774 catalog_manager.cc:5484] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 5 to 6, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:54.950600 17039 tablet_service.cc:1514] Processing DeleteTablet for tablet 029dba0050a64bd4adb35e9815450450 with delete_type TABLET_DATA_TOMBSTONED (TS 6431e35365644aac943c07c97e370fee not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:58394
I20240502 01:58:54.950850 20540 tablet_replica.cc:330] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee: stopping tablet replica
I20240502 01:58:54.950997 20540 raft_consensus.cc:2229] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:54.951167 20540 raft_consensus.cc:2258] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:54.951886 20540 ts_tablet_manager.cc:1875] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:54.953619 20540 ts_tablet_manager.cc:1888] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:54.953689 20540 log.cc:1196] T 029dba0050a64bd4adb35e9815450450 P 6431e35365644aac943c07c97e370fee: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/029dba0050a64bd4adb35e9815450450
I20240502 01:58:54.954222 16764 catalog_manager.cc:4830] TS 6431e35365644aac943c07c97e370fee (127.10.133.194:37811): tablet 029dba0050a64bd4adb35e9815450450 (table rebalance_test_table_3 [id=0c4182cf7d98406d87a12a073ef6b915]) successfully deleted
I20240502 01:58:54.956874 20531 raft_consensus.cc:1050] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441: attempting to promote NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 to VOTER
I20240502 01:58:54.957250 20531 consensus_queue.cc:237] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:58:54.958640 17058 raft_consensus.cc:1261] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:54.958752 17193 raft_consensus.cc:1261] T 56450521850a4afbbee4587c351b9ca1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:54.959070 20530 consensus_queue.cc:1035] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:54.959303 19370 consensus_queue.cc:1035] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:54.959343 19050 raft_consensus.cc:1261] T 56450521850a4afbbee4587c351b9ca1 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:54.959404 18919 raft_consensus.cc:1203] T 4965b4399f744b67807d2d5361bc1bd5 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:54.959761 19370 consensus_queue.cc:1035] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:54.962566 19370 raft_consensus.cc:2932] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:54.962999 17058 raft_consensus.cc:2932] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:54.963954 19050 raft_consensus.cc:2932] T 56450521850a4afbbee4587c351b9ca1 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:54.964915 17193 raft_consensus.cc:2932] T 56450521850a4afbbee4587c351b9ca1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:54.965186 16775 catalog_manager.cc:5484] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:54.968355 17325 consensus_queue.cc:237] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:58:54.969640 19050 raft_consensus.cc:1261] T 56450521850a4afbbee4587c351b9ca1 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:54.970306 19370 consensus_queue.cc:1035] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:54.970906 17193 raft_consensus.cc:1261] T 56450521850a4afbbee4587c351b9ca1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:54.971343 20531 consensus_queue.cc:1035] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:54.971920 20531 raft_consensus.cc:2932] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:54.972285 19050 raft_consensus.cc:2932] T 56450521850a4afbbee4587c351b9ca1 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:54.973435 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 56450521850a4afbbee4587c351b9ca1 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:54.974117 17193 raft_consensus.cc:2932] T 56450521850a4afbbee4587c351b9ca1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:54.974362 16775 catalog_manager.cc:5484] T 56450521850a4afbbee4587c351b9ca1 P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index 5 to 6, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:54.976740 17039 tablet_service.cc:1514] Processing DeleteTablet for tablet 56450521850a4afbbee4587c351b9ca1 with delete_type TABLET_DATA_TOMBSTONED (TS 6431e35365644aac943c07c97e370fee not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:58394
I20240502 01:58:54.976951 20540 tablet_replica.cc:330] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee: stopping tablet replica
I20240502 01:58:54.977056 20540 raft_consensus.cc:2229] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:54.977164 20540 raft_consensus.cc:2258] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:54.977843 20540 ts_tablet_manager.cc:1875] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:54.979759 20540 ts_tablet_manager.cc:1888] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:54.979825 20540 log.cc:1196] T 56450521850a4afbbee4587c351b9ca1 P 6431e35365644aac943c07c97e370fee: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/56450521850a4afbbee4587c351b9ca1
I20240502 01:58:54.980228 16764 catalog_manager.cc:4830] TS 6431e35365644aac943c07c97e370fee (127.10.133.194:37811): tablet 56450521850a4afbbee4587c351b9ca1 (table rebalance_test_table_9 [id=dbf980acd7c44315a784f2bc19c4a4a1]) successfully deleted
I20240502 01:58:55.011301 19050 raft_consensus.cc:1203] T 20f803864ef14f12a5ba3bafa3a3b0c3 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:55.040174 19050 raft_consensus.cc:1203] T 58924c2a9bf5433b86985bbde9d9ec33 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:55.047144 20544 raft_consensus.cc:1050] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc: attempting to promote NON_VOTER 436e7859396c42a6b60714873cb60495 to VOTER
I20240502 01:58:55.047590 20544 consensus_queue.cc:237] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:58:55.049052 18652 raft_consensus.cc:1261] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.049284 17058 raft_consensus.cc:1261] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.049595 17325 raft_consensus.cc:1261] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.049675 20024 consensus_queue.cc:1035] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.050045 20542 consensus_queue.cc:1035] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.050235 20024 consensus_queue.cc:1035] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.053720 20024 raft_consensus.cc:2932] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.054646 20544 raft_consensus.cc:1050] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc: attempting to promote NON_VOTER 436e7859396c42a6b60714873cb60495 to VOTER
I20240502 01:58:55.054898 17058 raft_consensus.cc:2932] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.055030 20544 consensus_queue.cc:237] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:58:55.056632 16775 catalog_manager.cc:5484] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:55.056955 17193 raft_consensus.cc:1261] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.057405 17324 raft_consensus.cc:1261] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.057425 20024 consensus_queue.cc:1035] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.058276 18651 raft_consensus.cc:1261] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.058646 17325 raft_consensus.cc:2932] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.060058 16923 consensus_queue.cc:237] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:58:55.061518 20024 consensus_queue.cc:1035] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.063092 18651 raft_consensus.cc:1261] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.063417 20024 consensus_queue.cc:1035] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.063711 20024 consensus_queue.cc:1035] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.063998 18652 raft_consensus.cc:2932] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.066380 17058 raft_consensus.cc:1261] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.066859 20024 consensus_queue.cc:1035] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.067217 20024 raft_consensus.cc:2932] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.067624 18650 raft_consensus.cc:2932] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.067739 20548 raft_consensus.cc:2932] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.069967 17324 raft_consensus.cc:2932] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.070609 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 6fb89894cf594139aecab491957f96c9 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:55.070591 17058 raft_consensus.cc:2932] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.070909 17193 raft_consensus.cc:2932] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.071511 16774 catalog_manager.cc:5484] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 5 to 6, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:55.071823 16774 catalog_manager.cc:5484] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:55.074244 18650 raft_consensus.cc:2932] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.075783 17304 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fb89894cf594139aecab491957f96c9 with delete_type TABLET_DATA_TOMBSTONED (TS ec11d4bb3a064a94a80084142637b441 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:58608
I20240502 01:58:55.076296 20642 tablet_replica.cc:330] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441: stopping tablet replica
I20240502 01:58:55.076658 20642 raft_consensus.cc:2229] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:55.076642 16923 consensus_queue.cc:237] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:58:55.076987 20642 raft_consensus.cc:2258] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:55.077790 17324 raft_consensus.cc:1261] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.078197 20021 raft_consensus.cc:1050] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee: attempting to promote NON_VOTER 436e7859396c42a6b60714873cb60495 to VOTER
I20240502 01:58:55.078238 20542 consensus_queue.cc:1035] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.078626 20021 consensus_queue.cc:237] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:58:55.080360 20642 ts_tablet_manager.cc:1875] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:55.080368 18651 raft_consensus.cc:1261] T 0a30ab572eff4a1ebabf95be48e178e2 P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.080507 18652 raft_consensus.cc:1261] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.080885 20542 consensus_queue.cc:1035] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.081526 20542 raft_consensus.cc:2932] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.082113 20020 consensus_queue.cc:1035] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.082737 20642 ts_tablet_manager.cc:1888] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:55.082815 20642 log.cc:1196] T 6fb89894cf594139aecab491957f96c9 P ec11d4bb3a064a94a80084142637b441: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/6fb89894cf594139aecab491957f96c9
I20240502 01:58:55.083237 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet cc145366c6244010b42a07e961f9636f with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:55.083251 17324 raft_consensus.cc:2932] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.083428 16923 raft_consensus.cc:1261] T 0a30ab572eff4a1ebabf95be48e178e2 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.083863 20020 consensus_queue.cc:1035] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.084327 16773 catalog_manager.cc:5484] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:55.085489 16764 catalog_manager.cc:4830] TS ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135): tablet 6fb89894cf594139aecab491957f96c9 (table rebalance_test_table_0 [id=61315444265f4e1e9a2b3fed3a82c4a5]) successfully deleted
I20240502 01:58:55.085733 17193 raft_consensus.cc:1261] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.086118 20020 consensus_queue.cc:1035] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.086042 18652 raft_consensus.cc:2932] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.087353 17171 tablet_service.cc:1514] Processing DeleteTablet for tablet cc145366c6244010b42a07e961f9636f with delete_type TABLET_DATA_TOMBSTONED (TS a1c00c21761540dea7ddae8d0dd26df4 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:50964
I20240502 01:58:55.087807 20654 tablet_replica.cc:330] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4: stopping tablet replica
I20240502 01:58:55.088160 20654 raft_consensus.cc:2229] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:55.088574 20654 raft_consensus.cc:2258] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:55.089706 20654 ts_tablet_manager.cc:1875] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:55.090040 20643 raft_consensus.cc:2932] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.090463 16923 raft_consensus.cc:2932] T 0a30ab572eff4a1ebabf95be48e178e2 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.090485 18650 raft_consensus.cc:2932] T 0a30ab572eff4a1ebabf95be48e178e2 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.092583 17193 raft_consensus.cc:2932] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.092851 16773 catalog_manager.cc:5484] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:55.093019 20654 ts_tablet_manager.cc:1888] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:55.093091 20654 log.cc:1196] T cc145366c6244010b42a07e961f9636f P a1c00c21761540dea7ddae8d0dd26df4: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/wals/cc145366c6244010b42a07e961f9636f
I20240502 01:58:55.095250 16765 catalog_manager.cc:4830] TS a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923): tablet cc145366c6244010b42a07e961f9636f (table rebalance_test_table_7 [id=a8b80745166a46a9a386a8805718513d]) successfully deleted
I20240502 01:58:55.096230 17058 consensus_queue.cc:237] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:58:55.097383 18650 raft_consensus.cc:1261] T 0a30ab572eff4a1ebabf95be48e178e2 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.097422 16923 raft_consensus.cc:1261] T 0a30ab572eff4a1ebabf95be48e178e2 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.097805 20649 consensus_queue.cc:1035] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.098032 20021 consensus_queue.cc:1035] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.099802 20021 raft_consensus.cc:2932] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.100033 18650 raft_consensus.cc:2932] T 0a30ab572eff4a1ebabf95be48e178e2 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.101274 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 0a30ab572eff4a1ebabf95be48e178e2 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:55.102341 16776 catalog_manager.cc:5484] T 0a30ab572eff4a1ebabf95be48e178e2 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:55.102612 16923 raft_consensus.cc:2932] T 0a30ab572eff4a1ebabf95be48e178e2 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.104843 17171 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a30ab572eff4a1ebabf95be48e178e2 with delete_type TABLET_DATA_TOMBSTONED (TS a1c00c21761540dea7ddae8d0dd26df4 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:50964
I20240502 01:58:55.105906 20541 raft_consensus.cc:1050] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4: attempting to promote NON_VOTER 436e7859396c42a6b60714873cb60495 to VOTER
I20240502 01:58:55.106016 20654 tablet_replica.cc:330] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4: stopping tablet replica
I20240502 01:58:55.106132 20654 raft_consensus.cc:2229] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:55.106259 20654 raft_consensus.cc:2258] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:55.106434 20541 consensus_queue.cc:237] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:58:55.107264 20654 ts_tablet_manager.cc:1875] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:55.107739 18650 raft_consensus.cc:1261] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.108050 17324 raft_consensus.cc:1261] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.108104 20662 consensus_queue.cc:1035] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.108481 16923 raft_consensus.cc:1261] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.108454 20541 consensus_queue.cc:1035] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.109187 20662 consensus_queue.cc:1035] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.109417 20654 ts_tablet_manager.cc:1888] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:55.109520 20654 log.cc:1196] T 0a30ab572eff4a1ebabf95be48e178e2 P a1c00c21761540dea7ddae8d0dd26df4: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/wals/0a30ab572eff4a1ebabf95be48e178e2
I20240502 01:58:55.110050 16765 catalog_manager.cc:4830] TS a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923): tablet 0a30ab572eff4a1ebabf95be48e178e2 (table rebalance_test_table_5 [id=2cbb40e4a59445dc9a1b5b4161e4c646]) successfully deleted
I20240502 01:58:55.110823 20662 raft_consensus.cc:2932] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.111330 17324 raft_consensus.cc:2932] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.112574 16923 raft_consensus.cc:2932] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.113456 18650 raft_consensus.cc:2932] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.114979 16775 catalog_manager.cc:5484] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:55.119964 17193 consensus_queue.cc:237] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:58:55.121235 17324 raft_consensus.cc:1261] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.121582 20541 consensus_queue.cc:1035] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.121933 18650 raft_consensus.cc:1261] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.122330 20663 consensus_queue.cc:1035] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.123070 20541 raft_consensus.cc:2932] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.124123 18650 raft_consensus.cc:2932] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.124682 17325 raft_consensus.cc:2932] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.126547 16773 catalog_manager.cc:5484] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:55.127051 16765 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet a475490b83164ff3930aae5978e7845e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:55.128932 16901 tablet_service.cc:1514] Processing DeleteTablet for tablet a475490b83164ff3930aae5978e7845e with delete_type TABLET_DATA_TOMBSTONED (TS 191fe00ca08b44c9aef6646e86aecebc not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:40018
I20240502 01:58:55.129460 20672 tablet_replica.cc:330] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc: stopping tablet replica
I20240502 01:58:55.129734 20672 raft_consensus.cc:2229] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:55.129938 20672 raft_consensus.cc:2258] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:55.131148 20672 ts_tablet_manager.cc:1875] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:55.132491 18919 raft_consensus.cc:1203] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:55.135136 20672 ts_tablet_manager.cc:1888] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:55.135210 20672 log.cc:1196] T a475490b83164ff3930aae5978e7845e P 191fe00ca08b44c9aef6646e86aecebc: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/a475490b83164ff3930aae5978e7845e
I20240502 01:58:55.135732 16764 catalog_manager.cc:4830] TS 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571): tablet a475490b83164ff3930aae5978e7845e (table rebalance_test_table_4 [id=ed83c8027ba34b24b41cae8d5a7a294c]) successfully deleted
I20240502 01:58:55.140444 20530 raft_consensus.cc:1050] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441: attempting to promote NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 to VOTER
I20240502 01:58:55.140846 20530 consensus_queue.cc:237] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:58:55.142185 18919 raft_consensus.cc:1261] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.142232 16923 raft_consensus.cc:1261] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.142587 20531 consensus_queue.cc:1035] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.143265 17058 raft_consensus.cc:1261] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.143725 20528 consensus_queue.cc:1035] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.143937 16923 consensus_queue.cc:237] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:55.144028 20528 consensus_queue.cc:1035] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.145278 17193 raft_consensus.cc:1261] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:55.145450 17325 raft_consensus.cc:1261] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:55.145665 19389 consensus_queue.cc:1035] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:55.145849 20544 consensus_queue.cc:1035] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:55.146989 20530 raft_consensus.cc:2932] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.147440 17058 raft_consensus.cc:2932] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.147755 20544 raft_consensus.cc:2932] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:58:55.149405 17193 raft_consensus.cc:2932] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:58:55.149736 17325 raft_consensus.cc:2932] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:58:55.149761 18919 raft_consensus.cc:2932] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.150508 16776 catalog_manager.cc:5484] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:55.151309 16923 raft_consensus.cc:2932] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.151824 16775 catalog_manager.cc:5484] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.156725 17325 consensus_queue.cc:237] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:58:55.158125 18919 raft_consensus.cc:1261] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.158537 19370 consensus_queue.cc:1035] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.158599 17058 raft_consensus.cc:1261] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.160145 20528 consensus_queue.cc:1035] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.160640 20528 raft_consensus.cc:2932] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
W20240502 01:58:55.161135 16859 consensus_peers.cc:485] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc -> Peer b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200:46021): Couldn't send request to peer b6aa9ef40e50468ca7a9742c21140d24. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2162035e4ed4433fafcc49934be62a9c. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:55.161809 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 64b3111c603247ac8ff4a1eb9369086f with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:55.162640 18919 raft_consensus.cc:2932] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.162923 17058 raft_consensus.cc:2932] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.164366 16774 catalog_manager.cc:5484] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:55.166682 16901 tablet_service.cc:1514] Processing DeleteTablet for tablet 64b3111c603247ac8ff4a1eb9369086f with delete_type TABLET_DATA_TOMBSTONED (TS 191fe00ca08b44c9aef6646e86aecebc not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:40018
I20240502 01:58:55.166930 20672 tablet_replica.cc:330] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc: stopping tablet replica
I20240502 01:58:55.167075 20672 raft_consensus.cc:2229] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:55.167214 20672 raft_consensus.cc:2258] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:55.167919 20672 ts_tablet_manager.cc:1875] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:55.169924 20672 ts_tablet_manager.cc:1888] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:55.170023 20672 log.cc:1196] T 64b3111c603247ac8ff4a1eb9369086f P 191fe00ca08b44c9aef6646e86aecebc: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/64b3111c603247ac8ff4a1eb9369086f
I20240502 01:58:55.170507 16764 catalog_manager.cc:4830] TS 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571): tablet 64b3111c603247ac8ff4a1eb9369086f (table rebalance_test_table_8 [id=cd393e2f31fe436b87329907984e9dcd]) successfully deleted
I20240502 01:58:55.224907 20024 raft_consensus.cc:1050] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc: attempting to promote NON_VOTER d7989bd96de94be4a94995fcfcd6b16b to VOTER
I20240502 01:58:55.225339 20024 consensus_queue.cc:237] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } }
I20240502 01:58:55.226794 17193 raft_consensus.cc:1261] T c7f53fd60e7541f98c0e20f259a86b45 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.227152 19389 consensus_queue.cc:1035] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.227329 18785 raft_consensus.cc:1261] T c7f53fd60e7541f98c0e20f259a86b45 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.227736 19389 consensus_queue.cc:1035] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.228435 17325 raft_consensus.cc:1261] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.229130 19389 consensus_queue.cc:1035] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.230137 20544 raft_consensus.cc:2932] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.230461 18785 raft_consensus.cc:2932] T c7f53fd60e7541f98c0e20f259a86b45 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.231509 17325 raft_consensus.cc:2932] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.232069 17193 raft_consensus.cc:2932] T c7f53fd60e7541f98c0e20f259a86b45 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.233203 16776 catalog_manager.cc:5484] T c7f53fd60e7541f98c0e20f259a86b45 P d7989bd96de94be4a94995fcfcd6b16b reported cstate change: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.235466 18785 raft_consensus.cc:1203] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:55.237643 16923 consensus_queue.cc:237] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } }
I20240502 01:58:55.238690 18785 raft_consensus.cc:1261] T c7f53fd60e7541f98c0e20f259a86b45 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.238806 17193 raft_consensus.cc:1261] T c7f53fd60e7541f98c0e20f259a86b45 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.239176 20544 consensus_queue.cc:1035] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.239420 19389 consensus_queue.cc:1035] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.241391 20544 raft_consensus.cc:2932] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.241740 17193 raft_consensus.cc:2932] T c7f53fd60e7541f98c0e20f259a86b45 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.241798 18785 raft_consensus.cc:2932] T c7f53fd60e7541f98c0e20f259a86b45 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.242913 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet c7f53fd60e7541f98c0e20f259a86b45 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:55.243927 16773 catalog_manager.cc:5484] T c7f53fd60e7541f98c0e20f259a86b45 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 5 to 6, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:55.246402 17304 tablet_service.cc:1514] Processing DeleteTablet for tablet c7f53fd60e7541f98c0e20f259a86b45 with delete_type TABLET_DATA_TOMBSTONED (TS ec11d4bb3a064a94a80084142637b441 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:58608
I20240502 01:58:55.247023 20642 tablet_replica.cc:330] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441: stopping tablet replica
I20240502 01:58:55.247184 20642 raft_consensus.cc:2229] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:55.247327 20642 raft_consensus.cc:2258] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:55.247921 20643 raft_consensus.cc:1050] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee: attempting to promote NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 to VOTER
I20240502 01:58:55.248009 20642 ts_tablet_manager.cc:1875] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:55.248332 20643 consensus_queue.cc:237] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:58:55.250036 17325 raft_consensus.cc:1261] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.250278 20642 ts_tablet_manager.cc:1888] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:55.250342 20642 log.cc:1196] T c7f53fd60e7541f98c0e20f259a86b45 P ec11d4bb3a064a94a80084142637b441: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/c7f53fd60e7541f98c0e20f259a86b45
I20240502 01:58:55.250447 19050 raft_consensus.cc:1261] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.250429 20021 consensus_queue.cc:1035] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.250871 16764 catalog_manager.cc:4830] TS ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135): tablet c7f53fd60e7541f98c0e20f259a86b45 (table rebalance_test_table_8 [id=cd393e2f31fe436b87329907984e9dcd]) successfully deleted
I20240502 01:58:55.251163 20021 consensus_queue.cc:1035] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.251235 17193 raft_consensus.cc:1261] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.251590 20021 consensus_queue.cc:1035] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.253593 20650 raft_consensus.cc:2932] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.254050 17192 raft_consensus.cc:2932] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.254492 19050 raft_consensus.cc:2932] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.256632 17325 raft_consensus.cc:2932] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.258239 16774 catalog_manager.cc:5484] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.274904 20020 raft_consensus.cc:1050] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee: attempting to promote NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 to VOTER
I20240502 01:58:55.275277 20020 consensus_queue.cc:237] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:58:55.276597 17325 raft_consensus.cc:1261] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.276633 17192 raft_consensus.cc:1261] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.276964 20021 consensus_queue.cc:1035] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.277230 18919 raft_consensus.cc:1261] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.277607 20021 consensus_queue.cc:1035] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.277802 20649 consensus_queue.cc:1035] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.279614 20643 raft_consensus.cc:2932] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.279956 17325 raft_consensus.cc:2932] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.281311 17192 raft_consensus.cc:2932] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.281384 18919 raft_consensus.cc:2932] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.282372 16775 catalog_manager.cc:5484] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:55.287964 17325 consensus_queue.cc:237] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:58:55.289207 17192 raft_consensus.cc:1261] T c9240a82777b44648966e18a616fdfa2 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:55.289822 20530 consensus_queue.cc:1035] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:55.289896 17059 raft_consensus.cc:1261] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:55.290300 20530 consensus_queue.cc:1035] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:55.291486 20531 raft_consensus.cc:2932] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:58:55.292389 17059 raft_consensus.cc:2932] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
W20240502 01:58:55.293339 17260 consensus_peers.cc:485] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 -> Peer 436e7859396c42a6b60714873cb60495 (127.10.133.197:45213): Couldn't send request to peer 436e7859396c42a6b60714873cb60495. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c9240a82777b44648966e18a616fdfa2. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:55.293947 17192 raft_consensus.cc:2932] T c9240a82777b44648966e18a616fdfa2 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:58:55.294343 16775 catalog_manager.cc:5484] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index -1 to 4, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:55.295807 20024 raft_consensus.cc:1050] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc: attempting to promote NON_VOTER d7989bd96de94be4a94995fcfcd6b16b to VOTER
I20240502 01:58:55.296211 20024 consensus_queue.cc:237] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } }
I20240502 01:58:55.297674 17325 raft_consensus.cc:1261] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.298045 20649 raft_consensus.cc:1050] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee: attempting to promote NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 to VOTER
I20240502 01:58:55.298081 19389 consensus_queue.cc:1035] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.298427 20649 consensus_queue.cc:237] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:58:55.299690 17192 raft_consensus.cc:1261] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.300024 17325 raft_consensus.cc:1261] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.300158 20649 consensus_queue.cc:1035] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.300431 20649 consensus_queue.cc:1035] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.302258 18785 raft_consensus.cc:1261] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.302640 19389 consensus_queue.cc:1035] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.303342 17059 raft_consensus.cc:1261] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.303433 19050 raft_consensus.cc:1261] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.303750 19389 consensus_queue.cc:1035] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.304957 20021 consensus_queue.cc:1035] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.305296 20643 raft_consensus.cc:2932] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.306144 20548 raft_consensus.cc:2932] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.307577 19050 raft_consensus.cc:2932] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.307756 17325 raft_consensus.cc:2932] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.308542 16773 catalog_manager.cc:5484] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:55.309772 16776 catalog_manager.cc:5484] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:55.310474 17059 raft_consensus.cc:2932] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.311677 17192 raft_consensus.cc:2932] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.312556 18785 raft_consensus.cc:2932] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.313129 16923 consensus_queue.cc:237] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } }
I20240502 01:58:55.315114 17325 raft_consensus.cc:2932] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.317123 17059 raft_consensus.cc:1261] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.317433 18785 raft_consensus.cc:1261] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.317808 19389 consensus_queue.cc:1035] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.317974 20544 consensus_queue.cc:1035] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.319653 20024 raft_consensus.cc:2932] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.320047 17059 raft_consensus.cc:2932] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.320569 18785 raft_consensus.cc:2932] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.321144 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet adf06dd039c4433890e31c1ad9b44e98 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:55.322515 16775 catalog_manager.cc:5484] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 5 to 6, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.324445 17304 tablet_service.cc:1514] Processing DeleteTablet for tablet adf06dd039c4433890e31c1ad9b44e98 with delete_type TABLET_DATA_TOMBSTONED (TS ec11d4bb3a064a94a80084142637b441 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:58608
I20240502 01:58:55.324680 20642 tablet_replica.cc:330] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441: stopping tablet replica
I20240502 01:58:55.324816 20642 raft_consensus.cc:2229] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:55.324965 20642 raft_consensus.cc:2258] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:55.325704 20642 ts_tablet_manager.cc:1875] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:55.327383 20642 ts_tablet_manager.cc:1888] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:55.327482 20642 log.cc:1196] T adf06dd039c4433890e31c1ad9b44e98 P ec11d4bb3a064a94a80084142637b441: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/adf06dd039c4433890e31c1ad9b44e98
I20240502 01:58:55.327939 16764 catalog_manager.cc:4830] TS ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135): tablet adf06dd039c4433890e31c1ad9b44e98 (table rebalance_test_table_6 [id=3b1319b666dc429cb0d33c9c55b7266e]) successfully deleted
I20240502 01:58:55.328354 17192 consensus_queue.cc:237] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:55.329720 16923 raft_consensus.cc:1261] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:55.329730 17325 raft_consensus.cc:1261] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:55.330091 20662 consensus_queue.cc:1035] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:55.330255 20541 consensus_queue.cc:1035] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:55.331985 20663 raft_consensus.cc:2932] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:55.332429 17325 raft_consensus.cc:2932] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:55.332504 16923 raft_consensus.cc:2932] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
W20240502 01:58:55.334303 17126 consensus_peers.cc:485] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 -> Peer d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198:45549): Couldn't send request to peer d7989bd96de94be4a94995fcfcd6b16b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86c8e4b2177946de9d18d4ef657da4be. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:55.335049 16774 catalog_manager.cc:5484] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:55.342455 17059 consensus_queue.cc:237] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:55.343575 17192 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:55.343606 17325 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 01:58:55.343861 16991 consensus_peers.cc:485] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee -> Peer b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199:34045): Couldn't send request to peer b7ec79239ce64b38a1d55f66a95407c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d9de883c491f43378a26c5a370062555. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:55.343912 20020 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:55.344056 20650 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:55.345619 20650 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:55.346030 17325 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:55.346387 17192 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:55.348337 16775 catalog_manager.cc:5484] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:55.355032 17192 consensus_queue.cc:237] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:55.356190 17059 raft_consensus.cc:1261] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:55.356364 16923 raft_consensus.cc:1261] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 01:58:55.356396 17126 consensus_peers.cc:485] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 -> Peer d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198:45549): Couldn't send request to peer d7989bd96de94be4a94995fcfcd6b16b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 47f0db0b9b7744758b9ca7f1e797bdb0. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:55.356563 20662 consensus_queue.cc:1035] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:55.356737 20022 consensus_queue.cc:1035] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:55.358388 20022 raft_consensus.cc:2932] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:55.358844 17059 raft_consensus.cc:2932] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:55.359253 16923 raft_consensus.cc:2932] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:55.361392 16776 catalog_manager.cc:5484] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:55.368057 16923 consensus_queue.cc:237] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:55.369299 17059 raft_consensus.cc:1261] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 01:58:55.369515 16858 consensus_peers.cc:485] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc -> Peer b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199:34045): Couldn't send request to peer b7ec79239ce64b38a1d55f66a95407c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe3333c0dfe048fda6cfc8b12bf0d5a9. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:55.369540 17192 raft_consensus.cc:1261] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:55.369637 20024 consensus_queue.cc:1035] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:55.369939 19389 consensus_queue.cc:1035] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:55.371086 19389 raft_consensus.cc:1050] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc: attempting to promote NON_VOTER 436e7859396c42a6b60714873cb60495 to VOTER
I20240502 01:58:55.371454 19389 consensus_queue.cc:237] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:58:55.372015 20024 raft_consensus.cc:2932] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:55.372807 18650 raft_consensus.cc:1261] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.373247 20542 consensus_queue.cc:1035] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.373457 17193 raft_consensus.cc:1261] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.373790 17193 raft_consensus.cc:2932] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:55.374035 20542 consensus_queue.cc:1035] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.374132 17058 raft_consensus.cc:1261] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.374545 17059 raft_consensus.cc:2932] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:55.375466 20024 consensus_queue.cc:1035] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.376013 16774 catalog_manager.cc:5484] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:55.380697 20544 raft_consensus.cc:2932] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.381170 17193 raft_consensus.cc:2932] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.382491 17059 raft_consensus.cc:2932] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.382795 18650 raft_consensus.cc:2932] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.384934 16776 catalog_manager.cc:5484] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.388012 16923 consensus_queue.cc:237] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:58:55.389003 17059 raft_consensus.cc:1261] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.389147 18650 raft_consensus.cc:1261] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.389358 20542 consensus_queue.cc:1035] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.389792 20542 consensus_queue.cc:1035] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.390908 20544 raft_consensus.cc:2932] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.392148 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 2aeb35a29ea645288fe123b890452936 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:55.392277 18650 raft_consensus.cc:2932] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.393157 17059 raft_consensus.cc:2932] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:55.393568 16776 catalog_manager.cc:5484] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:55.395915 17171 tablet_service.cc:1514] Processing DeleteTablet for tablet 2aeb35a29ea645288fe123b890452936 with delete_type TABLET_DATA_TOMBSTONED (TS a1c00c21761540dea7ddae8d0dd26df4 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:50964
I20240502 01:58:55.396119 20654 tablet_replica.cc:330] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4: stopping tablet replica
I20240502 01:58:55.396261 20654 raft_consensus.cc:2229] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:55.396416 20654 raft_consensus.cc:2258] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:55.397210 20654 ts_tablet_manager.cc:1875] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:55.398981 20654 ts_tablet_manager.cc:1888] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:55.399060 20654 log.cc:1196] T 2aeb35a29ea645288fe123b890452936 P a1c00c21761540dea7ddae8d0dd26df4: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/wals/2aeb35a29ea645288fe123b890452936
I20240502 01:58:55.399510 16765 catalog_manager.cc:4830] TS a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923): tablet 2aeb35a29ea645288fe123b890452936 (table rebalance_test_table_8 [id=cd393e2f31fe436b87329907984e9dcd]) successfully deleted
I20240502 01:58:55.427604 17059 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e03fff9bc743475d92ae26b85e7f39ff"
dest_uuid: "6431e35365644aac943c07c97e370fee"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:52346
I20240502 01:58:55.427770 17059 raft_consensus.cc:595] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Received request to transfer leadership
I20240502 01:58:55.445520 20643 raft_consensus.cc:1050] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee: attempting to promote NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 to VOTER
I20240502 01:58:55.445950 20643 consensus_queue.cc:237] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:58:55.447643 18919 raft_consensus.cc:1261] T 4965b4399f744b67807d2d5361bc1bd5 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.447821 17325 raft_consensus.cc:1261] T 4965b4399f744b67807d2d5361bc1bd5 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.448248 20649 consensus_queue.cc:1035] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.448396 20650 consensus_queue.cc:1035] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.449618 16923 raft_consensus.cc:1261] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.450233 20020 consensus_queue.cc:1035] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.450974 20649 raft_consensus.cc:2932] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.452962 18919 raft_consensus.cc:2932] T 4965b4399f744b67807d2d5361bc1bd5 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.453271 17325 raft_consensus.cc:2932] T 4965b4399f744b67807d2d5361bc1bd5 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.455482 16923 raft_consensus.cc:2932] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.455972 16776 catalog_manager.cc:5484] T 4965b4399f744b67807d2d5361bc1bd5 P b7ec79239ce64b38a1d55f66a95407c0 reported cstate change: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.461457 17059 consensus_queue.cc:237] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:58:55.462446 18919 raft_consensus.cc:1261] T 4965b4399f744b67807d2d5361bc1bd5 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.463215 17325 raft_consensus.cc:1261] T 4965b4399f744b67807d2d5361bc1bd5 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.463533 20650 consensus_queue.cc:1035] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.464560 20650 consensus_queue.cc:1035] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.465116 20643 raft_consensus.cc:2932] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.465888 18919 raft_consensus.cc:2932] T 4965b4399f744b67807d2d5361bc1bd5 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.466578 17325 raft_consensus.cc:2932] T 4965b4399f744b67807d2d5361bc1bd5 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.466801 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 4965b4399f744b67807d2d5361bc1bd5 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:55.468250 16775 catalog_manager.cc:5484] T 4965b4399f744b67807d2d5361bc1bd5 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:55.470688 16901 tablet_service.cc:1514] Processing DeleteTablet for tablet 4965b4399f744b67807d2d5361bc1bd5 with delete_type TABLET_DATA_TOMBSTONED (TS 191fe00ca08b44c9aef6646e86aecebc not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:40018
I20240502 01:58:55.470912 20672 tablet_replica.cc:330] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc: stopping tablet replica
I20240502 01:58:55.471055 20672 raft_consensus.cc:2229] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:55.471212 20672 raft_consensus.cc:2258] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:55.471845 20672 ts_tablet_manager.cc:1875] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:55.473592 20672 ts_tablet_manager.cc:1888] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:55.473670 20672 log.cc:1196] T 4965b4399f744b67807d2d5361bc1bd5 P 191fe00ca08b44c9aef6646e86aecebc: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/4965b4399f744b67807d2d5361bc1bd5
I20240502 01:58:55.474225 16764 catalog_manager.cc:4830] TS 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571): tablet 4965b4399f744b67807d2d5361bc1bd5 (table rebalance_test_table_2 [id=e2d3cd2117a14964a0bc535eca4d5850]) successfully deleted
I20240502 01:58:55.487321 17059 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "086b486997ae4d15a4b070e79552807f"
dest_uuid: "6431e35365644aac943c07c97e370fee"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:52412
I20240502 01:58:55.487440 17059 raft_consensus.cc:595] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Received request to transfer leadership
I20240502 01:58:55.491267 20541 raft_consensus.cc:1050] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4: attempting to promote NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 to VOTER
I20240502 01:58:55.491693 20541 consensus_queue.cc:237] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:58:55.492977 19050 raft_consensus.cc:1261] T 20f803864ef14f12a5ba3bafa3a3b0c3 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.493114 16923 raft_consensus.cc:1261] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.493140 17325 raft_consensus.cc:1261] T 20f803864ef14f12a5ba3bafa3a3b0c3 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.493620 20663 consensus_queue.cc:1035] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.494184 20662 consensus_queue.cc:1035] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.494506 20022 consensus_queue.cc:1035] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.497319 20022 raft_consensus.cc:2932] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.497771 17325 raft_consensus.cc:2932] T 20f803864ef14f12a5ba3bafa3a3b0c3 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.499291 16923 raft_consensus.cc:2932] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.499353 19050 raft_consensus.cc:2932] T 20f803864ef14f12a5ba3bafa3a3b0c3 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.500967 16774 catalog_manager.cc:5484] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:55.504917 17193 consensus_queue.cc:237] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:58:55.506116 17325 raft_consensus.cc:1261] T 20f803864ef14f12a5ba3bafa3a3b0c3 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.506238 19050 raft_consensus.cc:1261] T 20f803864ef14f12a5ba3bafa3a3b0c3 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.506546 20541 consensus_queue.cc:1035] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.506714 20662 consensus_queue.cc:1035] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.508083 20541 raft_consensus.cc:2932] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.508611 17325 raft_consensus.cc:2932] T 20f803864ef14f12a5ba3bafa3a3b0c3 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.508674 19050 raft_consensus.cc:2932] T 20f803864ef14f12a5ba3bafa3a3b0c3 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.509539 16765 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 20f803864ef14f12a5ba3bafa3a3b0c3 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:55.510982 16775 catalog_manager.cc:5484] T 20f803864ef14f12a5ba3bafa3a3b0c3 P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:55.513235 16901 tablet_service.cc:1514] Processing DeleteTablet for tablet 20f803864ef14f12a5ba3bafa3a3b0c3 with delete_type TABLET_DATA_TOMBSTONED (TS 191fe00ca08b44c9aef6646e86aecebc not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:40018
I20240502 01:58:55.513435 20672 tablet_replica.cc:330] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc: stopping tablet replica
I20240502 01:58:55.513589 20672 raft_consensus.cc:2229] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:55.513758 20672 raft_consensus.cc:2258] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:55.514422 20672 ts_tablet_manager.cc:1875] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:55.516315 20672 ts_tablet_manager.cc:1888] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:55.516376 20672 log.cc:1196] T 20f803864ef14f12a5ba3bafa3a3b0c3 P 191fe00ca08b44c9aef6646e86aecebc: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/20f803864ef14f12a5ba3bafa3a3b0c3
I20240502 01:58:55.516865 16764 catalog_manager.cc:4830] TS 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571): tablet 20f803864ef14f12a5ba3bafa3a3b0c3 (table rebalance_test_table_6 [id=3b1319b666dc429cb0d33c9c55b7266e]) successfully deleted
I20240502 01:58:55.524145 17325 consensus_queue.cc:237] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:55.525396 17193 raft_consensus.cc:1261] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:55.525476 17059 raft_consensus.cc:1261] T 0429b2d6357546f48b422810148fdce1 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 01:58:55.525661 17259 consensus_peers.cc:485] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 -> Peer d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198:45549): Couldn't send request to peer d7989bd96de94be4a94995fcfcd6b16b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0429b2d6357546f48b422810148fdce1. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:55.525866 20530 consensus_queue.cc:1035] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:55.526026 20528 consensus_queue.cc:1035] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:55.527599 19370 raft_consensus.cc:2932] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:55.529011 17059 raft_consensus.cc:2932] T 0429b2d6357546f48b422810148fdce1 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:55.529119 17193 raft_consensus.cc:2932] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:55.529609 16773 catalog_manager.cc:5484] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:55.564854 20020 raft_consensus.cc:1050] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee: attempting to promote NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 to VOTER
I20240502 01:58:55.565264 20020 consensus_queue.cc:237] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:58:55.566879 17193 raft_consensus.cc:1261] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.566977 17325 raft_consensus.cc:1261] T 58924c2a9bf5433b86985bbde9d9ec33 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.567225 20650 consensus_queue.cc:1035] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.567384 20643 consensus_queue.cc:1035] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.567461 19050 raft_consensus.cc:1261] T 58924c2a9bf5433b86985bbde9d9ec33 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.568632 20643 consensus_queue.cc:1035] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.570307 20650 raft_consensus.cc:2932] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.570942 17325 raft_consensus.cc:2932] T 58924c2a9bf5433b86985bbde9d9ec33 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.572366 17193 raft_consensus.cc:2932] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.573503 16773 catalog_manager.cc:5484] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:55.575480 17059 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e03fff9bc743475d92ae26b85e7f39ff"
dest_uuid: "6431e35365644aac943c07c97e370fee"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:52446
I20240502 01:58:55.575393 19050 raft_consensus.cc:2932] T 58924c2a9bf5433b86985bbde9d9ec33 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.575599 17059 raft_consensus.cc:595] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Received request to transfer leadership
I20240502 01:58:55.578477 17059 consensus_queue.cc:237] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:58:55.579660 19050 raft_consensus.cc:1261] T 58924c2a9bf5433b86985bbde9d9ec33 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.579744 17325 raft_consensus.cc:1261] T 58924c2a9bf5433b86985bbde9d9ec33 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.580055 20649 consensus_queue.cc:1035] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.580374 20649 consensus_queue.cc:1035] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.581534 20021 raft_consensus.cc:2932] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.582152 19050 raft_consensus.cc:2932] T 58924c2a9bf5433b86985bbde9d9ec33 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.582569 17325 raft_consensus.cc:2932] T 58924c2a9bf5433b86985bbde9d9ec33 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.583047 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 58924c2a9bf5433b86985bbde9d9ec33 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:55.585006 16776 catalog_manager.cc:5484] T 58924c2a9bf5433b86985bbde9d9ec33 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:55.587381 17171 tablet_service.cc:1514] Processing DeleteTablet for tablet 58924c2a9bf5433b86985bbde9d9ec33 with delete_type TABLET_DATA_TOMBSTONED (TS a1c00c21761540dea7ddae8d0dd26df4 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:50964
I20240502 01:58:55.587579 20654 tablet_replica.cc:330] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4: stopping tablet replica
I20240502 01:58:55.587721 20654 raft_consensus.cc:2229] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:55.587884 20654 raft_consensus.cc:2258] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:55.588503 20654 ts_tablet_manager.cc:1875] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:55.590420 20654 ts_tablet_manager.cc:1888] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:55.590502 20654 log.cc:1196] T 58924c2a9bf5433b86985bbde9d9ec33 P a1c00c21761540dea7ddae8d0dd26df4: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/wals/58924c2a9bf5433b86985bbde9d9ec33
I20240502 01:58:55.591004 16765 catalog_manager.cc:4830] TS a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923): tablet 58924c2a9bf5433b86985bbde9d9ec33 (table rebalance_test_table_7 [id=a8b80745166a46a9a386a8805718513d]) successfully deleted
I20240502 01:58:55.610498 17059 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "086b486997ae4d15a4b070e79552807f"
dest_uuid: "6431e35365644aac943c07c97e370fee"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:52506
I20240502 01:58:55.610613 17059 raft_consensus.cc:595] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Received request to transfer leadership
I20240502 01:58:55.628192 17325 consensus_queue.cc:237] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:55.629601 17193 raft_consensus.cc:1261] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 01:58:55.629806 17261 consensus_peers.cc:485] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 -> Peer b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200:46021): Couldn't send request to peer b6aa9ef40e50468ca7a9742c21140d24. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 787b9b0227da4dd08df5aeb37f0d0468. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:55.630168 16923 raft_consensus.cc:1261] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:55.630213 19370 consensus_queue.cc:1035] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:55.630685 19370 consensus_queue.cc:1035] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:55.632015 20528 raft_consensus.cc:2932] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:58:55.632692 17193 raft_consensus.cc:2932] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:58:55.632885 16923 raft_consensus.cc:2932] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:58:55.635365 16775 catalog_manager.cc:5484] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index -1 to 4, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:58:55.642151 21051 ts_tablet_manager.cc:902] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24: Initiating tablet copy from peer 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:55.642654 21051 tablet_copy_client.cc:308] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:45571
I20240502 01:58:55.643366 17059 consensus_queue.cc:237] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:55.644690 16923 raft_consensus.cc:1261] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:55.644695 17193 raft_consensus.cc:1261] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 01:58:55.644801 16991 consensus_peers.cc:485] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee -> Peer b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199:34045): Couldn't send request to peer b7ec79239ce64b38a1d55f66a95407c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7d9d4310df14878a5ae4167c5320e3a. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:55.645084 20649 consensus_queue.cc:1035] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:55.645248 20020 consensus_queue.cc:1035] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:55.646956 20643 raft_consensus.cc:2932] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:55.647512 17193 raft_consensus.cc:2932] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:55.647611 16923 raft_consensus.cc:2932] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:58:55.649520 16773 catalog_manager.cc:5484] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index -1 to 4, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:55.656841 16943 tablet_copy_service.cc:140] P 191fe00ca08b44c9aef6646e86aecebc: Received BeginTabletCopySession request for tablet 2162035e4ed4433fafcc49934be62a9c from peer b6aa9ef40e50468ca7a9742c21140d24 ({username='slave'} at 127.10.133.200:33817)
I20240502 01:58:55.656945 16943 tablet_copy_service.cc:161] P 191fe00ca08b44c9aef6646e86aecebc: Beginning new tablet copy session on tablet 2162035e4ed4433fafcc49934be62a9c from peer b6aa9ef40e50468ca7a9742c21140d24 at {username='slave'} at 127.10.133.200:33817: session id = b6aa9ef40e50468ca7a9742c21140d24-2162035e4ed4433fafcc49934be62a9c
I20240502 01:58:55.657938 16943 tablet_copy_source_session.cc:205] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:55.659433 21051 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2162035e4ed4433fafcc49934be62a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:55.663266 21051 tablet_copy_client.cc:783] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:55.663508 21051 tablet_copy_client.cc:647] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:55.664434 21060 tablet_copy_client.cc:1002] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:55.692528 21101 ts_tablet_manager.cc:902] T c9240a82777b44648966e18a616fdfa2 P 436e7859396c42a6b60714873cb60495: Initiating tablet copy from peer ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:55.693145 21101 tablet_copy_client.cc:308] T c9240a82777b44648966e18a616fdfa2 P 436e7859396c42a6b60714873cb60495: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.196:38135
I20240502 01:58:55.696909 17346 tablet_copy_service.cc:140] P ec11d4bb3a064a94a80084142637b441: Received BeginTabletCopySession request for tablet c9240a82777b44648966e18a616fdfa2 from peer 436e7859396c42a6b60714873cb60495 ({username='slave'} at 127.10.133.197:57723)
I20240502 01:58:55.697017 17346 tablet_copy_service.cc:161] P ec11d4bb3a064a94a80084142637b441: Beginning new tablet copy session on tablet c9240a82777b44648966e18a616fdfa2 from peer 436e7859396c42a6b60714873cb60495 at {username='slave'} at 127.10.133.197:57723: session id = 436e7859396c42a6b60714873cb60495-c9240a82777b44648966e18a616fdfa2
I20240502 01:58:55.698035 17346 tablet_copy_source_session.cc:205] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:55.698925 21101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c9240a82777b44648966e18a616fdfa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:55.701062 21101 tablet_copy_client.cc:783] T c9240a82777b44648966e18a616fdfa2 P 436e7859396c42a6b60714873cb60495: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:55.701205 21101 tablet_copy_client.cc:647] T c9240a82777b44648966e18a616fdfa2 P 436e7859396c42a6b60714873cb60495: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:55.702145 21106 tablet_copy_client.cc:1002] T c9240a82777b44648966e18a616fdfa2 P 436e7859396c42a6b60714873cb60495: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:55.707952 17059 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e03fff9bc743475d92ae26b85e7f39ff"
dest_uuid: "6431e35365644aac943c07c97e370fee"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:52528
I20240502 01:58:55.708072 17059 raft_consensus.cc:595] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Received request to transfer leadership
I20240502 01:58:55.732219 17059 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "086b486997ae4d15a4b070e79552807f"
dest_uuid: "6431e35365644aac943c07c97e370fee"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:52582
I20240502 01:58:55.732332 17059 raft_consensus.cc:595] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Received request to transfer leadership
I20240502 01:58:55.736594 20020 raft_consensus.cc:1050] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee: attempting to promote NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 to VOTER
I20240502 01:58:55.737008 20020 consensus_queue.cc:237] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:58:55.738126 18919 raft_consensus.cc:1261] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.738219 16923 raft_consensus.cc:1261] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.738274 17325 raft_consensus.cc:1261] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.738593 20649 consensus_queue.cc:1035] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.738965 20649 consensus_queue.cc:1035] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.739356 20021 consensus_queue.cc:1035] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.741384 20649 raft_consensus.cc:2932] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.742184 16923 raft_consensus.cc:2932] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.743304 17325 raft_consensus.cc:2932] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.744205 16774 catalog_manager.cc:5484] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:55.746116 18919 raft_consensus.cc:2932] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.747556 17059 consensus_queue.cc:237] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:58:55.748306 20643 raft_consensus.cc:979] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee: : Instructing follower ec11d4bb3a064a94a80084142637b441 to start an election
I20240502 01:58:55.748428 20643 raft_consensus.cc:1067] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Signalling peer ec11d4bb3a064a94a80084142637b441 to start an election
I20240502 01:58:55.748544 18919 raft_consensus.cc:1261] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.748888 20650 consensus_queue.cc:1035] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.749377 17324 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e03fff9bc743475d92ae26b85e7f39ff"
dest_uuid: "ec11d4bb3a064a94a80084142637b441"
from {username='slave'} at 127.10.133.194:39913
I20240502 01:58:55.749548 17324 raft_consensus.cc:482] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:58:55.749611 17324 raft_consensus.cc:3037] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:58:55.749378 17325 raft_consensus.cc:1261] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.750550 17324 raft_consensus.cc:504] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:58:55.751013 17324 leader_election.cc:288] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 2 election: Requested vote from peers a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923), 6431e35365644aac943c07c97e370fee (127.10.133.194:37811), b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200:46021)
I20240502 01:58:55.751323 17193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e03fff9bc743475d92ae26b85e7f39ff" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:58:55.751500 17193 raft_consensus.cc:3037] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:58:55.751507 19050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e03fff9bc743475d92ae26b85e7f39ff" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "b6aa9ef40e50468ca7a9742c21140d24"
I20240502 01:58:55.751709 19050 raft_consensus.cc:3037] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:58:55.751709 20649 consensus_queue.cc:1035] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.752408 17193 raft_consensus.cc:2454] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 2.
I20240502 01:58:55.752846 19050 raft_consensus.cc:2454] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 2.
I20240502 01:58:55.753237 20020 raft_consensus.cc:2932] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.753659 18919 raft_consensus.cc:2932] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.753765 17324 raft_consensus.cc:2932] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.754150 17261 leader_election.cc:302] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: a1c00c21761540dea7ddae8d0dd26df4, b6aa9ef40e50468ca7a9742c21140d24, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:55.754297 19370 raft_consensus.cc:2781] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:58:55.754356 19370 raft_consensus.cc:686] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [term 2 LEADER]: Becoming Leader. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Running, Role: LEADER
I20240502 01:58:55.754478 19370 consensus_queue.cc:237] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:58:55.754774 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 8a386a1fd8ae4d70ae482b3ce958825b with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:55.755986 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e03fff9bc743475d92ae26b85e7f39ff" candidate_uuid: "ec11d4bb3a064a94a80084142637b441" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "6431e35365644aac943c07c97e370fee"
I20240502 01:58:55.756094 17059 raft_consensus.cc:3032] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:58:55.756152 17059 raft_consensus.cc:729] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Running, Role: LEADER
I20240502 01:58:55.756300 17059 consensus_queue.cc:260] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:58:55.756296 16775 catalog_manager.cc:5484] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 reported cstate change: term changed from 1 to 2, leader changed from 6431e35365644aac943c07c97e370fee (127.10.133.194) to ec11d4bb3a064a94a80084142637b441 (127.10.133.196). New cstate: current_term: 2 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:55.756443 17059 raft_consensus.cc:3037] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:58:55.756573 16775 catalog_manager.cc:5484] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:55.757169 17059 raft_consensus.cc:2454] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec11d4bb3a064a94a80084142637b441 in term 2.
I20240502 01:58:55.759006 17059 consensus_queue.cc:237] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:58:55.759768 16901 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a386a1fd8ae4d70ae482b3ce958825b with delete_type TABLET_DATA_TOMBSTONED (TS 191fe00ca08b44c9aef6646e86aecebc not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:40018
I20240502 01:58:55.760035 20672 tablet_replica.cc:330] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc: stopping tablet replica
I20240502 01:58:55.760071 17324 raft_consensus.cc:1261] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.760177 20672 raft_consensus.cc:2229] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:55.760192 19050 raft_consensus.cc:1261] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.760324 20672 raft_consensus.cc:2258] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:55.760576 20649 consensus_queue.cc:1035] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.760748 20021 consensus_queue.cc:1035] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.761207 20672 ts_tablet_manager.cc:1875] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:55.762107 20649 raft_consensus.cc:2932] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.762562 19050 raft_consensus.cc:2932] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.763406 20672 ts_tablet_manager.cc:1888] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:55.763468 20672 log.cc:1196] T 8a386a1fd8ae4d70ae482b3ce958825b P 191fe00ca08b44c9aef6646e86aecebc: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/8a386a1fd8ae4d70ae482b3ce958825b
I20240502 01:58:55.763507 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 1a396235bc534141bcd180430c51e7e1 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:55.763939 16764 catalog_manager.cc:4830] TS 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571): tablet 8a386a1fd8ae4d70ae482b3ce958825b (table rebalance_test_table_6 [id=3b1319b666dc429cb0d33c9c55b7266e]) successfully deleted
I20240502 01:58:55.764007 17324 raft_consensus.cc:2932] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:55.765129 16775 catalog_manager.cc:5484] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:55.767244 17171 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a396235bc534141bcd180430c51e7e1 with delete_type TABLET_DATA_TOMBSTONED (TS a1c00c21761540dea7ddae8d0dd26df4 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:50964
I20240502 01:58:55.767459 20654 tablet_replica.cc:330] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4: stopping tablet replica
I20240502 01:58:55.767604 20654 raft_consensus.cc:2229] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:55.767756 20654 raft_consensus.cc:2258] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:55.768371 20654 ts_tablet_manager.cc:1875] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:55.769142 20542 raft_consensus.cc:1050] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc: attempting to promote NON_VOTER d7989bd96de94be4a94995fcfcd6b16b to VOTER
I20240502 01:58:55.769539 20542 consensus_queue.cc:237] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } }
I20240502 01:58:55.770329 20654 ts_tablet_manager.cc:1888] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:55.770390 20654 log.cc:1196] T 1a396235bc534141bcd180430c51e7e1 P a1c00c21761540dea7ddae8d0dd26df4: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/wals/1a396235bc534141bcd180430c51e7e1
I20240502 01:58:55.770903 16765 catalog_manager.cc:4830] TS a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923): tablet 1a396235bc534141bcd180430c51e7e1 (table rebalance_test_table_1 [id=e1f098a771d942879080a8a67a25fa1c]) successfully deleted
I20240502 01:58:55.771075 17324 raft_consensus.cc:1261] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.771171 18785 raft_consensus.cc:1261] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.771409 20544 consensus_queue.cc:1035] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.771576 20024 consensus_queue.cc:1035] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.771735 17059 raft_consensus.cc:1261] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:55.772192 20544 consensus_queue.cc:1035] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:55.773977 20024 raft_consensus.cc:2932] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.774377 17059 raft_consensus.cc:2932] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.775657 18785 raft_consensus.cc:2932] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.775925 17324 raft_consensus.cc:2932] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.776888 16774 catalog_manager.cc:5484] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.780269 16923 consensus_queue.cc:237] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } }
I20240502 01:58:55.781383 17059 raft_consensus.cc:1261] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.781500 18785 raft_consensus.cc:1261] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:55.781731 20544 consensus_queue.cc:1035] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.781872 19389 consensus_queue.cc:1035] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:55.783453 20024 raft_consensus.cc:2932] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.783869 17059 raft_consensus.cc:2932] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.784796 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet df21aa40548c4f49bae79294085c80f4 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:55.785228 18785 raft_consensus.cc:2932] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:55.785624 16776 catalog_manager.cc:5484] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 5 to 6, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:55.788053 17304 tablet_service.cc:1514] Processing DeleteTablet for tablet df21aa40548c4f49bae79294085c80f4 with delete_type TABLET_DATA_TOMBSTONED (TS ec11d4bb3a064a94a80084142637b441 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:58608
I20240502 01:58:55.788266 20642 tablet_replica.cc:330] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441: stopping tablet replica
I20240502 01:58:55.788388 20642 raft_consensus.cc:2229] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:55.788520 20642 raft_consensus.cc:2258] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:55.789095 20642 ts_tablet_manager.cc:1875] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:55.790731 20642 ts_tablet_manager.cc:1888] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:55.790789 20642 log.cc:1196] T df21aa40548c4f49bae79294085c80f4 P ec11d4bb3a064a94a80084142637b441: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/df21aa40548c4f49bae79294085c80f4
I20240502 01:58:55.791160 16764 catalog_manager.cc:4830] TS ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135): tablet df21aa40548c4f49bae79294085c80f4 (table rebalance_test_table_2 [id=e2d3cd2117a14964a0bc535eca4d5850]) successfully deleted
I20240502 01:58:55.818125 20643 raft_consensus.cc:979] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee: : Instructing follower a1c00c21761540dea7ddae8d0dd26df4 to start an election
I20240502 01:58:55.818230 20643 raft_consensus.cc:1067] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Signalling peer a1c00c21761540dea7ddae8d0dd26df4 to start an election
I20240502 01:58:55.818699 17193 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "086b486997ae4d15a4b070e79552807f"
dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
from {username='slave'} at 127.10.133.194:48035
I20240502 01:58:55.818854 17193 raft_consensus.cc:482] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:58:55.818912 17193 raft_consensus.cc:3037] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:58:55.819883 17193 raft_consensus.cc:504] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:58:55.820384 17193 leader_election.cc:288] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [CANDIDATE]: Term 2 election: Requested vote from peers 6431e35365644aac943c07c97e370fee (127.10.133.194:37811), ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135), b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199:34045)
I20240502 01:58:55.820740 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "086b486997ae4d15a4b070e79552807f" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "6431e35365644aac943c07c97e370fee"
I20240502 01:58:55.820848 17059 raft_consensus.cc:3032] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:58:55.820889 17059 raft_consensus.cc:729] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Running, Role: LEADER
I20240502 01:58:55.821012 17059 consensus_queue.cc:260] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:58:55.821170 17059 raft_consensus.cc:3037] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:58:55.821555 17324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "086b486997ae4d15a4b070e79552807f" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "ec11d4bb3a064a94a80084142637b441"
I20240502 01:58:55.821704 17324 raft_consensus.cc:3037] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:58:55.822170 17059 raft_consensus.cc:2454] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 2.
I20240502 01:58:55.822690 17324 raft_consensus.cc:2454] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 2.
I20240502 01:58:55.823019 17125 leader_election.cc:302] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, a1c00c21761540dea7ddae8d0dd26df4, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:58:55.823295 20022 raft_consensus.cc:2781] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:58:55.823388 20022 raft_consensus.cc:686] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [term 2 LEADER]: Becoming Leader. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Running, Role: LEADER
I20240502 01:58:55.823510 20022 consensus_queue.cc:237] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:58:55.825470 21165 ts_tablet_manager.cc:902] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P b7ec79239ce64b38a1d55f66a95407c0: Initiating tablet copy from peer 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:58:55.825533 16775 catalog_manager.cc:5484] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: term changed from 1 to 2, leader changed from 6431e35365644aac943c07c97e370fee (127.10.133.194) to a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195). New cstate: current_term: 2 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:55.826050 21165 tablet_copy_client.cc:308] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:45571
I20240502 01:58:55.826089 18919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "086b486997ae4d15a4b070e79552807f" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "b7ec79239ce64b38a1d55f66a95407c0"
I20240502 01:58:55.826260 18919 raft_consensus.cc:3037] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:58:55.826835 21164 ts_tablet_manager.cc:902] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b: Initiating tablet copy from peer a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:55.827296 18919 raft_consensus.cc:2454] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 2.
I20240502 01:58:55.827385 21164 tablet_copy_client.cc:308] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.195:35923
I20240502 01:58:55.827867 16943 tablet_copy_service.cc:140] P 191fe00ca08b44c9aef6646e86aecebc: Received BeginTabletCopySession request for tablet fe3333c0dfe048fda6cfc8b12bf0d5a9 from peer b7ec79239ce64b38a1d55f66a95407c0 ({username='slave'} at 127.10.133.199:51555)
I20240502 01:58:55.827968 16943 tablet_copy_service.cc:161] P 191fe00ca08b44c9aef6646e86aecebc: Beginning new tablet copy session on tablet fe3333c0dfe048fda6cfc8b12bf0d5a9 from peer b7ec79239ce64b38a1d55f66a95407c0 at {username='slave'} at 127.10.133.199:51555: session id = b7ec79239ce64b38a1d55f66a95407c0-fe3333c0dfe048fda6cfc8b12bf0d5a9
I20240502 01:58:55.828888 16943 tablet_copy_source_session.cc:205] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:55.830900 21165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe3333c0dfe048fda6cfc8b12bf0d5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:55.832691 17214 tablet_copy_service.cc:140] P a1c00c21761540dea7ddae8d0dd26df4: Received BeginTabletCopySession request for tablet 47f0db0b9b7744758b9ca7f1e797bdb0 from peer d7989bd96de94be4a94995fcfcd6b16b ({username='slave'} at 127.10.133.198:54575)
I20240502 01:58:55.832790 17214 tablet_copy_service.cc:161] P a1c00c21761540dea7ddae8d0dd26df4: Beginning new tablet copy session on tablet 47f0db0b9b7744758b9ca7f1e797bdb0 from peer d7989bd96de94be4a94995fcfcd6b16b at {username='slave'} at 127.10.133.198:54575: session id = d7989bd96de94be4a94995fcfcd6b16b-47f0db0b9b7744758b9ca7f1e797bdb0
I20240502 01:58:55.833109 21165 tablet_copy_client.cc:783] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:55.833240 21165 tablet_copy_client.cc:647] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:55.833804 17214 tablet_copy_source_session.cc:205] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:55.834110 21169 tablet_copy_client.cc:1002] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:55.834676 21164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47f0db0b9b7744758b9ca7f1e797bdb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:55.836402 21164 tablet_copy_client.cc:783] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:55.836549 21164 tablet_copy_client.cc:647] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:55.837482 21170 tablet_copy_client.cc:1002] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:55.912134 21175 ts_tablet_manager.cc:902] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0: Initiating tablet copy from peer 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:55.912690 21175 tablet_copy_client.cc:308] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37811
I20240502 01:58:55.913210 17079 tablet_copy_service.cc:140] P 6431e35365644aac943c07c97e370fee: Received BeginTabletCopySession request for tablet d9de883c491f43378a26c5a370062555 from peer b7ec79239ce64b38a1d55f66a95407c0 ({username='slave'} at 127.10.133.199:45123)
I20240502 01:58:55.913324 17079 tablet_copy_service.cc:161] P 6431e35365644aac943c07c97e370fee: Beginning new tablet copy session on tablet d9de883c491f43378a26c5a370062555 from peer b7ec79239ce64b38a1d55f66a95407c0 at {username='slave'} at 127.10.133.199:45123: session id = b7ec79239ce64b38a1d55f66a95407c0-d9de883c491f43378a26c5a370062555
I20240502 01:58:55.914176 17079 tablet_copy_source_session.cc:205] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:55.915035 21175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9de883c491f43378a26c5a370062555. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:55.916720 21175 tablet_copy_client.cc:783] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:55.916867 21175 tablet_copy_client.cc:647] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:55.917937 21179 tablet_copy_client.cc:1002] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:55.933431 21180 ts_tablet_manager.cc:902] T 0429b2d6357546f48b422810148fdce1 P d7989bd96de94be4a94995fcfcd6b16b: Initiating tablet copy from peer ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:55.934057 21180 tablet_copy_client.cc:308] T 0429b2d6357546f48b422810148fdce1 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.196:38135
I20240502 01:58:55.934502 17346 tablet_copy_service.cc:140] P ec11d4bb3a064a94a80084142637b441: Received BeginTabletCopySession request for tablet 0429b2d6357546f48b422810148fdce1 from peer d7989bd96de94be4a94995fcfcd6b16b ({username='slave'} at 127.10.133.198:57185)
I20240502 01:58:55.934612 17346 tablet_copy_service.cc:161] P ec11d4bb3a064a94a80084142637b441: Beginning new tablet copy session on tablet 0429b2d6357546f48b422810148fdce1 from peer d7989bd96de94be4a94995fcfcd6b16b at {username='slave'} at 127.10.133.198:57185: session id = d7989bd96de94be4a94995fcfcd6b16b-0429b2d6357546f48b422810148fdce1
I20240502 01:58:55.935384 17346 tablet_copy_source_session.cc:205] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:55.936229 21180 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0429b2d6357546f48b422810148fdce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:55.937918 21180 tablet_copy_client.cc:783] T 0429b2d6357546f48b422810148fdce1 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:55.938097 21180 tablet_copy_client.cc:647] T 0429b2d6357546f48b422810148fdce1 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:55.939085 21184 tablet_copy_client.cc:1002] T 0429b2d6357546f48b422810148fdce1 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:55.947077 21191 ts_tablet_manager.cc:902] T 86c8e4b2177946de9d18d4ef657da4be P d7989bd96de94be4a94995fcfcd6b16b: Initiating tablet copy from peer a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:58:55.947649 21191 tablet_copy_client.cc:308] T 86c8e4b2177946de9d18d4ef657da4be P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.195:35923
I20240502 01:58:55.948117 17214 tablet_copy_service.cc:140] P a1c00c21761540dea7ddae8d0dd26df4: Received BeginTabletCopySession request for tablet 86c8e4b2177946de9d18d4ef657da4be from peer d7989bd96de94be4a94995fcfcd6b16b ({username='slave'} at 127.10.133.198:54575)
I20240502 01:58:55.948233 17214 tablet_copy_service.cc:161] P a1c00c21761540dea7ddae8d0dd26df4: Beginning new tablet copy session on tablet 86c8e4b2177946de9d18d4ef657da4be from peer d7989bd96de94be4a94995fcfcd6b16b at {username='slave'} at 127.10.133.198:54575: session id = d7989bd96de94be4a94995fcfcd6b16b-86c8e4b2177946de9d18d4ef657da4be
I20240502 01:58:55.949194 17214 tablet_copy_source_session.cc:205] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:55.950017 21191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86c8e4b2177946de9d18d4ef657da4be. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:55.952060 21191 tablet_copy_client.cc:783] T 86c8e4b2177946de9d18d4ef657da4be P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:55.952260 21191 tablet_copy_client.cc:647] T 86c8e4b2177946de9d18d4ef657da4be P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:55.953243 21193 tablet_copy_client.cc:1002] T 86c8e4b2177946de9d18d4ef657da4be P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:56.022475 17059 consensus_queue.cc:237] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:56.024134 16923 raft_consensus.cc:1261] T cd6925b06dd64a028757d8527f896d10 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:56.024499 20643 consensus_queue.cc:1035] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:56.024652 17192 raft_consensus.cc:1261] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:56.025100 20643 consensus_queue.cc:1035] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:56.027464 20643 raft_consensus.cc:2932] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:56.029222 17192 raft_consensus.cc:2932] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
W20240502 01:58:56.029860 16990 consensus_peers.cc:485] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee -> Peer d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198:45549): Couldn't send request to peer d7989bd96de94be4a94995fcfcd6b16b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cd6925b06dd64a028757d8527f896d10. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:56.030663 16775 catalog_manager.cc:5484] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:56.035192 16923 raft_consensus.cc:2932] T cd6925b06dd64a028757d8527f896d10 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:56.135591 17059 raft_consensus.cc:1261] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 2 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20240502 01:58:56.135597 19050 raft_consensus.cc:1261] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20240502 01:58:56.136055 20530 consensus_queue.cc:1035] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:56.136199 19370 consensus_queue.cc:1035] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:56.139173 17192 raft_consensus.cc:1261] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 2 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20240502 01:58:56.139612 19370 consensus_queue.cc:1035] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:56.216388 21338 ts_tablet_manager.cc:902] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24: Initiating tablet copy from peer ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:58:56.216941 21338 tablet_copy_client.cc:308] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.196:38135
I20240502 01:58:56.217432 17346 tablet_copy_service.cc:140] P ec11d4bb3a064a94a80084142637b441: Received BeginTabletCopySession request for tablet 787b9b0227da4dd08df5aeb37f0d0468 from peer b6aa9ef40e50468ca7a9742c21140d24 ({username='slave'} at 127.10.133.200:54049)
I20240502 01:58:56.217540 17346 tablet_copy_service.cc:161] P ec11d4bb3a064a94a80084142637b441: Beginning new tablet copy session on tablet 787b9b0227da4dd08df5aeb37f0d0468 from peer b6aa9ef40e50468ca7a9742c21140d24 at {username='slave'} at 127.10.133.200:54049: session id = b6aa9ef40e50468ca7a9742c21140d24-787b9b0227da4dd08df5aeb37f0d0468
I20240502 01:58:56.218340 17346 tablet_copy_source_session.cc:205] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:56.219172 21338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 787b9b0227da4dd08df5aeb37f0d0468. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:56.219870 21343 ts_tablet_manager.cc:902] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0: Initiating tablet copy from peer 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:56.220350 21343 tablet_copy_client.cc:308] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37811
I20240502 01:58:56.221302 17079 tablet_copy_service.cc:140] P 6431e35365644aac943c07c97e370fee: Received BeginTabletCopySession request for tablet f7d9d4310df14878a5ae4167c5320e3a from peer b7ec79239ce64b38a1d55f66a95407c0 ({username='slave'} at 127.10.133.199:45123)
I20240502 01:58:56.221406 17079 tablet_copy_service.cc:161] P 6431e35365644aac943c07c97e370fee: Beginning new tablet copy session on tablet f7d9d4310df14878a5ae4167c5320e3a from peer b7ec79239ce64b38a1d55f66a95407c0 at {username='slave'} at 127.10.133.199:45123: session id = b7ec79239ce64b38a1d55f66a95407c0-f7d9d4310df14878a5ae4167c5320e3a
I20240502 01:58:56.221485 21338 tablet_copy_client.cc:783] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:56.221629 21338 tablet_copy_client.cc:647] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:56.222275 17079 tablet_copy_source_session.cc:205] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:56.222977 21340 tablet_copy_client.cc:1002] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:56.223117 21343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7d9d4310df14878a5ae4167c5320e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:56.225046 21343 tablet_copy_client.cc:783] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:56.225206 21343 tablet_copy_client.cc:647] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:56.226222 21347 tablet_copy_client.cc:1002] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:56.306524 17324 raft_consensus.cc:1261] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20240502 01:58:56.307003 20022 consensus_queue.cc:1035] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:56.400206 18919 raft_consensus.cc:1261] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0 [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20240502 01:58:56.400602 21365 consensus_queue.cc:1035] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:56.403528 17059 raft_consensus.cc:1261] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20240502 01:58:56.404107 20022 consensus_queue.cc:1035] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:56.405932 17192 consensus_queue.cc:237] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 2.6, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:58:56.407907 17324 raft_consensus.cc:1261] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 2 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20240502 01:58:56.407976 18918 raft_consensus.cc:1261] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0 [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 2 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20240502 01:58:56.408764 20662 consensus_queue.cc:1035] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:56.409032 20662 consensus_queue.cc:1035] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:58:56.410737 21365 raft_consensus.cc:2932] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [term 2 LEADER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:56.411118 18919 raft_consensus.cc:2932] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0 [term 2 FOLLOWER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:56.412362 16765 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 086b486997ae4d15a4b070e79552807f with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:56.413017 17324 raft_consensus.cc:2932] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:56.413967 16775 catalog_manager.cc:5484] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 5 to 7, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New cstate: current_term: 2 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:56.417637 17039 tablet_service.cc:1514] Processing DeleteTablet for tablet 086b486997ae4d15a4b070e79552807f with delete_type TABLET_DATA_TOMBSTONED (TS 6431e35365644aac943c07c97e370fee not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:58394
I20240502 01:58:56.417955 21416 tablet_replica.cc:330] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee: stopping tablet replica
I20240502 01:58:56.418108 21416 raft_consensus.cc:2229] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:56.418248 21416 raft_consensus.cc:2258] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:56.418905 21416 ts_tablet_manager.cc:1875] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:56.420540 21416 ts_tablet_manager.cc:1888] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.6
I20240502 01:58:56.420611 21416 log.cc:1196] T 086b486997ae4d15a4b070e79552807f P 6431e35365644aac943c07c97e370fee: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/086b486997ae4d15a4b070e79552807f
I20240502 01:58:56.421118 16764 catalog_manager.cc:4830] TS 6431e35365644aac943c07c97e370fee (127.10.133.194:37811): tablet 086b486997ae4d15a4b070e79552807f (table rebalance_test_table_5 [id=2cbb40e4a59445dc9a1b5b4161e4c646]) successfully deleted
I20240502 01:58:56.430775 21417 ts_tablet_manager.cc:902] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b: Initiating tablet copy from peer 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:56.431380 21417 tablet_copy_client.cc:308] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37811
I20240502 01:58:56.435731 17079 tablet_copy_service.cc:140] P 6431e35365644aac943c07c97e370fee: Received BeginTabletCopySession request for tablet cd6925b06dd64a028757d8527f896d10 from peer d7989bd96de94be4a94995fcfcd6b16b ({username='slave'} at 127.10.133.198:47861)
I20240502 01:58:56.435837 17079 tablet_copy_service.cc:161] P 6431e35365644aac943c07c97e370fee: Beginning new tablet copy session on tablet cd6925b06dd64a028757d8527f896d10 from peer d7989bd96de94be4a94995fcfcd6b16b at {username='slave'} at 127.10.133.198:47861: session id = d7989bd96de94be4a94995fcfcd6b16b-cd6925b06dd64a028757d8527f896d10
I20240502 01:58:56.436925 17079 tablet_copy_source_session.cc:205] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:56.437815 21417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd6925b06dd64a028757d8527f896d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:56.439538 21417 tablet_copy_client.cc:783] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:56.439734 21417 tablet_copy_client.cc:647] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:56.441970 21420 tablet_copy_client.cc:1002] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:56.563323 17324 consensus_queue.cc:237] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 2.6, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:58:56.564517 19050 raft_consensus.cc:1261] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 2 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20240502 01:58:56.564935 17192 raft_consensus.cc:1261] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 2 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 2 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20240502 01:58:56.564961 20531 consensus_queue.cc:1035] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:58:56.565311 20530 consensus_queue.cc:1035] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:58:56.566625 20531 raft_consensus.cc:2932] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [term 2 LEADER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:56.567112 19050 raft_consensus.cc:2932] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:56.567440 17192 raft_consensus.cc:2932] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 2 FOLLOWER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:56.569283 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet e03fff9bc743475d92ae26b85e7f39ff with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:56.569445 16773 catalog_manager.cc:5484] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index 5 to 7, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New cstate: current_term: 2 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:56.572019 17039 tablet_service.cc:1514] Processing DeleteTablet for tablet e03fff9bc743475d92ae26b85e7f39ff with delete_type TABLET_DATA_TOMBSTONED (TS 6431e35365644aac943c07c97e370fee not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:58394
I20240502 01:58:56.572264 21416 tablet_replica.cc:330] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee: stopping tablet replica
I20240502 01:58:56.572402 21416 raft_consensus.cc:2229] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:56.572525 21416 raft_consensus.cc:2258] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:56.573179 21416 ts_tablet_manager.cc:1875] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:56.575096 21416 ts_tablet_manager.cc:1888] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.6
I20240502 01:58:56.575167 21416 log.cc:1196] T e03fff9bc743475d92ae26b85e7f39ff P 6431e35365644aac943c07c97e370fee: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/e03fff9bc743475d92ae26b85e7f39ff
I20240502 01:58:56.575697 16764 catalog_manager.cc:4830] TS 6431e35365644aac943c07c97e370fee (127.10.133.194:37811): tablet e03fff9bc743475d92ae26b85e7f39ff (table rebalance_test_table_5 [id=2cbb40e4a59445dc9a1b5b4161e4c646]) successfully deleted
I20240502 01:58:57.164773 21051 tablet_copy_client.cc:523] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:57.166348 21051 tablet_bootstrap.cc:492] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap starting.
I20240502 01:58:57.189231 21051 tablet_bootstrap.cc:492] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:57.189524 21051 tablet_bootstrap.cc:492] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap complete.
I20240502 01:58:57.189705 21051 ts_tablet_manager.cc:1367] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24: Time spent bootstrapping tablet: real 0.023s user 0.021s sys 0.000s
I20240502 01:58:57.190186 21051 raft_consensus.cc:348] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:57.190327 21051 raft_consensus.cc:729] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b6aa9ef40e50468ca7a9742c21140d24, State: Initialized, Role: LEARNER
I20240502 01:58:57.190423 21051 consensus_queue.cc:260] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:57.190799 21051 ts_tablet_manager.cc:1398] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 01:58:57.191632 16943 tablet_copy_service.cc:342] P 191fe00ca08b44c9aef6646e86aecebc: Request end of tablet copy session b6aa9ef40e50468ca7a9742c21140d24-2162035e4ed4433fafcc49934be62a9c received from {username='slave'} at 127.10.133.200:33817
I20240502 01:58:57.191713 16943 tablet_copy_service.cc:433] P 191fe00ca08b44c9aef6646e86aecebc: ending tablet copy session b6aa9ef40e50468ca7a9742c21140d24-2162035e4ed4433fafcc49934be62a9c on tablet 2162035e4ed4433fafcc49934be62a9c with peer b6aa9ef40e50468ca7a9742c21140d24
I20240502 01:58:57.202428 21101 tablet_copy_client.cc:523] T c9240a82777b44648966e18a616fdfa2 P 436e7859396c42a6b60714873cb60495: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:57.203858 21101 tablet_bootstrap.cc:492] T c9240a82777b44648966e18a616fdfa2 P 436e7859396c42a6b60714873cb60495: Bootstrap starting.
I20240502 01:58:57.221689 21101 tablet_bootstrap.cc:492] T c9240a82777b44648966e18a616fdfa2 P 436e7859396c42a6b60714873cb60495: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:57.221951 21101 tablet_bootstrap.cc:492] T c9240a82777b44648966e18a616fdfa2 P 436e7859396c42a6b60714873cb60495: Bootstrap complete.
I20240502 01:58:57.222151 21101 ts_tablet_manager.cc:1367] T c9240a82777b44648966e18a616fdfa2 P 436e7859396c42a6b60714873cb60495: Time spent bootstrapping tablet: real 0.018s user 0.019s sys 0.000s
I20240502 01:58:57.222548 21101 raft_consensus.cc:348] T c9240a82777b44648966e18a616fdfa2 P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:58:57.222693 21101 raft_consensus.cc:729] T c9240a82777b44648966e18a616fdfa2 P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 436e7859396c42a6b60714873cb60495, State: Initialized, Role: LEARNER
I20240502 01:58:57.222800 21101 consensus_queue.cc:260] T c9240a82777b44648966e18a616fdfa2 P 436e7859396c42a6b60714873cb60495 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:58:57.223078 21101 ts_tablet_manager.cc:1398] T c9240a82777b44648966e18a616fdfa2 P 436e7859396c42a6b60714873cb60495: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:57.223616 17346 tablet_copy_service.cc:342] P ec11d4bb3a064a94a80084142637b441: Request end of tablet copy session 436e7859396c42a6b60714873cb60495-c9240a82777b44648966e18a616fdfa2 received from {username='slave'} at 127.10.133.197:57723
I20240502 01:58:57.223697 17346 tablet_copy_service.cc:433] P ec11d4bb3a064a94a80084142637b441: ending tablet copy session 436e7859396c42a6b60714873cb60495-c9240a82777b44648966e18a616fdfa2 on tablet c9240a82777b44648966e18a616fdfa2 with peer 436e7859396c42a6b60714873cb60495
I20240502 01:58:57.334470 21165 tablet_copy_client.cc:523] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:57.335935 21165 tablet_bootstrap.cc:492] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap starting.
I20240502 01:58:57.337764 21164 tablet_copy_client.cc:523] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:57.339303 21164 tablet_bootstrap.cc:492] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap starting.
I20240502 01:58:57.357683 21165 tablet_bootstrap.cc:492] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:57.358026 21165 tablet_bootstrap.cc:492] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap complete.
I20240502 01:58:57.358222 21165 ts_tablet_manager.cc:1367] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P b7ec79239ce64b38a1d55f66a95407c0: Time spent bootstrapping tablet: real 0.022s user 0.019s sys 0.004s
I20240502 01:58:57.358711 21165 raft_consensus.cc:348] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:57.358839 21165 raft_consensus.cc:729] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b7ec79239ce64b38a1d55f66a95407c0, State: Initialized, Role: LEARNER
I20240502 01:58:57.358956 21165 consensus_queue.cc:260] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P b7ec79239ce64b38a1d55f66a95407c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:57.359315 21165 ts_tablet_manager.cc:1398] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P b7ec79239ce64b38a1d55f66a95407c0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:57.360258 16943 tablet_copy_service.cc:342] P 191fe00ca08b44c9aef6646e86aecebc: Request end of tablet copy session b7ec79239ce64b38a1d55f66a95407c0-fe3333c0dfe048fda6cfc8b12bf0d5a9 received from {username='slave'} at 127.10.133.199:51555
I20240502 01:58:57.360347 16943 tablet_copy_service.cc:433] P 191fe00ca08b44c9aef6646e86aecebc: ending tablet copy session b7ec79239ce64b38a1d55f66a95407c0-fe3333c0dfe048fda6cfc8b12bf0d5a9 on tablet fe3333c0dfe048fda6cfc8b12bf0d5a9 with peer b7ec79239ce64b38a1d55f66a95407c0
I20240502 01:58:57.362361 21164 tablet_bootstrap.cc:492] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:57.362676 21164 tablet_bootstrap.cc:492] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap complete.
I20240502 01:58:57.362855 21164 ts_tablet_manager.cc:1367] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b: Time spent bootstrapping tablet: real 0.024s user 0.023s sys 0.000s
I20240502 01:58:57.363174 21164 raft_consensus.cc:348] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:57.363268 21164 raft_consensus.cc:729] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d7989bd96de94be4a94995fcfcd6b16b, State: Initialized, Role: LEARNER
I20240502 01:58:57.363341 21164 consensus_queue.cc:260] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:57.363586 21164 ts_tablet_manager.cc:1398] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:57.364055 17214 tablet_copy_service.cc:342] P a1c00c21761540dea7ddae8d0dd26df4: Request end of tablet copy session d7989bd96de94be4a94995fcfcd6b16b-47f0db0b9b7744758b9ca7f1e797bdb0 received from {username='slave'} at 127.10.133.198:54575
I20240502 01:58:57.364132 17214 tablet_copy_service.cc:433] P a1c00c21761540dea7ddae8d0dd26df4: ending tablet copy session d7989bd96de94be4a94995fcfcd6b16b-47f0db0b9b7744758b9ca7f1e797bdb0 on tablet 47f0db0b9b7744758b9ca7f1e797bdb0 with peer d7989bd96de94be4a94995fcfcd6b16b
I20240502 01:58:57.418215 21175 tablet_copy_client.cc:523] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:57.419819 21175 tablet_bootstrap.cc:492] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap starting.
I20240502 01:58:57.439607 21180 tablet_copy_client.cc:523] T 0429b2d6357546f48b422810148fdce1 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:57.441030 21180 tablet_bootstrap.cc:492] T 0429b2d6357546f48b422810148fdce1 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap starting.
I20240502 01:58:57.441522 21175 tablet_bootstrap.cc:492] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:57.441778 21175 tablet_bootstrap.cc:492] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap complete.
I20240502 01:58:57.441947 21175 ts_tablet_manager.cc:1367] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0: Time spent bootstrapping tablet: real 0.022s user 0.020s sys 0.000s
I20240502 01:58:57.442363 21175 raft_consensus.cc:348] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:57.442471 21175 raft_consensus.cc:729] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b7ec79239ce64b38a1d55f66a95407c0, State: Initialized, Role: LEARNER
I20240502 01:58:57.442579 21175 consensus_queue.cc:260] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:57.442854 21175 ts_tablet_manager.cc:1398] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:57.443465 17079 tablet_copy_service.cc:342] P 6431e35365644aac943c07c97e370fee: Request end of tablet copy session b7ec79239ce64b38a1d55f66a95407c0-d9de883c491f43378a26c5a370062555 received from {username='slave'} at 127.10.133.199:45123
I20240502 01:58:57.443565 17079 tablet_copy_service.cc:433] P 6431e35365644aac943c07c97e370fee: ending tablet copy session b7ec79239ce64b38a1d55f66a95407c0-d9de883c491f43378a26c5a370062555 on tablet d9de883c491f43378a26c5a370062555 with peer b7ec79239ce64b38a1d55f66a95407c0
I20240502 01:58:57.453579 21191 tablet_copy_client.cc:523] T 86c8e4b2177946de9d18d4ef657da4be P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:57.454977 21191 tablet_bootstrap.cc:492] T 86c8e4b2177946de9d18d4ef657da4be P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap starting.
I20240502 01:58:57.464772 21180 tablet_bootstrap.cc:492] T 0429b2d6357546f48b422810148fdce1 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:57.465171 21180 tablet_bootstrap.cc:492] T 0429b2d6357546f48b422810148fdce1 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap complete.
I20240502 01:58:57.465415 21180 ts_tablet_manager.cc:1367] T 0429b2d6357546f48b422810148fdce1 P d7989bd96de94be4a94995fcfcd6b16b: Time spent bootstrapping tablet: real 0.024s user 0.024s sys 0.000s
I20240502 01:58:57.465862 21180 raft_consensus.cc:348] T 0429b2d6357546f48b422810148fdce1 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:57.466045 21180 raft_consensus.cc:729] T 0429b2d6357546f48b422810148fdce1 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d7989bd96de94be4a94995fcfcd6b16b, State: Initialized, Role: LEARNER
I20240502 01:58:57.466213 21180 consensus_queue.cc:260] T 0429b2d6357546f48b422810148fdce1 P d7989bd96de94be4a94995fcfcd6b16b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:57.466763 21180 ts_tablet_manager.cc:1398] T 0429b2d6357546f48b422810148fdce1 P d7989bd96de94be4a94995fcfcd6b16b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:57.467381 17346 tablet_copy_service.cc:342] P ec11d4bb3a064a94a80084142637b441: Request end of tablet copy session d7989bd96de94be4a94995fcfcd6b16b-0429b2d6357546f48b422810148fdce1 received from {username='slave'} at 127.10.133.198:57185
I20240502 01:58:57.467460 17346 tablet_copy_service.cc:433] P ec11d4bb3a064a94a80084142637b441: ending tablet copy session d7989bd96de94be4a94995fcfcd6b16b-0429b2d6357546f48b422810148fdce1 on tablet 0429b2d6357546f48b422810148fdce1 with peer d7989bd96de94be4a94995fcfcd6b16b
I20240502 01:58:57.478713 21191 tablet_bootstrap.cc:492] T 86c8e4b2177946de9d18d4ef657da4be P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:57.479009 21191 tablet_bootstrap.cc:492] T 86c8e4b2177946de9d18d4ef657da4be P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap complete.
I20240502 01:58:57.479175 21191 ts_tablet_manager.cc:1367] T 86c8e4b2177946de9d18d4ef657da4be P d7989bd96de94be4a94995fcfcd6b16b: Time spent bootstrapping tablet: real 0.024s user 0.023s sys 0.000s
I20240502 01:58:57.479538 21191 raft_consensus.cc:348] T 86c8e4b2177946de9d18d4ef657da4be P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:57.479652 21191 raft_consensus.cc:729] T 86c8e4b2177946de9d18d4ef657da4be P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d7989bd96de94be4a94995fcfcd6b16b, State: Initialized, Role: LEARNER
I20240502 01:58:57.479744 21191 consensus_queue.cc:260] T 86c8e4b2177946de9d18d4ef657da4be P d7989bd96de94be4a94995fcfcd6b16b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:57.479990 21191 ts_tablet_manager.cc:1398] T 86c8e4b2177946de9d18d4ef657da4be P d7989bd96de94be4a94995fcfcd6b16b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:57.480796 17214 tablet_copy_service.cc:342] P a1c00c21761540dea7ddae8d0dd26df4: Request end of tablet copy session d7989bd96de94be4a94995fcfcd6b16b-86c8e4b2177946de9d18d4ef657da4be received from {username='slave'} at 127.10.133.198:54575
I20240502 01:58:57.480885 17214 tablet_copy_service.cc:433] P a1c00c21761540dea7ddae8d0dd26df4: ending tablet copy session d7989bd96de94be4a94995fcfcd6b16b-86c8e4b2177946de9d18d4ef657da4be on tablet 86c8e4b2177946de9d18d4ef657da4be with peer d7989bd96de94be4a94995fcfcd6b16b
I20240502 01:58:57.521050 18785 raft_consensus.cc:1203] T 86c8e4b2177946de9d18d4ef657da4be P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:57.705477 19050 raft_consensus.cc:1203] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:57.723273 21338 tablet_copy_client.cc:523] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:57.724877 21338 tablet_bootstrap.cc:492] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap starting.
I20240502 01:58:57.725358 18785 raft_consensus.cc:1203] T 0429b2d6357546f48b422810148fdce1 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:57.726533 21343 tablet_copy_client.cc:523] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:57.728137 21343 tablet_bootstrap.cc:492] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap starting.
I20240502 01:58:57.758348 21343 tablet_bootstrap.cc:492] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:57.758642 21343 tablet_bootstrap.cc:492] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap complete.
I20240502 01:58:57.758812 21343 ts_tablet_manager.cc:1367] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0: Time spent bootstrapping tablet: real 0.031s user 0.022s sys 0.000s
I20240502 01:58:57.759225 21343 raft_consensus.cc:348] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:57.759330 21343 raft_consensus.cc:729] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b7ec79239ce64b38a1d55f66a95407c0, State: Initialized, Role: LEARNER
I20240502 01:58:57.759428 21343 consensus_queue.cc:260] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:58:57.759692 21343 ts_tablet_manager.cc:1398] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:58:57.760282 17079 tablet_copy_service.cc:342] P 6431e35365644aac943c07c97e370fee: Request end of tablet copy session b7ec79239ce64b38a1d55f66a95407c0-f7d9d4310df14878a5ae4167c5320e3a received from {username='slave'} at 127.10.133.199:45123
I20240502 01:58:57.760375 17079 tablet_copy_service.cc:433] P 6431e35365644aac943c07c97e370fee: ending tablet copy session b7ec79239ce64b38a1d55f66a95407c0-f7d9d4310df14878a5ae4167c5320e3a on tablet f7d9d4310df14878a5ae4167c5320e3a with peer b7ec79239ce64b38a1d55f66a95407c0
I20240502 01:58:57.761332 18785 raft_consensus.cc:1203] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:57.762681 18650 raft_consensus.cc:1203] T c9240a82777b44648966e18a616fdfa2 P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:57.762964 21338 tablet_bootstrap.cc:492] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:57.763258 21338 tablet_bootstrap.cc:492] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap complete.
I20240502 01:58:57.763415 21338 ts_tablet_manager.cc:1367] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24: Time spent bootstrapping tablet: real 0.039s user 0.015s sys 0.005s
I20240502 01:58:57.763868 21338 raft_consensus.cc:348] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:57.763990 21338 raft_consensus.cc:729] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b6aa9ef40e50468ca7a9742c21140d24, State: Initialized, Role: LEARNER
I20240502 01:58:57.764081 21338 consensus_queue.cc:260] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:58:57.764392 21338 ts_tablet_manager.cc:1398] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 01:58:57.764931 17346 tablet_copy_service.cc:342] P ec11d4bb3a064a94a80084142637b441: Request end of tablet copy session b6aa9ef40e50468ca7a9742c21140d24-787b9b0227da4dd08df5aeb37f0d0468 received from {username='slave'} at 127.10.133.200:54049
I20240502 01:58:57.765019 17346 tablet_copy_service.cc:433] P ec11d4bb3a064a94a80084142637b441: ending tablet copy session b6aa9ef40e50468ca7a9742c21140d24-787b9b0227da4dd08df5aeb37f0d0468 on tablet 787b9b0227da4dd08df5aeb37f0d0468 with peer b6aa9ef40e50468ca7a9742c21140d24
I20240502 01:58:57.793069 19050 raft_consensus.cc:1203] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:57.838032 18919 raft_consensus.cc:1203] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:57.845765 18919 raft_consensus.cc:1203] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:57.884721 18919 raft_consensus.cc:1203] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:57.942298 21417 tablet_copy_client.cc:523] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:58:57.943616 21417 tablet_bootstrap.cc:492] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap starting.
I20240502 01:58:57.962083 21417 tablet_bootstrap.cc:492] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:58:57.962355 21417 tablet_bootstrap.cc:492] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap complete.
I20240502 01:58:57.962560 21417 ts_tablet_manager.cc:1367] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b: Time spent bootstrapping tablet: real 0.019s user 0.015s sys 0.005s
I20240502 01:58:57.962925 21417 raft_consensus.cc:348] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:57.963027 21417 raft_consensus.cc:729] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d7989bd96de94be4a94995fcfcd6b16b, State: Initialized, Role: LEARNER
I20240502 01:58:57.963116 21417 consensus_queue.cc:260] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:57.963390 21417 ts_tablet_manager.cc:1398] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:58:57.963939 17079 tablet_copy_service.cc:342] P 6431e35365644aac943c07c97e370fee: Request end of tablet copy session d7989bd96de94be4a94995fcfcd6b16b-cd6925b06dd64a028757d8527f896d10 received from {username='slave'} at 127.10.133.198:47861
I20240502 01:58:57.964013 17079 tablet_copy_service.cc:433] P 6431e35365644aac943c07c97e370fee: ending tablet copy session d7989bd96de94be4a94995fcfcd6b16b-cd6925b06dd64a028757d8527f896d10 on tablet cd6925b06dd64a028757d8527f896d10 with peer d7989bd96de94be4a94995fcfcd6b16b
I20240502 01:58:57.969089 18785 raft_consensus.cc:1203] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:58:58.092537 21806 raft_consensus.cc:1050] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4: attempting to promote NON_VOTER d7989bd96de94be4a94995fcfcd6b16b to VOTER
I20240502 01:58:58.093041 21806 consensus_queue.cc:237] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } }
I20240502 01:58:58.094470 16923 raft_consensus.cc:1261] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.094563 18785 raft_consensus.cc:1261] T 86c8e4b2177946de9d18d4ef657da4be P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.094543 17324 raft_consensus.cc:1261] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.094878 21806 consensus_queue.cc:1035] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.095045 21809 consensus_queue.cc:1035] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.095207 21808 consensus_queue.cc:1035] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.097108 21808 raft_consensus.cc:2932] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.097832 16923 raft_consensus.cc:2932] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.097841 18785 raft_consensus.cc:2932] T 86c8e4b2177946de9d18d4ef657da4be P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.099663 17324 raft_consensus.cc:2932] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.100335 16773 catalog_manager.cc:5484] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:58.104831 17193 consensus_queue.cc:237] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } }
I20240502 01:58:58.105881 18785 raft_consensus.cc:1261] T 86c8e4b2177946de9d18d4ef657da4be P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:58.105933 17324 raft_consensus.cc:1261] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:58.106246 20022 consensus_queue.cc:1035] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:58.106405 21806 consensus_queue.cc:1035] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:58.107831 21809 raft_consensus.cc:2932] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.108394 18785 raft_consensus.cc:2932] T 86c8e4b2177946de9d18d4ef657da4be P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.109220 16765 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 86c8e4b2177946de9d18d4ef657da4be with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:58.109846 17324 raft_consensus.cc:2932] T 86c8e4b2177946de9d18d4ef657da4be P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.110843 16774 catalog_manager.cc:5484] T 86c8e4b2177946de9d18d4ef657da4be P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:58.113073 16901 tablet_service.cc:1514] Processing DeleteTablet for tablet 86c8e4b2177946de9d18d4ef657da4be with delete_type TABLET_DATA_TOMBSTONED (TS 191fe00ca08b44c9aef6646e86aecebc not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:40018
I20240502 01:58:58.113471 21817 tablet_replica.cc:330] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc: stopping tablet replica
I20240502 01:58:58.113631 21817 raft_consensus.cc:2229] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:58.113786 21817 raft_consensus.cc:2258] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:58.114387 21817 ts_tablet_manager.cc:1875] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:58.116407 21817 ts_tablet_manager.cc:1888] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:58.116480 21817 log.cc:1196] T 86c8e4b2177946de9d18d4ef657da4be P 191fe00ca08b44c9aef6646e86aecebc: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/86c8e4b2177946de9d18d4ef657da4be
I20240502 01:58:58.116983 16764 catalog_manager.cc:4830] TS 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571): tablet 86c8e4b2177946de9d18d4ef657da4be (table rebalance_test_table_0 [id=61315444265f4e1e9a2b3fed3a82c4a5]) successfully deleted
I20240502 01:58:58.206841 21752 raft_consensus.cc:1050] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441: attempting to promote NON_VOTER d7989bd96de94be4a94995fcfcd6b16b to VOTER
I20240502 01:58:58.207274 21752 consensus_queue.cc:237] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } }
I20240502 01:58:58.208618 17059 raft_consensus.cc:1261] T 0429b2d6357546f48b422810148fdce1 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.208634 18785 raft_consensus.cc:1261] T 0429b2d6357546f48b422810148fdce1 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.208745 17193 raft_consensus.cc:1261] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.209069 21752 consensus_queue.cc:1035] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.209264 19370 consensus_queue.cc:1035] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.209443 21818 consensus_queue.cc:1035] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.211776 19370 raft_consensus.cc:2932] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.212173 18785 raft_consensus.cc:2932] T 0429b2d6357546f48b422810148fdce1 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.214051 17059 raft_consensus.cc:2932] T 0429b2d6357546f48b422810148fdce1 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.214619 17193 raft_consensus.cc:2932] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.216840 16775 catalog_manager.cc:5484] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:58.219712 17324 consensus_queue.cc:237] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } }
I20240502 01:58:58.221390 18785 raft_consensus.cc:1261] T 0429b2d6357546f48b422810148fdce1 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:58.221796 21820 consensus_queue.cc:1035] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:58.222934 17059 raft_consensus.cc:1261] T 0429b2d6357546f48b422810148fdce1 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:58.223279 19370 consensus_queue.cc:1035] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:58.224812 21820 raft_consensus.cc:2932] T 0429b2d6357546f48b422810148fdce1 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.226146 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 0429b2d6357546f48b422810148fdce1 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:58.226367 17059 raft_consensus.cc:2932] T 0429b2d6357546f48b422810148fdce1 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.228528 18785 raft_consensus.cc:2932] T 0429b2d6357546f48b422810148fdce1 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.228559 16774 catalog_manager.cc:5484] T 0429b2d6357546f48b422810148fdce1 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.230926 17171 tablet_service.cc:1514] Processing DeleteTablet for tablet 0429b2d6357546f48b422810148fdce1 with delete_type TABLET_DATA_TOMBSTONED (TS a1c00c21761540dea7ddae8d0dd26df4 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:50964
I20240502 01:58:58.237813 21834 tablet_replica.cc:330] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4: stopping tablet replica
I20240502 01:58:58.238004 21834 raft_consensus.cc:2229] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:58.238200 21834 raft_consensus.cc:2258] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:58.238893 21834 ts_tablet_manager.cc:1875] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:58.240896 21834 ts_tablet_manager.cc:1888] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:58.240960 21834 log.cc:1196] T 0429b2d6357546f48b422810148fdce1 P a1c00c21761540dea7ddae8d0dd26df4: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/wals/0429b2d6357546f48b422810148fdce1
I20240502 01:58:58.241451 16765 catalog_manager.cc:4830] TS a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923): tablet 0429b2d6357546f48b422810148fdce1 (table rebalance_test_table_3 [id=0c4182cf7d98406d87a12a073ef6b915]) successfully deleted
I20240502 01:58:58.257421 21856 raft_consensus.cc:1050] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee: attempting to promote NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 to VOTER
I20240502 01:58:58.257834 21856 consensus_queue.cc:237] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:58:58.259388 16923 raft_consensus.cc:1261] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.259460 17193 raft_consensus.cc:1261] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.259687 18919 raft_consensus.cc:1261] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.259865 21855 consensus_queue.cc:1035] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.260083 21863 consensus_queue.cc:1035] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.260388 21856 consensus_queue.cc:1035] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.262638 21855 raft_consensus.cc:2932] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.263540 17193 raft_consensus.cc:2932] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.265076 18919 raft_consensus.cc:2932] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.265555 16923 raft_consensus.cc:2932] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.266106 16776 catalog_manager.cc:5484] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:58.273489 17059 consensus_queue.cc:237] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:58:58.275003 18919 raft_consensus.cc:1261] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:58.275507 21856 consensus_queue.cc:1035] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:58.276429 16923 raft_consensus.cc:1261] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:58.276815 21856 consensus_queue.cc:1035] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:58.278208 21863 raft_consensus.cc:2932] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.278663 18919 raft_consensus.cc:2932] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.279184 16923 raft_consensus.cc:2932] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.280740 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet f7d9d4310df14878a5ae4167c5320e3a with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:58.281517 16774 catalog_manager.cc:5484] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:58.284817 17171 tablet_service.cc:1514] Processing DeleteTablet for tablet f7d9d4310df14878a5ae4167c5320e3a with delete_type TABLET_DATA_TOMBSTONED (TS a1c00c21761540dea7ddae8d0dd26df4 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:50964
I20240502 01:58:58.285032 21834 tablet_replica.cc:330] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4: stopping tablet replica
I20240502 01:58:58.285176 21834 raft_consensus.cc:2229] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:58.285341 21834 raft_consensus.cc:2258] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:58.286098 21834 ts_tablet_manager.cc:1875] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:58.287969 21834 ts_tablet_manager.cc:1888] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:58.288031 21834 log.cc:1196] T f7d9d4310df14878a5ae4167c5320e3a P a1c00c21761540dea7ddae8d0dd26df4: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/wals/f7d9d4310df14878a5ae4167c5320e3a
I20240502 01:58:58.288491 16765 catalog_manager.cc:4830] TS a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923): tablet f7d9d4310df14878a5ae4167c5320e3a (table rebalance_test_table_0 [id=61315444265f4e1e9a2b3fed3a82c4a5]) successfully deleted
I20240502 01:58:58.298100 17059 consensus_queue.cc:237] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:58:58.299399 16923 raft_consensus.cc:1261] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:58.299441 17193 raft_consensus.cc:1261] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:58:58.299826 20020 consensus_queue.cc:1035] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:58.300297 20020 consensus_queue.cc:1035] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:58:58.300840 20548 raft_consensus.cc:1050] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc: attempting to promote NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 to VOTER
I20240502 01:58:58.301259 20548 consensus_queue.cc:237] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:58:58.302680 17324 raft_consensus.cc:1261] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.303187 21640 consensus_queue.cc:1035] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.303236 19050 raft_consensus.cc:1261] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.303656 21640 consensus_queue.cc:1035] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.303871 20020 raft_consensus.cc:2932] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:58.305624 16923 raft_consensus.cc:2932] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
W20240502 01:58:58.306437 16990 consensus_peers.cc:485] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee -> Peer d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198:45549): Couldn't send request to peer d7989bd96de94be4a94995fcfcd6b16b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a375533a25a4da5b0030b0e06488351. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:58:58.306821 16773 catalog_manager.cc:5484] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:58.307003 17193 raft_consensus.cc:1261] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.307360 20548 raft_consensus.cc:2932] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:58.309607 17192 raft_consensus.cc:2932] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:58:58.309653 17324 raft_consensus.cc:2932] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:58.309816 19050 raft_consensus.cc:2932] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:58.311738 21889 consensus_queue.cc:1035] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.313477 16775 catalog_manager.cc:5484] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:58.314735 17192 raft_consensus.cc:2932] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:58.316376 20022 raft_consensus.cc:1050] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4: attempting to promote NON_VOTER d7989bd96de94be4a94995fcfcd6b16b to VOTER
I20240502 01:58:58.316550 21818 raft_consensus.cc:1050] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441: attempting to promote NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 to VOTER
I20240502 01:58:58.316745 20022 consensus_queue.cc:237] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } }
I20240502 01:58:58.316927 21818 consensus_queue.cc:237] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:58:58.318109 17059 raft_consensus.cc:1261] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.318130 18785 raft_consensus.cc:1261] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.318312 19050 raft_consensus.cc:1261] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.318527 21809 consensus_queue.cc:1035] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.318738 21820 consensus_queue.cc:1035] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.318836 16923 raft_consensus.cc:1261] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.319311 17192 raft_consensus.cc:1261] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.319458 21809 consensus_queue.cc:1035] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.319737 21820 consensus_queue.cc:1035] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.320012 19370 consensus_queue.cc:1035] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.320884 21904 raft_consensus.cc:1050] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441: attempting to promote NON_VOTER 436e7859396c42a6b60714873cb60495 to VOTER
I20240502 01:58:58.321260 21904 consensus_queue.cc:237] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:58:58.322909 18650 raft_consensus.cc:1261] T c9240a82777b44648966e18a616fdfa2 P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.323634 17193 raft_consensus.cc:1261] T c9240a82777b44648966e18a616fdfa2 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.323788 17059 raft_consensus.cc:1261] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.324168 21818 consensus_queue.cc:1035] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.324319 19370 consensus_queue.cc:1035] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.324484 21809 raft_consensus.cc:2932] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.324676 19370 consensus_queue.cc:1035] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.326339 18785 raft_consensus.cc:2932] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.328099 21818 raft_consensus.cc:2932] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:58.328655 16923 raft_consensus.cc:1261] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.329003 21806 consensus_queue.cc:1035] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.330076 17058 raft_consensus.cc:2932] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:58.330106 17193 raft_consensus.cc:2932] T c9240a82777b44648966e18a616fdfa2 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:58.330253 18650 raft_consensus.cc:2932] T c9240a82777b44648966e18a616fdfa2 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:58.331840 16772 catalog_manager.cc:5484] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index 4 to 5, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:58.332250 17059 raft_consensus.cc:2932] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.333009 16773 catalog_manager.cc:5484] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:58.333171 16923 raft_consensus.cc:2932] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.336189 17324 consensus_queue.cc:237] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:58:58.336686 17193 consensus_queue.cc:237] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } }
I20240502 01:58:58.338047 18650 raft_consensus.cc:1261] T c9240a82777b44648966e18a616fdfa2 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:58.338105 18785 raft_consensus.cc:1261] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:58.338487 20022 consensus_queue.cc:1035] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:58.338725 21818 consensus_queue.cc:1035] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:58.339547 17193 raft_consensus.cc:1261] T c9240a82777b44648966e18a616fdfa2 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:58.340039 21818 consensus_queue.cc:1035] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:58.340341 20022 raft_consensus.cc:2932] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.340926 21904 raft_consensus.cc:2932] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:58.343994 16765 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 47f0db0b9b7744758b9ca7f1e797bdb0 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:58.344125 17059 raft_consensus.cc:1261] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:58.344288 18785 raft_consensus.cc:2932] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.344677 18650 raft_consensus.cc:2932] T c9240a82777b44648966e18a616fdfa2 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:58.344696 17193 raft_consensus.cc:2932] T c9240a82777b44648966e18a616fdfa2 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:58:58.345067 16776 catalog_manager.cc:5484] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:58.345814 21809 consensus_queue.cc:1035] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:58.346586 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet c9240a82777b44648966e18a616fdfa2 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:58.346768 17059 raft_consensus.cc:2932] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.348271 16901 tablet_service.cc:1514] Processing DeleteTablet for tablet 47f0db0b9b7744758b9ca7f1e797bdb0 with delete_type TABLET_DATA_TOMBSTONED (TS 191fe00ca08b44c9aef6646e86aecebc not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:40018
I20240502 01:58:58.348471 21817 tablet_replica.cc:330] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc: stopping tablet replica
I20240502 01:58:58.348618 21817 raft_consensus.cc:2229] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:58.348766 21817 raft_consensus.cc:2258] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:58.348696 16776 catalog_manager.cc:5484] T c9240a82777b44648966e18a616fdfa2 P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index 5 to 6, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:58.350765 21820 raft_consensus.cc:2932] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:58.351289 17039 tablet_service.cc:1514] Processing DeleteTablet for tablet c9240a82777b44648966e18a616fdfa2 with delete_type TABLET_DATA_TOMBSTONED (TS 6431e35365644aac943c07c97e370fee not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:58394
I20240502 01:58:58.352586 16922 raft_consensus.cc:2932] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:58.353070 19050 raft_consensus.cc:2932] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
W20240502 01:58:58.353538 21916 consensus_queue.cc:1159] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "191fe00ca08b44c9aef6646e86aecebc" status { last_received { term: 1 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 1 index: 5 } }
I20240502 01:58:58.354274 21817 ts_tablet_manager.cc:1875] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:58.355451 16775 catalog_manager.cc:5484] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:58.356335 21817 ts_tablet_manager.cc:1888] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:58.356410 21817 log.cc:1196] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 191fe00ca08b44c9aef6646e86aecebc: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/47f0db0b9b7744758b9ca7f1e797bdb0
I20240502 01:58:58.356541 21919 tablet_replica.cc:330] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee: stopping tablet replica
I20240502 01:58:58.356480 17192 raft_consensus.cc:2932] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:58.356956 21919 raft_consensus.cc:2229] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:58.357182 21919 raft_consensus.cc:2258] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:58.357273 16764 catalog_manager.cc:4830] TS 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571): tablet 47f0db0b9b7744758b9ca7f1e797bdb0 (table rebalance_test_table_7 [id=a8b80745166a46a9a386a8805718513d]) successfully deleted
I20240502 01:58:58.358439 21919 ts_tablet_manager.cc:1875] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:58.360766 21919 ts_tablet_manager.cc:1888] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:58.360903 21919 log.cc:1196] T c9240a82777b44648966e18a616fdfa2 P 6431e35365644aac943c07c97e370fee: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/c9240a82777b44648966e18a616fdfa2
I20240502 01:58:58.361481 16764 catalog_manager.cc:4830] TS 6431e35365644aac943c07c97e370fee (127.10.133.194:37811): tablet c9240a82777b44648966e18a616fdfa2 (table rebalance_test_table_1 [id=e1f098a771d942879080a8a67a25fa1c]) successfully deleted
I20240502 01:58:58.379436 17324 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "787b9b0227da4dd08df5aeb37f0d0468"
dest_uuid: "ec11d4bb3a064a94a80084142637b441"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:51030
I20240502 01:58:58.379565 17324 raft_consensus.cc:595] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Received request to transfer leadership
I20240502 01:58:58.424260 17324 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "787b9b0227da4dd08df5aeb37f0d0468"
dest_uuid: "ec11d4bb3a064a94a80084142637b441"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:51066
I20240502 01:58:58.424412 17324 raft_consensus.cc:595] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Received request to transfer leadership
I20240502 01:58:58.446136 21863 raft_consensus.cc:1050] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee: attempting to promote NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 to VOTER
I20240502 01:58:58.446630 21863 consensus_queue.cc:237] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:58:58.448101 18919 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.448417 17192 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.448895 21863 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.449203 17324 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.450428 21855 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.450738 21855 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.451198 21892 raft_consensus.cc:1050] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc: attempting to promote NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 to VOTER
I20240502 01:58:58.451643 21892 consensus_queue.cc:237] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:58:58.452673 21855 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.453162 17192 raft_consensus.cc:1261] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.453253 17059 raft_consensus.cc:1261] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.453585 21889 consensus_queue.cc:1035] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.453755 20548 consensus_queue.cc:1035] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.454874 17193 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.455463 18919 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.457269 16775 catalog_manager.cc:5484] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:58.458950 18919 raft_consensus.cc:1261] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.459343 21640 consensus_queue.cc:1035] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.460955 17324 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.462632 17059 consensus_queue.cc:237] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:58:58.463788 18919 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:58.464169 20020 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:58.464063 21640 raft_consensus.cc:2932] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.465202 17324 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:58.465675 20020 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:58.467617 16776 catalog_manager.cc:5484] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:58.467629 17058 raft_consensus.cc:2932] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.468199 18918 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.467607 20020 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.470508 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet d9de883c491f43378a26c5a370062555 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:58.470679 16775 catalog_manager.cc:5484] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 reported cstate change: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.471307 18919 raft_consensus.cc:2932] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.474478 16923 consensus_queue.cc:237] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:58:58.475625 18918 raft_consensus.cc:1261] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:58.475850 17171 tablet_service.cc:1514] Processing DeleteTablet for tablet d9de883c491f43378a26c5a370062555 with delete_type TABLET_DATA_TOMBSTONED (TS a1c00c21761540dea7ddae8d0dd26df4 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:50964
I20240502 01:58:58.475998 17192 raft_consensus.cc:2932] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.476130 17058 raft_consensus.cc:1261] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:58.476364 21834 tablet_replica.cc:330] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4: stopping tablet replica
I20240502 01:58:58.476490 21834 raft_consensus.cc:2229] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:58.476503 20548 consensus_queue.cc:1035] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:58.476621 21834 raft_consensus.cc:2258] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:58.477931 20548 consensus_queue.cc:1035] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:58.479842 21856 raft_consensus.cc:1050] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee: attempting to promote NON_VOTER d7989bd96de94be4a94995fcfcd6b16b to VOTER
I20240502 01:58:58.480211 21856 consensus_queue.cc:237] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } }
I20240502 01:58:58.480522 20548 raft_consensus.cc:2932] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.481791 18785 raft_consensus.cc:1261] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.482034 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet fe3333c0dfe048fda6cfc8b12bf0d5a9 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:58.482529 21863 consensus_queue.cc:1035] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.483036 16773 catalog_manager.cc:5484] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:58.483336 18919 raft_consensus.cc:2932] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.484274 16923 raft_consensus.cc:1261] T cd6925b06dd64a028757d8527f896d10 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.484405 17324 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.485440 20020 consensus_queue.cc:1035] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.486042 17058 raft_consensus.cc:2932] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:58:58.487843 17171 tablet_service.cc:1514] Processing DeleteTablet for tablet fe3333c0dfe048fda6cfc8b12bf0d5a9 with delete_type TABLET_DATA_TOMBSTONED (TS a1c00c21761540dea7ddae8d0dd26df4 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:50964
I20240502 01:58:58.490362 17192 raft_consensus.cc:1261] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:58:58.490736 20020 consensus_queue.cc:1035] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:58:58.491219 21834 ts_tablet_manager.cc:1875] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:58.493188 21834 ts_tablet_manager.cc:1888] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:58.493263 21834 log.cc:1196] T d9de883c491f43378a26c5a370062555 P a1c00c21761540dea7ddae8d0dd26df4: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/wals/d9de883c491f43378a26c5a370062555
I20240502 01:58:58.493686 21834 tablet_replica.cc:330] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4: stopping tablet replica
I20240502 01:58:58.493767 16765 catalog_manager.cc:4830] TS a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923): tablet d9de883c491f43378a26c5a370062555 (table rebalance_test_table_9 [id=dbf980acd7c44315a784f2bc19c4a4a1]) successfully deleted
I20240502 01:58:58.493815 21834 raft_consensus.cc:2229] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:58.493959 21834 raft_consensus.cc:2258] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:58.494436 20020 raft_consensus.cc:2932] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.495692 21834 ts_tablet_manager.cc:1875] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:58.495916 17192 raft_consensus.cc:2932] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.496665 18785 raft_consensus.cc:2932] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.497607 21834 ts_tablet_manager.cc:1888] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:58.497659 21834 log.cc:1196] T fe3333c0dfe048fda6cfc8b12bf0d5a9 P a1c00c21761540dea7ddae8d0dd26df4: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/wals/fe3333c0dfe048fda6cfc8b12bf0d5a9
I20240502 01:58:58.498143 16765 catalog_manager.cc:4830] TS a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923): tablet fe3333c0dfe048fda6cfc8b12bf0d5a9 (table rebalance_test_table_4 [id=ed83c8027ba34b24b41cae8d5a7a294c]) successfully deleted
I20240502 01:58:58.498553 16923 raft_consensus.cc:2932] T cd6925b06dd64a028757d8527f896d10 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.499516 16773 catalog_manager.cc:5484] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b reported cstate change: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.502439 17058 consensus_queue.cc:237] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } }
I20240502 01:58:58.503427 16923 raft_consensus.cc:1261] T cd6925b06dd64a028757d8527f896d10 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:58.503436 18785 raft_consensus.cc:1261] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:58.503767 21855 consensus_queue.cc:1035] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:58.503921 20020 consensus_queue.cc:1035] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:58.505347 21855 raft_consensus.cc:2932] T cd6925b06dd64a028757d8527f896d10 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.506146 18785 raft_consensus.cc:2932] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.506557 16923 raft_consensus.cc:2932] T cd6925b06dd64a028757d8527f896d10 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.506877 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet cd6925b06dd64a028757d8527f896d10 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:58.508502 16776 catalog_manager.cc:5484] T cd6925b06dd64a028757d8527f896d10 P d7989bd96de94be4a94995fcfcd6b16b reported cstate change: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:58:58.510731 17171 tablet_service.cc:1514] Processing DeleteTablet for tablet cd6925b06dd64a028757d8527f896d10 with delete_type TABLET_DATA_TOMBSTONED (TS a1c00c21761540dea7ddae8d0dd26df4 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:50964
I20240502 01:58:58.510950 21834 tablet_replica.cc:330] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4: stopping tablet replica
I20240502 01:58:58.511144 21834 raft_consensus.cc:2229] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:58.511355 21834 raft_consensus.cc:2258] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:58.511899 21834 ts_tablet_manager.cc:1875] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:58.513401 21834 ts_tablet_manager.cc:1888] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:58.513469 21834 log.cc:1196] T cd6925b06dd64a028757d8527f896d10 P a1c00c21761540dea7ddae8d0dd26df4: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/wals/cd6925b06dd64a028757d8527f896d10
I20240502 01:58:58.513885 16765 catalog_manager.cc:4830] TS a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923): tablet cd6925b06dd64a028757d8527f896d10 (table rebalance_test_table_9 [id=dbf980acd7c44315a784f2bc19c4a4a1]) successfully deleted
I20240502 01:58:58.662026 17324 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "787b9b0227da4dd08df5aeb37f0d0468"
dest_uuid: "ec11d4bb3a064a94a80084142637b441"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:51080
I20240502 01:58:58.662186 17324 raft_consensus.cc:595] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Received request to transfer leadership
I20240502 01:58:58.693758 17324 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "787b9b0227da4dd08df5aeb37f0d0468"
dest_uuid: "ec11d4bb3a064a94a80084142637b441"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:51106
I20240502 01:58:58.693886 17324 raft_consensus.cc:595] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Received request to transfer leadership
I20240502 01:58:58.776816 19370 raft_consensus.cc:979] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441: : Instructing follower a1c00c21761540dea7ddae8d0dd26df4 to start an election
I20240502 01:58:58.776934 19370 raft_consensus.cc:1067] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Signalling peer a1c00c21761540dea7ddae8d0dd26df4 to start an election
I20240502 01:58:58.777451 17192 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "787b9b0227da4dd08df5aeb37f0d0468"
dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
from {username='slave'} at 127.10.133.196:58691
I20240502 01:58:58.777601 17192 raft_consensus.cc:482] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:58:58.777686 17192 raft_consensus.cc:3037] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:58:58.778684 17192 raft_consensus.cc:504] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:58:58.779122 17192 leader_election.cc:288] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [CANDIDATE]: Term 2 election: Requested vote from peers 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571), ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135), b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200:46021)
I20240502 01:58:58.779399 16923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "787b9b0227da4dd08df5aeb37f0d0468" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
I20240502 01:58:58.779569 16923 raft_consensus.cc:3037] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:58:58.779544 19050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "787b9b0227da4dd08df5aeb37f0d0468" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "b6aa9ef40e50468ca7a9742c21140d24"
I20240502 01:58:58.779563 17324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "787b9b0227da4dd08df5aeb37f0d0468" candidate_uuid: "a1c00c21761540dea7ddae8d0dd26df4" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "ec11d4bb3a064a94a80084142637b441"
I20240502 01:58:58.779688 17324 raft_consensus.cc:3032] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:58:58.779695 19050 raft_consensus.cc:3037] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:58:58.779722 17324 raft_consensus.cc:729] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec11d4bb3a064a94a80084142637b441, State: Running, Role: LEADER
I20240502 01:58:58.779878 17324 consensus_queue.cc:260] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:58:58.780036 17324 raft_consensus.cc:3037] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:58:58.780635 19050 raft_consensus.cc:2454] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 2.
I20240502 01:58:58.780632 16923 raft_consensus.cc:2454] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 2.
I20240502 01:58:58.780771 17324 raft_consensus.cc:2454] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1c00c21761540dea7ddae8d0dd26df4 in term 2.
I20240502 01:58:58.781028 17125 leader_election.cc:302] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, a1c00c21761540dea7ddae8d0dd26df4, b6aa9ef40e50468ca7a9742c21140d24; no voters:
I20240502 01:58:58.781235 21913 raft_consensus.cc:2781] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:58:58.781322 21913 raft_consensus.cc:686] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [term 2 LEADER]: Becoming Leader. State: Replica: a1c00c21761540dea7ddae8d0dd26df4, State: Running, Role: LEADER
I20240502 01:58:58.781466 21913 consensus_queue.cc:237] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:58:58.783334 16775 catalog_manager.cc:5484] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: term changed from 1 to 2, leader changed from ec11d4bb3a064a94a80084142637b441 (127.10.133.196) to a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195). New cstate: current_term: 2 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:58:58.869613 16923 consensus_queue.cc:237] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:58:58.870755 17192 raft_consensus.cc:1261] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:58.871001 19050 raft_consensus.cc:1261] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:58:58.871376 21889 consensus_queue.cc:1035] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:58.871574 21640 consensus_queue.cc:1035] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:58.873258 20548 raft_consensus.cc:2932] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:58.875062 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 2162035e4ed4433fafcc49934be62a9c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:58.875015 17192 raft_consensus.cc:2932] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:58.875679 19050 raft_consensus.cc:2932] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:58.877305 16775 catalog_manager.cc:5484] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 5 to 6, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:58.880020 17304 tablet_service.cc:1514] Processing DeleteTablet for tablet 2162035e4ed4433fafcc49934be62a9c with delete_type TABLET_DATA_TOMBSTONED (TS ec11d4bb3a064a94a80084142637b441 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:58608
I20240502 01:58:58.880380 22074 tablet_replica.cc:330] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441: stopping tablet replica
I20240502 01:58:58.880504 22074 raft_consensus.cc:2229] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:58.880635 22074 raft_consensus.cc:2258] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:58.881202 22074 ts_tablet_manager.cc:1875] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:58.883234 22074 ts_tablet_manager.cc:1888] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:58:58.883332 22074 log.cc:1196] T 2162035e4ed4433fafcc49934be62a9c P ec11d4bb3a064a94a80084142637b441: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/2162035e4ed4433fafcc49934be62a9c
I20240502 01:58:58.883843 16764 catalog_manager.cc:4830] TS ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135): tablet 2162035e4ed4433fafcc49934be62a9c (table rebalance_test_table_2 [id=e2d3cd2117a14964a0bc535eca4d5850]) successfully deleted
I20240502 01:58:58.896178 22075 ts_tablet_manager.cc:902] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b: Initiating tablet copy from peer 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:58:58.896665 22075 tablet_copy_client.cc:308] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37811
I20240502 01:58:58.897143 17079 tablet_copy_service.cc:140] P 6431e35365644aac943c07c97e370fee: Received BeginTabletCopySession request for tablet 1a375533a25a4da5b0030b0e06488351 from peer d7989bd96de94be4a94995fcfcd6b16b ({username='slave'} at 127.10.133.198:47861)
I20240502 01:58:58.897249 17079 tablet_copy_service.cc:161] P 6431e35365644aac943c07c97e370fee: Beginning new tablet copy session on tablet 1a375533a25a4da5b0030b0e06488351 from peer d7989bd96de94be4a94995fcfcd6b16b at {username='slave'} at 127.10.133.198:47861: session id = d7989bd96de94be4a94995fcfcd6b16b-1a375533a25a4da5b0030b0e06488351
I20240502 01:58:58.898022 17079 tablet_copy_source_session.cc:205] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:58:58.898909 22075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a375533a25a4da5b0030b0e06488351. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:58:58.900866 22075 tablet_copy_client.cc:783] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Starting download of 0 data blocks...
I20240502 01:58:58.901027 22075 tablet_copy_client.cc:647] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Starting download of 1 WAL segments...
I20240502 01:58:58.902475 22079 tablet_copy_client.cc:1002] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Injecting latency into file download: 1500
I20240502 01:58:59.194087 16923 raft_consensus.cc:1261] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20240502 01:58:59.194509 21809 consensus_queue.cc:1035] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:59.234253 17324 raft_consensus.cc:1261] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20240502 01:58:59.234700 21809 consensus_queue.cc:1035] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:59.238058 19050 raft_consensus.cc:1261] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20240502 01:58:59.238747 21913 consensus_queue.cc:1035] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:58:59.690516 17192 consensus_queue.cc:237] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 2.6, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:58:59.691648 19050 raft_consensus.cc:1261] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 2 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20240502 01:58:59.691680 16923 raft_consensus.cc:1261] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 2 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20240502 01:58:59.692071 21913 consensus_queue.cc:1035] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:58:59.692282 22118 consensus_queue.cc:1035] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:58:59.693858 21809 raft_consensus.cc:2932] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [term 2 LEADER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:59.694272 16923 raft_consensus.cc:2932] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 2 FOLLOWER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:59.694360 19050 raft_consensus.cc:2932] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:58:59.695291 16765 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 787b9b0227da4dd08df5aeb37f0d0468 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:58:59.696650 16772 catalog_manager.cc:5484] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 5 to 7, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New cstate: current_term: 2 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:58:59.699447 17304 tablet_service.cc:1514] Processing DeleteTablet for tablet 787b9b0227da4dd08df5aeb37f0d0468 with delete_type TABLET_DATA_TOMBSTONED (TS ec11d4bb3a064a94a80084142637b441 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:58608
I20240502 01:58:59.699846 22147 tablet_replica.cc:330] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441: stopping tablet replica
I20240502 01:58:59.699978 22147 raft_consensus.cc:2229] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 01:58:59.700090 22147 raft_consensus.cc:2258] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:58:59.700647 22147 ts_tablet_manager.cc:1875] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:58:59.702492 22147 ts_tablet_manager.cc:1888] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.6
I20240502 01:58:59.702564 22147 log.cc:1196] T 787b9b0227da4dd08df5aeb37f0d0468 P ec11d4bb3a064a94a80084142637b441: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/787b9b0227da4dd08df5aeb37f0d0468
I20240502 01:58:59.703033 16764 catalog_manager.cc:4830] TS ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135): tablet 787b9b0227da4dd08df5aeb37f0d0468 (table rebalance_test_table_3 [id=0c4182cf7d98406d87a12a073ef6b915]) successfully deleted
I20240502 01:59:00.402959 22075 tablet_copy_client.cc:523] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:00.404568 22075 tablet_bootstrap.cc:492] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap starting.
I20240502 01:59:00.421574 22075 tablet_bootstrap.cc:492] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:00.421869 22075 tablet_bootstrap.cc:492] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap complete.
I20240502 01:59:00.422086 22075 ts_tablet_manager.cc:1367] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b: Time spent bootstrapping tablet: real 0.018s user 0.015s sys 0.004s
I20240502 01:59:00.422472 22075 raft_consensus.cc:348] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:59:00.422574 22075 raft_consensus.cc:729] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d7989bd96de94be4a94995fcfcd6b16b, State: Initialized, Role: LEARNER
I20240502 01:59:00.422685 22075 consensus_queue.cc:260] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:59:00.422997 22075 ts_tablet_manager.cc:1398] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:00.423496 17079 tablet_copy_service.cc:342] P 6431e35365644aac943c07c97e370fee: Request end of tablet copy session d7989bd96de94be4a94995fcfcd6b16b-1a375533a25a4da5b0030b0e06488351 received from {username='slave'} at 127.10.133.198:47861
I20240502 01:59:00.423574 17079 tablet_copy_service.cc:433] P 6431e35365644aac943c07c97e370fee: ending tablet copy session d7989bd96de94be4a94995fcfcd6b16b-1a375533a25a4da5b0030b0e06488351 on tablet 1a375533a25a4da5b0030b0e06488351 with peer d7989bd96de94be4a94995fcfcd6b16b
I20240502 01:59:00.505333 18784 raft_consensus.cc:1203] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:59:01.006106 22194 raft_consensus.cc:1050] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee: attempting to promote NON_VOTER d7989bd96de94be4a94995fcfcd6b16b to VOTER
I20240502 01:59:01.006536 22194 consensus_queue.cc:237] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } }
I20240502 01:59:01.007995 16923 raft_consensus.cc:1261] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:01.008137 18784 raft_consensus.cc:1261] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b [term 1 LEARNER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:01.008275 17192 raft_consensus.cc:1261] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:01.008677 22194 consensus_queue.cc:1035] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:01.008843 22170 consensus_queue.cc:1035] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:01.008952 22183 consensus_queue.cc:1035] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:01.010999 22196 raft_consensus.cc:2932] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:59:01.011518 18784 raft_consensus.cc:2932] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:59:01.012099 17192 raft_consensus.cc:2932] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:59:01.013094 16923 raft_consensus.cc:2932] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:59:01.014637 16775 catalog_manager.cc:5484] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 4 to 5, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:01.019233 17058 consensus_queue.cc:237] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } }
I20240502 01:59:01.020529 16923 raft_consensus.cc:1261] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:01.020648 18784 raft_consensus.cc:1261] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:01.020995 22194 consensus_queue.cc:1035] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:01.021591 22194 consensus_queue.cc:1035] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:01.024704 22170 raft_consensus.cc:2932] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:59:01.025138 16923 raft_consensus.cc:2932] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:59:01.026566 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 1a375533a25a4da5b0030b0e06488351 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:01.027272 16773 catalog_manager.cc:5484] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:01.027529 18784 raft_consensus.cc:2932] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:59:01.029847 17171 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a375533a25a4da5b0030b0e06488351 with delete_type TABLET_DATA_TOMBSTONED (TS a1c00c21761540dea7ddae8d0dd26df4 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:50964
I20240502 01:59:01.030927 22211 tablet_replica.cc:330] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4: stopping tablet replica
I20240502 01:59:01.031436 22211 raft_consensus.cc:2229] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:01.031683 22211 raft_consensus.cc:2258] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:01.032306 22211 ts_tablet_manager.cc:1875] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:01.034212 22211 ts_tablet_manager.cc:1888] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:59:01.034277 22211 log.cc:1196] T 1a375533a25a4da5b0030b0e06488351 P a1c00c21761540dea7ddae8d0dd26df4: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/wals/1a375533a25a4da5b0030b0e06488351
I20240502 01:59:01.034780 16765 catalog_manager.cc:4830] TS a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923): tablet 1a375533a25a4da5b0030b0e06488351 (table rebalance_test_table_1 [id=e1f098a771d942879080a8a67a25fa1c]) successfully deleted
I20240502 01:59:01.303580 17039 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:59:01.308208 17171 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:01.309944 18632 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:01.317323 16901 tablet_service.cc:1429] Tablet server has 9 leaders and 0 scanners
I20240502 01:59:01.326272 19030 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:01.326915 17304 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:01.340301 18898 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:01.342919 18765 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:01.344408 19951 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:01.384881 16923 consensus_queue.cc:237] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:01.386462 18784 raft_consensus.cc:1261] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:01.386462 17058 raft_consensus.cc:1261] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:01.386874 22204 consensus_queue.cc:1035] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.387037 21640 consensus_queue.cc:1035] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.388993 22274 raft_consensus.cc:2932] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:01.389350 17058 raft_consensus.cc:2932] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:01.389350 18784 raft_consensus.cc:2932] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
W20240502 01:59:01.392215 16859 consensus_peers.cc:485] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc -> Peer 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201:36215): Couldn't send request to peer 71c28e01ad304ab2a6adf2eb26ba7cc9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df21aa40548c4f49bae79294085c80f4. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:01.392765 16775 catalog_manager.cc:5484] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b reported cstate change: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:01.399883 17058 consensus_queue.cc:237] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:59:01.401396 18918 raft_consensus.cc:1261] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:01.401489 17324 raft_consensus.cc:1261] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 01:59:01.401598 16991 consensus_peers.cc:485] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee -> Peer 436e7859396c42a6b60714873cb60495 (127.10.133.197:45213): Couldn't send request to peer 436e7859396c42a6b60714873cb60495. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a386a1fd8ae4d70ae482b3ce958825b. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:01.401845 22170 consensus_queue.cc:1035] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.402007 22183 consensus_queue.cc:1035] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.403729 22183 raft_consensus.cc:2932] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:59:01.404681 18918 raft_consensus.cc:2932] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:59:01.405339 17324 raft_consensus.cc:2932] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:59:01.406358 16773 catalog_manager.cc:5484] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 6 to 7, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:01.415127 17324 consensus_queue.cc:237] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:59:01.416389 18784 raft_consensus.cc:1261] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:01.416416 16923 raft_consensus.cc:1261] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 01:59:01.416657 17261 consensus_peers.cc:485] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 -> Peer b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200:46021): Couldn't send request to peer b6aa9ef40e50468ca7a9742c21140d24. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c92206bbd4340d59a7ee7379f581bb7. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:01.416788 19370 consensus_queue.cc:1035] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.416965 22290 consensus_queue.cc:1035] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.419435 16923 raft_consensus.cc:2932] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:59:01.419435 18784 raft_consensus.cc:2932] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:59:01.419137 22291 raft_consensus.cc:2932] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:59:01.421844 16774 catalog_manager.cc:5484] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b reported cstate change: config changed from index 6 to 7, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:59:01.430727 17058 consensus_queue.cc:237] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
W20240502 01:59:01.431898 16991 consensus_peers.cc:485] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee -> Peer b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199:34045): Couldn't send request to peer b7ec79239ce64b38a1d55f66a95407c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a375533a25a4da5b0030b0e06488351. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:01.431907 18784 raft_consensus.cc:1261] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:01.432009 16923 raft_consensus.cc:1261] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:01.432361 22170 consensus_queue.cc:1035] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.432523 22196 consensus_queue.cc:1035] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.434070 22196 raft_consensus.cc:2932] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:59:01.434638 18784 raft_consensus.cc:2932] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:59:01.435695 16923 raft_consensus.cc:2932] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:59:01.436556 16774 catalog_manager.cc:5484] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 6 to 7, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:01.443996 17324 consensus_queue.cc:237] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 2.7, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:59:01.445328 17192 raft_consensus.cc:1261] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 2 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 2 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20240502 01:59:01.445353 19050 raft_consensus.cc:1261] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 2 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20240502 01:59:01.445693 22294 consensus_queue.cc:1035] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20240502 01:59:01.445890 17259 consensus_peers.cc:485] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 -> Peer d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198:45549): Couldn't send request to peer d7989bd96de94be4a94995fcfcd6b16b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e03fff9bc743475d92ae26b85e7f39ff. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:01.445912 22291 consensus_queue.cc:1035] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:01.447681 22290 raft_consensus.cc:2932] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [term 2 LEADER]: Committing config change with OpId 2.8: config changed from index 7 to 8, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:59:01.448177 17192 raft_consensus.cc:2932] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 2 FOLLOWER]: Committing config change with OpId 2.8: config changed from index 7 to 8, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:59:01.449241 19050 raft_consensus.cc:2932] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Committing config change with OpId 2.8: config changed from index 7 to 8, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } } }
I20240502 01:59:01.451283 16775 catalog_manager.cc:5484] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index 7 to 8, NON_VOTER d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) added. New cstate: current_term: 2 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:01.458849 17058 consensus_queue.cc:237] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:01.460290 19050 raft_consensus.cc:1261] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:01.460760 17324 raft_consensus.cc:1261] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:01.461233 22170 consensus_queue.cc:1035] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.461386 22183 consensus_queue.cc:1035] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.463037 22194 raft_consensus.cc:2932] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:01.463449 19050 raft_consensus.cc:2932] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
W20240502 01:59:01.467197 16992 consensus_peers.cc:485] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee -> Peer 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201:36215): Couldn't send request to peer 71c28e01ad304ab2a6adf2eb26ba7cc9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a396235bc534141bcd180430c51e7e1. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:01.465866 16772 catalog_manager.cc:5484] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:01.467633 17324 raft_consensus.cc:2932] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:01.474985 17192 consensus_queue.cc:237] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 2.7, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:59:01.476545 19050 raft_consensus.cc:1261] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 2 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20240502 01:59:01.476555 16923 raft_consensus.cc:1261] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 2 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
W20240502 01:59:01.476836 17127 consensus_peers.cc:485] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 -> Peer 436e7859396c42a6b60714873cb60495 (127.10.133.197:45213): Couldn't send request to peer 436e7859396c42a6b60714873cb60495. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 787b9b0227da4dd08df5aeb37f0d0468. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:01.476958 22326 consensus_queue.cc:1035] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:01.477121 22325 consensus_queue.cc:1035] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:01.479269 22325 raft_consensus.cc:2932] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [term 2 LEADER]: Committing config change with OpId 2.8: config changed from index 7 to 8, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:59:01.482949 19050 raft_consensus.cc:2932] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Committing config change with OpId 2.8: config changed from index 7 to 8, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:59:01.483031 16923 raft_consensus.cc:2932] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 2 FOLLOWER]: Committing config change with OpId 2.8: config changed from index 7 to 8, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:59:01.485711 16772 catalog_manager.cc:5484] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 7 to 8, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New cstate: current_term: 2 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:01.493681 17324 consensus_queue.cc:237] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:59:01.495223 18918 raft_consensus.cc:1261] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 01:59:01.495631 17261 consensus_peers.cc:485] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 -> Peer b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200:46021): Couldn't send request to peer b6aa9ef40e50468ca7a9742c21140d24. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64b3111c603247ac8ff4a1eb9369086f. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:01.495779 17058 raft_consensus.cc:1261] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:01.495759 19370 consensus_queue.cc:1035] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.496166 19370 consensus_queue.cc:1035] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.497953 22294 raft_consensus.cc:2932] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:59:01.498387 18918 raft_consensus.cc:2932] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:59:01.500686 16775 catalog_manager.cc:5484] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index 6 to 7, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:01.501405 17059 raft_consensus.cc:2932] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:59:01.510993 17192 consensus_queue.cc:237] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:59:01.512253 18784 raft_consensus.cc:1261] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:01.512367 17059 raft_consensus.cc:1261] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 01:59:01.512534 17127 consensus_peers.cc:485] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 -> Peer b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199:34045): Couldn't send request to peer b7ec79239ce64b38a1d55f66a95407c0. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 47f0db0b9b7744758b9ca7f1e797bdb0. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:01.512684 22118 consensus_queue.cc:1035] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.512859 22325 consensus_queue.cc:1035] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.514572 22118 raft_consensus.cc:2932] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:59:01.515117 17059 raft_consensus.cc:2932] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:59:01.516204 18784 raft_consensus.cc:2932] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } } }
I20240502 01:59:01.517033 16774 catalog_manager.cc:5484] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 6 to 7, NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) added. New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:01.525113 16923 consensus_queue.cc:237] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:01.526358 18918 raft_consensus.cc:1261] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 01:59:01.526572 16859 consensus_peers.cc:485] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc -> Peer 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201:36215): Couldn't send request to peer 71c28e01ad304ab2a6adf2eb26ba7cc9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 029dba0050a64bd4adb35e9815450450. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:01.526701 17192 raft_consensus.cc:1261] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:01.526724 22204 consensus_queue.cc:1035] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.527025 21640 consensus_queue.cc:1035] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.528363 22204 raft_consensus.cc:2932] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:01.528787 18918 raft_consensus.cc:2932] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:01.529179 17192 raft_consensus.cc:2932] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:01.531288 16774 catalog_manager.cc:5484] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:01.538811 17192 consensus_queue.cc:237] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 2.7, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:01.540048 18918 raft_consensus.cc:1261] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0 [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 2 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20240502 01:59:01.540138 17324 raft_consensus.cc:1261] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 2 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
I20240502 01:59:01.540423 22326 consensus_queue.cc:1035] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:01.541447 22326 consensus_queue.cc:1035] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:01.542249 22325 raft_consensus.cc:2932] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [term 2 LEADER]: Committing config change with OpId 2.8: config changed from index 7 to 8, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:01.542698 18918 raft_consensus.cc:2932] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0 [term 2 FOLLOWER]: Committing config change with OpId 2.8: config changed from index 7 to 8, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:01.543581 17324 raft_consensus.cc:2932] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Committing config change with OpId 2.8: config changed from index 7 to 8, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:01.545521 16775 catalog_manager.cc:5484] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0 reported cstate change: config changed from index 7 to 8, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New cstate: current_term: 2 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
W20240502 01:59:01.546083 17128 consensus_peers.cc:485] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 -> Peer 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201:36215): Couldn't send request to peer 71c28e01ad304ab2a6adf2eb26ba7cc9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 086b486997ae4d15a4b070e79552807f. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:01.553347 16923 consensus_queue.cc:237] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:59:01.554719 17192 raft_consensus.cc:1261] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:01.554796 19050 raft_consensus.cc:1261] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:01.555197 22274 consensus_queue.cc:1035] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.555373 21640 consensus_queue.cc:1035] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20240502 01:59:01.555547 16858 consensus_peers.cc:485] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc -> Peer 436e7859396c42a6b60714873cb60495 (127.10.133.197:45213): Couldn't send request to peer 436e7859396c42a6b60714873cb60495. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2162035e4ed4433fafcc49934be62a9c. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:01.557155 22204 raft_consensus.cc:2932] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:59:01.557513 17192 raft_consensus.cc:2932] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:59:01.557628 19050 raft_consensus.cc:2932] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:59:01.560369 16774 catalog_manager.cc:5484] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 6 to 7, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:01.566589 17059 consensus_queue.cc:237] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:59:01.567826 18918 raft_consensus.cc:1261] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:01.567977 16923 raft_consensus.cc:1261] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 01:59:01.568118 16992 consensus_peers.cc:485] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee -> Peer b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200:46021): Couldn't send request to peer b6aa9ef40e50468ca7a9742c21140d24. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7d9d4310df14878a5ae4167c5320e3a. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:01.568212 22194 consensus_queue.cc:1035] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.568377 22196 consensus_queue.cc:1035] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.570122 22183 raft_consensus.cc:2932] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:59:01.570565 16923 raft_consensus.cc:2932] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:59:01.571950 18918 raft_consensus.cc:2932] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } } }
I20240502 01:59:01.572710 16772 catalog_manager.cc:5484] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 6 to 7, NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:01.580543 17192 consensus_queue.cc:237] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:01.581903 17324 raft_consensus.cc:1261] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:01.582032 18650 raft_consensus.cc:1261] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 01:59:01.582082 17128 consensus_peers.cc:485] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 -> Peer 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201:36215): Couldn't send request to peer 71c28e01ad304ab2a6adf2eb26ba7cc9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a475490b83164ff3930aae5978e7845e. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:01.582336 22326 consensus_queue.cc:1035] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.582536 22325 consensus_queue.cc:1035] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.584235 22118 raft_consensus.cc:2932] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:01.584668 18650 raft_consensus.cc:2932] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:01.584789 17324 raft_consensus.cc:2932] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:01.587011 16775 catalog_manager.cc:5484] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:01.595407 17059 consensus_queue.cc:237] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:59:01.596850 17325 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:01.597205 18918 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:01.597249 22196 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20240502 01:59:01.597438 16991 consensus_peers.cc:485] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee -> Peer 436e7859396c42a6b60714873cb60495 (127.10.133.197:45213): Couldn't send request to peer 436e7859396c42a6b60714873cb60495. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d9de883c491f43378a26c5a370062555. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:01.597640 22196 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:01.598966 22183 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:59:01.599366 17325 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:59:01.599754 18918 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } }
I20240502 01:59:01.602826 16772 catalog_manager.cc:5484] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 6 to 7, NON_VOTER 436e7859396c42a6b60714873cb60495 (127.10.133.197) added. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:01.820541 22472 ts_tablet_manager.cc:902] T 7c92206bbd4340d59a7ee7379f581bb7 P b6aa9ef40e50468ca7a9742c21140d24: Initiating tablet copy from peer ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:59:01.821060 22472 tablet_copy_client.cc:308] T 7c92206bbd4340d59a7ee7379f581bb7 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.196:38135
I20240502 01:59:01.821540 17346 tablet_copy_service.cc:140] P ec11d4bb3a064a94a80084142637b441: Received BeginTabletCopySession request for tablet 7c92206bbd4340d59a7ee7379f581bb7 from peer b6aa9ef40e50468ca7a9742c21140d24 ({username='slave'} at 127.10.133.200:54049)
I20240502 01:59:01.821650 17346 tablet_copy_service.cc:161] P ec11d4bb3a064a94a80084142637b441: Beginning new tablet copy session on tablet 7c92206bbd4340d59a7ee7379f581bb7 from peer b6aa9ef40e50468ca7a9742c21140d24 at {username='slave'} at 127.10.133.200:54049: session id = b6aa9ef40e50468ca7a9742c21140d24-7c92206bbd4340d59a7ee7379f581bb7
I20240502 01:59:01.822422 17346 tablet_copy_source_session.cc:205] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:01.823261 22472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c92206bbd4340d59a7ee7379f581bb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:01.825042 22472 tablet_copy_client.cc:783] T 7c92206bbd4340d59a7ee7379f581bb7 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:01.825271 22472 tablet_copy_client.cc:647] T 7c92206bbd4340d59a7ee7379f581bb7 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:01.826251 22476 tablet_copy_client.cc:1002] T 7c92206bbd4340d59a7ee7379f581bb7 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Injecting latency into file download: 1500
I20240502 01:59:01.832085 22477 ts_tablet_manager.cc:902] T 8a386a1fd8ae4d70ae482b3ce958825b P 436e7859396c42a6b60714873cb60495: Initiating tablet copy from peer 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:59:01.832607 22477 tablet_copy_client.cc:308] T 8a386a1fd8ae4d70ae482b3ce958825b P 436e7859396c42a6b60714873cb60495: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37811
I20240502 01:59:01.833106 17079 tablet_copy_service.cc:140] P 6431e35365644aac943c07c97e370fee: Received BeginTabletCopySession request for tablet 8a386a1fd8ae4d70ae482b3ce958825b from peer 436e7859396c42a6b60714873cb60495 ({username='slave'} at 127.10.133.197:58823)
I20240502 01:59:01.833217 17079 tablet_copy_service.cc:161] P 6431e35365644aac943c07c97e370fee: Beginning new tablet copy session on tablet 8a386a1fd8ae4d70ae482b3ce958825b from peer 436e7859396c42a6b60714873cb60495 at {username='slave'} at 127.10.133.197:58823: session id = 436e7859396c42a6b60714873cb60495-8a386a1fd8ae4d70ae482b3ce958825b
I20240502 01:59:01.834107 17079 tablet_copy_source_session.cc:205] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:01.835013 22477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a386a1fd8ae4d70ae482b3ce958825b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:01.837210 22477 tablet_copy_client.cc:783] T 8a386a1fd8ae4d70ae482b3ce958825b P 436e7859396c42a6b60714873cb60495: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:01.837373 22477 tablet_copy_client.cc:647] T 8a386a1fd8ae4d70ae482b3ce958825b P 436e7859396c42a6b60714873cb60495: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:01.838428 22481 tablet_copy_client.cc:1002] T 8a386a1fd8ae4d70ae482b3ce958825b P 436e7859396c42a6b60714873cb60495: tablet copy: Injecting latency into file download: 1500
I20240502 01:59:01.838459 22482 ts_tablet_manager.cc:902] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Initiating tablet copy from peer 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:59:01.839291 22482 tablet_copy_client.cc:308] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:45571
I20240502 01:59:01.842975 16943 tablet_copy_service.cc:140] P 191fe00ca08b44c9aef6646e86aecebc: Received BeginTabletCopySession request for tablet df21aa40548c4f49bae79294085c80f4 from peer 71c28e01ad304ab2a6adf2eb26ba7cc9 ({username='slave'} at 127.10.133.201:46641)
I20240502 01:59:01.843072 16943 tablet_copy_service.cc:161] P 191fe00ca08b44c9aef6646e86aecebc: Beginning new tablet copy session on tablet df21aa40548c4f49bae79294085c80f4 from peer 71c28e01ad304ab2a6adf2eb26ba7cc9 at {username='slave'} at 127.10.133.201:46641: session id = 71c28e01ad304ab2a6adf2eb26ba7cc9-df21aa40548c4f49bae79294085c80f4
I20240502 01:59:01.843814 16943 tablet_copy_source_session.cc:205] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:01.845717 22488 ts_tablet_manager.cc:902] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0: Initiating tablet copy from peer 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:59:01.846287 22488 tablet_copy_client.cc:308] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37811
I20240502 01:59:01.846763 17079 tablet_copy_service.cc:140] P 6431e35365644aac943c07c97e370fee: Received BeginTabletCopySession request for tablet 1a375533a25a4da5b0030b0e06488351 from peer b7ec79239ce64b38a1d55f66a95407c0 ({username='slave'} at 127.10.133.199:45123)
I20240502 01:59:01.846859 17079 tablet_copy_service.cc:161] P 6431e35365644aac943c07c97e370fee: Beginning new tablet copy session on tablet 1a375533a25a4da5b0030b0e06488351 from peer b7ec79239ce64b38a1d55f66a95407c0 at {username='slave'} at 127.10.133.199:45123: session id = b7ec79239ce64b38a1d55f66a95407c0-1a375533a25a4da5b0030b0e06488351
I20240502 01:59:01.847141 22482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df21aa40548c4f49bae79294085c80f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:01.847537 17079 tablet_copy_source_session.cc:205] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:01.848294 22488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a375533a25a4da5b0030b0e06488351. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:01.850564 22488 tablet_copy_client.cc:783] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:01.850713 22488 tablet_copy_client.cc:647] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:01.851833 22493 tablet_copy_client.cc:1002] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Injecting latency into file download: 1500
I20240502 01:59:01.852697 22482 tablet_copy_client.cc:783] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:01.852860 22482 tablet_copy_client.cc:647] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:01.854043 22486 tablet_copy_client.cc:1002] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Injecting latency into file download: 1500
I20240502 01:59:01.918666 22532 ts_tablet_manager.cc:902] T 787b9b0227da4dd08df5aeb37f0d0468 P 436e7859396c42a6b60714873cb60495: Initiating tablet copy from peer a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:59:01.919246 22532 tablet_copy_client.cc:308] T 787b9b0227da4dd08df5aeb37f0d0468 P 436e7859396c42a6b60714873cb60495: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.195:35923
I20240502 01:59:01.919706 17214 tablet_copy_service.cc:140] P a1c00c21761540dea7ddae8d0dd26df4: Received BeginTabletCopySession request for tablet 787b9b0227da4dd08df5aeb37f0d0468 from peer 436e7859396c42a6b60714873cb60495 ({username='slave'} at 127.10.133.197:53483)
I20240502 01:59:01.919816 17214 tablet_copy_service.cc:161] P a1c00c21761540dea7ddae8d0dd26df4: Beginning new tablet copy session on tablet 787b9b0227da4dd08df5aeb37f0d0468 from peer 436e7859396c42a6b60714873cb60495 at {username='slave'} at 127.10.133.197:53483: session id = 436e7859396c42a6b60714873cb60495-787b9b0227da4dd08df5aeb37f0d0468
I20240502 01:59:01.920743 17214 tablet_copy_source_session.cc:205] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:01.921633 22532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 787b9b0227da4dd08df5aeb37f0d0468. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:01.923806 22532 tablet_copy_client.cc:783] T 787b9b0227da4dd08df5aeb37f0d0468 P 436e7859396c42a6b60714873cb60495: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:01.924021 22532 tablet_copy_client.cc:647] T 787b9b0227da4dd08df5aeb37f0d0468 P 436e7859396c42a6b60714873cb60495: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:01.925027 22538 tablet_copy_client.cc:1002] T 787b9b0227da4dd08df5aeb37f0d0468 P 436e7859396c42a6b60714873cb60495: tablet copy: Injecting latency into file download: 1500
I20240502 01:59:01.927052 22544 ts_tablet_manager.cc:902] T 086b486997ae4d15a4b070e79552807f P 71c28e01ad304ab2a6adf2eb26ba7cc9: Initiating tablet copy from peer a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:59:01.927906 22544 tablet_copy_client.cc:308] T 086b486997ae4d15a4b070e79552807f P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.195:35923
I20240502 01:59:01.934194 17214 tablet_copy_service.cc:140] P a1c00c21761540dea7ddae8d0dd26df4: Received BeginTabletCopySession request for tablet 086b486997ae4d15a4b070e79552807f from peer 71c28e01ad304ab2a6adf2eb26ba7cc9 ({username='slave'} at 127.10.133.201:58657)
I20240502 01:59:01.934311 17214 tablet_copy_service.cc:161] P a1c00c21761540dea7ddae8d0dd26df4: Beginning new tablet copy session on tablet 086b486997ae4d15a4b070e79552807f from peer 71c28e01ad304ab2a6adf2eb26ba7cc9 at {username='slave'} at 127.10.133.201:58657: session id = 71c28e01ad304ab2a6adf2eb26ba7cc9-086b486997ae4d15a4b070e79552807f
I20240502 01:59:01.935276 17214 tablet_copy_source_session.cc:205] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:01.936172 22544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 086b486997ae4d15a4b070e79552807f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:01.938338 22544 tablet_copy_client.cc:783] T 086b486997ae4d15a4b070e79552807f P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:01.938469 22544 tablet_copy_client.cc:647] T 086b486997ae4d15a4b070e79552807f P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:01.939478 22548 tablet_copy_client.cc:1002] T 086b486997ae4d15a4b070e79552807f P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Injecting latency into file download: 1500
I20240502 01:59:01.952389 22569 ts_tablet_manager.cc:902] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495: Initiating tablet copy from peer 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:59:01.952992 22569 tablet_copy_client.cc:308] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:45571
I20240502 01:59:01.953521 16943 tablet_copy_service.cc:140] P 191fe00ca08b44c9aef6646e86aecebc: Received BeginTabletCopySession request for tablet 2162035e4ed4433fafcc49934be62a9c from peer 436e7859396c42a6b60714873cb60495 ({username='slave'} at 127.10.133.197:36399)
I20240502 01:59:01.953642 16943 tablet_copy_service.cc:161] P 191fe00ca08b44c9aef6646e86aecebc: Beginning new tablet copy session on tablet 2162035e4ed4433fafcc49934be62a9c from peer 436e7859396c42a6b60714873cb60495 at {username='slave'} at 127.10.133.197:36399: session id = 436e7859396c42a6b60714873cb60495-2162035e4ed4433fafcc49934be62a9c
I20240502 01:59:01.954476 16943 tablet_copy_source_session.cc:205] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:01.955804 22569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2162035e4ed4433fafcc49934be62a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:01.958302 22569 tablet_copy_client.cc:783] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:01.958448 22569 tablet_copy_client.cc:647] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:01.959457 22570 tablet_copy_client.cc:1002] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495: tablet copy: Injecting latency into file download: 1500
I20240502 01:59:01.970160 22584 ts_tablet_manager.cc:902] T f7d9d4310df14878a5ae4167c5320e3a P b6aa9ef40e50468ca7a9742c21140d24: Initiating tablet copy from peer 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:59:01.970656 22584 tablet_copy_client.cc:308] T f7d9d4310df14878a5ae4167c5320e3a P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37811
I20240502 01:59:01.971251 17079 tablet_copy_service.cc:140] P 6431e35365644aac943c07c97e370fee: Received BeginTabletCopySession request for tablet f7d9d4310df14878a5ae4167c5320e3a from peer b6aa9ef40e50468ca7a9742c21140d24 ({username='slave'} at 127.10.133.200:46059)
I20240502 01:59:01.971391 17079 tablet_copy_service.cc:161] P 6431e35365644aac943c07c97e370fee: Beginning new tablet copy session on tablet f7d9d4310df14878a5ae4167c5320e3a from peer b6aa9ef40e50468ca7a9742c21140d24 at {username='slave'} at 127.10.133.200:46059: session id = b6aa9ef40e50468ca7a9742c21140d24-f7d9d4310df14878a5ae4167c5320e3a
I20240502 01:59:01.972272 17079 tablet_copy_source_session.cc:205] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:01.972942 22584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7d9d4310df14878a5ae4167c5320e3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:01.974663 22584 tablet_copy_client.cc:783] T f7d9d4310df14878a5ae4167c5320e3a P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:01.974915 22584 tablet_copy_client.cc:647] T f7d9d4310df14878a5ae4167c5320e3a P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:01.975888 22588 tablet_copy_client.cc:1002] T f7d9d4310df14878a5ae4167c5320e3a P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Injecting latency into file download: 1500
I20240502 01:59:01.981565 22589 ts_tablet_manager.cc:902] T a475490b83164ff3930aae5978e7845e P 71c28e01ad304ab2a6adf2eb26ba7cc9: Initiating tablet copy from peer a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:59:01.982048 22589 tablet_copy_client.cc:308] T a475490b83164ff3930aae5978e7845e P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.195:35923
I20240502 01:59:01.982468 17214 tablet_copy_service.cc:140] P a1c00c21761540dea7ddae8d0dd26df4: Received BeginTabletCopySession request for tablet a475490b83164ff3930aae5978e7845e from peer 71c28e01ad304ab2a6adf2eb26ba7cc9 ({username='slave'} at 127.10.133.201:58657)
I20240502 01:59:01.982563 17214 tablet_copy_service.cc:161] P a1c00c21761540dea7ddae8d0dd26df4: Beginning new tablet copy session on tablet a475490b83164ff3930aae5978e7845e from peer 71c28e01ad304ab2a6adf2eb26ba7cc9 at {username='slave'} at 127.10.133.201:58657: session id = 71c28e01ad304ab2a6adf2eb26ba7cc9-a475490b83164ff3930aae5978e7845e
I20240502 01:59:01.983247 17214 tablet_copy_source_session.cc:205] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:01.983996 22589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a475490b83164ff3930aae5978e7845e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:01.985653 22589 tablet_copy_client.cc:783] T a475490b83164ff3930aae5978e7845e P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:01.985787 22589 tablet_copy_client.cc:647] T a475490b83164ff3930aae5978e7845e P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:01.986789 22593 tablet_copy_client.cc:1002] T a475490b83164ff3930aae5978e7845e P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Injecting latency into file download: 1500
I20240502 01:59:02.006824 22594 ts_tablet_manager.cc:902] T 47f0db0b9b7744758b9ca7f1e797bdb0 P b7ec79239ce64b38a1d55f66a95407c0: Initiating tablet copy from peer a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923)
I20240502 01:59:02.007331 22594 tablet_copy_client.cc:308] T 47f0db0b9b7744758b9ca7f1e797bdb0 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.195:35923
I20240502 01:59:02.011068 17214 tablet_copy_service.cc:140] P a1c00c21761540dea7ddae8d0dd26df4: Received BeginTabletCopySession request for tablet 47f0db0b9b7744758b9ca7f1e797bdb0 from peer b7ec79239ce64b38a1d55f66a95407c0 ({username='slave'} at 127.10.133.199:40327)
I20240502 01:59:02.011152 22600 ts_tablet_manager.cc:902] T e03fff9bc743475d92ae26b85e7f39ff P d7989bd96de94be4a94995fcfcd6b16b: Initiating tablet copy from peer ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:59:02.011169 17214 tablet_copy_service.cc:161] P a1c00c21761540dea7ddae8d0dd26df4: Beginning new tablet copy session on tablet 47f0db0b9b7744758b9ca7f1e797bdb0 from peer b7ec79239ce64b38a1d55f66a95407c0 at {username='slave'} at 127.10.133.199:40327: session id = b7ec79239ce64b38a1d55f66a95407c0-47f0db0b9b7744758b9ca7f1e797bdb0
I20240502 01:59:02.011700 22600 tablet_copy_client.cc:308] T e03fff9bc743475d92ae26b85e7f39ff P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.196:38135
I20240502 01:59:02.012230 17214 tablet_copy_source_session.cc:205] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:02.012286 17346 tablet_copy_service.cc:140] P ec11d4bb3a064a94a80084142637b441: Received BeginTabletCopySession request for tablet e03fff9bc743475d92ae26b85e7f39ff from peer d7989bd96de94be4a94995fcfcd6b16b ({username='slave'} at 127.10.133.198:57185)
I20240502 01:59:02.012368 17346 tablet_copy_service.cc:161] P ec11d4bb3a064a94a80084142637b441: Beginning new tablet copy session on tablet e03fff9bc743475d92ae26b85e7f39ff from peer d7989bd96de94be4a94995fcfcd6b16b at {username='slave'} at 127.10.133.198:57185: session id = d7989bd96de94be4a94995fcfcd6b16b-e03fff9bc743475d92ae26b85e7f39ff
I20240502 01:59:02.013228 17346 tablet_copy_source_session.cc:205] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:02.014225 22594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47f0db0b9b7744758b9ca7f1e797bdb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:02.014330 22600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e03fff9bc743475d92ae26b85e7f39ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:02.016211 22594 tablet_copy_client.cc:783] T 47f0db0b9b7744758b9ca7f1e797bdb0 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:02.016364 22594 tablet_copy_client.cc:647] T 47f0db0b9b7744758b9ca7f1e797bdb0 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:02.016453 22600 tablet_copy_client.cc:783] T e03fff9bc743475d92ae26b85e7f39ff P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:02.016613 22600 tablet_copy_client.cc:647] T e03fff9bc743475d92ae26b85e7f39ff P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:02.016961 22605 ts_tablet_manager.cc:902] T 1a396235bc534141bcd180430c51e7e1 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Initiating tablet copy from peer 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:59:02.017401 22598 tablet_copy_client.cc:1002] T 47f0db0b9b7744758b9ca7f1e797bdb0 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Injecting latency into file download: 1500
I20240502 01:59:02.017728 22605 tablet_copy_client.cc:308] T 1a396235bc534141bcd180430c51e7e1 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37811
I20240502 01:59:02.018102 22602 tablet_copy_client.cc:1002] T e03fff9bc743475d92ae26b85e7f39ff P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Injecting latency into file download: 1500
I20240502 01:59:02.021802 17079 tablet_copy_service.cc:140] P 6431e35365644aac943c07c97e370fee: Received BeginTabletCopySession request for tablet 1a396235bc534141bcd180430c51e7e1 from peer 71c28e01ad304ab2a6adf2eb26ba7cc9 ({username='slave'} at 127.10.133.201:33809)
I20240502 01:59:02.021914 17079 tablet_copy_service.cc:161] P 6431e35365644aac943c07c97e370fee: Beginning new tablet copy session on tablet 1a396235bc534141bcd180430c51e7e1 from peer 71c28e01ad304ab2a6adf2eb26ba7cc9 at {username='slave'} at 127.10.133.201:33809: session id = 71c28e01ad304ab2a6adf2eb26ba7cc9-1a396235bc534141bcd180430c51e7e1
I20240502 01:59:02.022773 17079 tablet_copy_source_session.cc:205] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:02.023586 22605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a396235bc534141bcd180430c51e7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:02.025631 22605 tablet_copy_client.cc:783] T 1a396235bc534141bcd180430c51e7e1 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:02.025764 22605 tablet_copy_client.cc:647] T 1a396235bc534141bcd180430c51e7e1 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:02.025871 22610 ts_tablet_manager.cc:902] T 029dba0050a64bd4adb35e9815450450 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Initiating tablet copy from peer 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:59:02.026415 22610 tablet_copy_client.cc:308] T 029dba0050a64bd4adb35e9815450450 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:45571
I20240502 01:59:02.026804 22608 tablet_copy_client.cc:1002] T 1a396235bc534141bcd180430c51e7e1 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Injecting latency into file download: 1500
I20240502 01:59:02.026841 16943 tablet_copy_service.cc:140] P 191fe00ca08b44c9aef6646e86aecebc: Received BeginTabletCopySession request for tablet 029dba0050a64bd4adb35e9815450450 from peer 71c28e01ad304ab2a6adf2eb26ba7cc9 ({username='slave'} at 127.10.133.201:46641)
I20240502 01:59:02.026953 16943 tablet_copy_service.cc:161] P 191fe00ca08b44c9aef6646e86aecebc: Beginning new tablet copy session on tablet 029dba0050a64bd4adb35e9815450450 from peer 71c28e01ad304ab2a6adf2eb26ba7cc9 at {username='slave'} at 127.10.133.201:46641: session id = 71c28e01ad304ab2a6adf2eb26ba7cc9-029dba0050a64bd4adb35e9815450450
I20240502 01:59:02.027640 16943 tablet_copy_source_session.cc:205] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:02.028290 22610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 029dba0050a64bd4adb35e9815450450. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:02.029867 22610 tablet_copy_client.cc:783] T 029dba0050a64bd4adb35e9815450450 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:02.030017 22610 tablet_copy_client.cc:647] T 029dba0050a64bd4adb35e9815450450 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:02.031009 22615 tablet_copy_client.cc:1002] T 029dba0050a64bd4adb35e9815450450 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Injecting latency into file download: 1500
I20240502 01:59:02.098455 22616 ts_tablet_manager.cc:902] T 64b3111c603247ac8ff4a1eb9369086f P b6aa9ef40e50468ca7a9742c21140d24: Initiating tablet copy from peer ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135)
I20240502 01:59:02.098955 22616 tablet_copy_client.cc:308] T 64b3111c603247ac8ff4a1eb9369086f P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.196:38135
I20240502 01:59:02.099393 17346 tablet_copy_service.cc:140] P ec11d4bb3a064a94a80084142637b441: Received BeginTabletCopySession request for tablet 64b3111c603247ac8ff4a1eb9369086f from peer b6aa9ef40e50468ca7a9742c21140d24 ({username='slave'} at 127.10.133.200:54049)
I20240502 01:59:02.099494 17346 tablet_copy_service.cc:161] P ec11d4bb3a064a94a80084142637b441: Beginning new tablet copy session on tablet 64b3111c603247ac8ff4a1eb9369086f from peer b6aa9ef40e50468ca7a9742c21140d24 at {username='slave'} at 127.10.133.200:54049: session id = b6aa9ef40e50468ca7a9742c21140d24-64b3111c603247ac8ff4a1eb9369086f
I20240502 01:59:02.100198 17346 tablet_copy_source_session.cc:205] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:02.101047 22616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64b3111c603247ac8ff4a1eb9369086f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:02.102907 22616 tablet_copy_client.cc:783] T 64b3111c603247ac8ff4a1eb9369086f P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:02.103044 22616 tablet_copy_client.cc:647] T 64b3111c603247ac8ff4a1eb9369086f P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:02.104070 22620 tablet_copy_client.cc:1002] T 64b3111c603247ac8ff4a1eb9369086f P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Injecting latency into file download: 1500
I20240502 01:59:02.181963 22636 ts_tablet_manager.cc:902] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495: Initiating tablet copy from peer 6431e35365644aac943c07c97e370fee (127.10.133.194:37811)
I20240502 01:59:02.182631 22636 tablet_copy_client.cc:308] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37811
I20240502 01:59:02.183159 17079 tablet_copy_service.cc:140] P 6431e35365644aac943c07c97e370fee: Received BeginTabletCopySession request for tablet d9de883c491f43378a26c5a370062555 from peer 436e7859396c42a6b60714873cb60495 ({username='slave'} at 127.10.133.197:58823)
I20240502 01:59:02.183265 17079 tablet_copy_service.cc:161] P 6431e35365644aac943c07c97e370fee: Beginning new tablet copy session on tablet d9de883c491f43378a26c5a370062555 from peer 436e7859396c42a6b60714873cb60495 at {username='slave'} at 127.10.133.197:58823: session id = 436e7859396c42a6b60714873cb60495-d9de883c491f43378a26c5a370062555
I20240502 01:59:02.184084 17079 tablet_copy_source_session.cc:205] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:02.185165 22636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9de883c491f43378a26c5a370062555. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:02.187669 22636 tablet_copy_client.cc:783] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:02.187811 22636 tablet_copy_client.cc:647] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:02.188814 22643 tablet_copy_client.cc:1002] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495: tablet copy: Injecting latency into file download: 1500
I20240502 01:59:03.326522 22472 tablet_copy_client.cc:523] T 7c92206bbd4340d59a7ee7379f581bb7 P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:03.328259 22472 tablet_bootstrap.cc:492] T 7c92206bbd4340d59a7ee7379f581bb7 P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap starting.
I20240502 01:59:03.338706 22477 tablet_copy_client.cc:523] T 8a386a1fd8ae4d70ae482b3ce958825b P 436e7859396c42a6b60714873cb60495: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:03.339926 22477 tablet_bootstrap.cc:492] T 8a386a1fd8ae4d70ae482b3ce958825b P 436e7859396c42a6b60714873cb60495: Bootstrap starting.
I20240502 01:59:03.348665 22472 tablet_bootstrap.cc:492] T 7c92206bbd4340d59a7ee7379f581bb7 P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:03.348973 22472 tablet_bootstrap.cc:492] T 7c92206bbd4340d59a7ee7379f581bb7 P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap complete.
I20240502 01:59:03.349138 22472 ts_tablet_manager.cc:1367] T 7c92206bbd4340d59a7ee7379f581bb7 P b6aa9ef40e50468ca7a9742c21140d24: Time spent bootstrapping tablet: real 0.021s user 0.021s sys 0.000s
I20240502 01:59:03.349697 22472 raft_consensus.cc:348] T 7c92206bbd4340d59a7ee7379f581bb7 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:59:03.349972 22472 raft_consensus.cc:729] T 7c92206bbd4340d59a7ee7379f581bb7 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b6aa9ef40e50468ca7a9742c21140d24, State: Initialized, Role: LEARNER
I20240502 01:59:03.350178 22472 consensus_queue.cc:260] T 7c92206bbd4340d59a7ee7379f581bb7 P b6aa9ef40e50468ca7a9742c21140d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:59:03.350548 22472 ts_tablet_manager.cc:1398] T 7c92206bbd4340d59a7ee7379f581bb7 P b6aa9ef40e50468ca7a9742c21140d24: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:03.351042 17346 tablet_copy_service.cc:342] P ec11d4bb3a064a94a80084142637b441: Request end of tablet copy session b6aa9ef40e50468ca7a9742c21140d24-7c92206bbd4340d59a7ee7379f581bb7 received from {username='slave'} at 127.10.133.200:54049
I20240502 01:59:03.351119 17346 tablet_copy_service.cc:433] P ec11d4bb3a064a94a80084142637b441: ending tablet copy session b6aa9ef40e50468ca7a9742c21140d24-7c92206bbd4340d59a7ee7379f581bb7 on tablet 7c92206bbd4340d59a7ee7379f581bb7 with peer b6aa9ef40e50468ca7a9742c21140d24
I20240502 01:59:03.352131 22488 tablet_copy_client.cc:523] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:03.353698 22488 tablet_bootstrap.cc:492] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap starting.
I20240502 01:59:03.354676 22482 tablet_copy_client.cc:523] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:03.356734 22482 tablet_bootstrap.cc:492] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap starting.
I20240502 01:59:03.364519 22477 tablet_bootstrap.cc:492] T 8a386a1fd8ae4d70ae482b3ce958825b P 436e7859396c42a6b60714873cb60495: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:03.364820 22477 tablet_bootstrap.cc:492] T 8a386a1fd8ae4d70ae482b3ce958825b P 436e7859396c42a6b60714873cb60495: Bootstrap complete.
I20240502 01:59:03.365005 22477 ts_tablet_manager.cc:1367] T 8a386a1fd8ae4d70ae482b3ce958825b P 436e7859396c42a6b60714873cb60495: Time spent bootstrapping tablet: real 0.025s user 0.023s sys 0.000s
I20240502 01:59:03.365433 22477 raft_consensus.cc:348] T 8a386a1fd8ae4d70ae482b3ce958825b P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:59:03.365559 22477 raft_consensus.cc:729] T 8a386a1fd8ae4d70ae482b3ce958825b P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 436e7859396c42a6b60714873cb60495, State: Initialized, Role: LEARNER
I20240502 01:59:03.365707 22477 consensus_queue.cc:260] T 8a386a1fd8ae4d70ae482b3ce958825b P 436e7859396c42a6b60714873cb60495 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:59:03.366267 22482 log.cc:824] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:03.366564 22477 ts_tablet_manager.cc:1398] T 8a386a1fd8ae4d70ae482b3ce958825b P 436e7859396c42a6b60714873cb60495: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:03.367347 17079 tablet_copy_service.cc:342] P 6431e35365644aac943c07c97e370fee: Request end of tablet copy session 436e7859396c42a6b60714873cb60495-8a386a1fd8ae4d70ae482b3ce958825b received from {username='slave'} at 127.10.133.197:58823
I20240502 01:59:03.367422 17079 tablet_copy_service.cc:433] P 6431e35365644aac943c07c97e370fee: ending tablet copy session 436e7859396c42a6b60714873cb60495-8a386a1fd8ae4d70ae482b3ce958825b on tablet 8a386a1fd8ae4d70ae482b3ce958825b with peer 436e7859396c42a6b60714873cb60495
I20240502 01:59:03.378799 22488 tablet_bootstrap.cc:492] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:03.379101 22488 tablet_bootstrap.cc:492] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap complete.
I20240502 01:59:03.379267 22488 ts_tablet_manager.cc:1367] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0: Time spent bootstrapping tablet: real 0.026s user 0.021s sys 0.000s
I20240502 01:59:03.379635 22488 raft_consensus.cc:348] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:59:03.379738 22488 raft_consensus.cc:729] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b7ec79239ce64b38a1d55f66a95407c0, State: Initialized, Role: LEARNER
I20240502 01:59:03.379848 22488 consensus_queue.cc:260] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:59:03.380165 22488 ts_tablet_manager.cc:1398] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 01:59:03.380641 17079 tablet_copy_service.cc:342] P 6431e35365644aac943c07c97e370fee: Request end of tablet copy session b7ec79239ce64b38a1d55f66a95407c0-1a375533a25a4da5b0030b0e06488351 received from {username='slave'} at 127.10.133.199:45123
I20240502 01:59:03.380734 17079 tablet_copy_service.cc:433] P 6431e35365644aac943c07c97e370fee: ending tablet copy session b7ec79239ce64b38a1d55f66a95407c0-1a375533a25a4da5b0030b0e06488351 on tablet 1a375533a25a4da5b0030b0e06488351 with peer b7ec79239ce64b38a1d55f66a95407c0
I20240502 01:59:03.396410 22482 tablet_bootstrap.cc:492] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:03.396804 22482 tablet_bootstrap.cc:492] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap complete.
I20240502 01:59:03.397148 22482 ts_tablet_manager.cc:1367] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Time spent bootstrapping tablet: real 0.041s user 0.033s sys 0.000s
I20240502 01:59:03.399361 22482 raft_consensus.cc:348] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:03.399618 22482 raft_consensus.cc:729] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71c28e01ad304ab2a6adf2eb26ba7cc9, State: Initialized, Role: LEARNER
I20240502 01:59:03.399942 22482 consensus_queue.cc:260] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:03.400727 22482 ts_tablet_manager.cc:1398] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Time spent starting tablet: real 0.004s user 0.006s sys 0.000s
I20240502 01:59:03.401298 16943 tablet_copy_service.cc:342] P 191fe00ca08b44c9aef6646e86aecebc: Request end of tablet copy session 71c28e01ad304ab2a6adf2eb26ba7cc9-df21aa40548c4f49bae79294085c80f4 received from {username='slave'} at 127.10.133.201:46641
I20240502 01:59:03.401371 16943 tablet_copy_service.cc:433] P 191fe00ca08b44c9aef6646e86aecebc: ending tablet copy session 71c28e01ad304ab2a6adf2eb26ba7cc9-df21aa40548c4f49bae79294085c80f4 on tablet df21aa40548c4f49bae79294085c80f4 with peer 71c28e01ad304ab2a6adf2eb26ba7cc9
I20240502 01:59:03.425310 22532 tablet_copy_client.cc:523] T 787b9b0227da4dd08df5aeb37f0d0468 P 436e7859396c42a6b60714873cb60495: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:03.426764 22532 tablet_bootstrap.cc:492] T 787b9b0227da4dd08df5aeb37f0d0468 P 436e7859396c42a6b60714873cb60495: Bootstrap starting.
I20240502 01:59:03.439792 22544 tablet_copy_client.cc:523] T 086b486997ae4d15a4b070e79552807f P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:03.440966 22544 tablet_bootstrap.cc:492] T 086b486997ae4d15a4b070e79552807f P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap starting.
I20240502 01:59:03.445904 22532 tablet_bootstrap.cc:492] T 787b9b0227da4dd08df5aeb37f0d0468 P 436e7859396c42a6b60714873cb60495: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:03.446179 22532 tablet_bootstrap.cc:492] T 787b9b0227da4dd08df5aeb37f0d0468 P 436e7859396c42a6b60714873cb60495: Bootstrap complete.
I20240502 01:59:03.446331 22532 ts_tablet_manager.cc:1367] T 787b9b0227da4dd08df5aeb37f0d0468 P 436e7859396c42a6b60714873cb60495: Time spent bootstrapping tablet: real 0.020s user 0.015s sys 0.005s
I20240502 01:59:03.446717 22532 raft_consensus.cc:348] T 787b9b0227da4dd08df5aeb37f0d0468 P 436e7859396c42a6b60714873cb60495 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:59:03.446825 22532 raft_consensus.cc:729] T 787b9b0227da4dd08df5aeb37f0d0468 P 436e7859396c42a6b60714873cb60495 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 436e7859396c42a6b60714873cb60495, State: Initialized, Role: LEARNER
I20240502 01:59:03.446920 22532 consensus_queue.cc:260] T 787b9b0227da4dd08df5aeb37f0d0468 P 436e7859396c42a6b60714873cb60495 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 2.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:59:03.447666 22532 ts_tablet_manager.cc:1398] T 787b9b0227da4dd08df5aeb37f0d0468 P 436e7859396c42a6b60714873cb60495: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:03.448136 17214 tablet_copy_service.cc:342] P a1c00c21761540dea7ddae8d0dd26df4: Request end of tablet copy session 436e7859396c42a6b60714873cb60495-787b9b0227da4dd08df5aeb37f0d0468 received from {username='slave'} at 127.10.133.197:53483
I20240502 01:59:03.448220 17214 tablet_copy_service.cc:433] P a1c00c21761540dea7ddae8d0dd26df4: ending tablet copy session 436e7859396c42a6b60714873cb60495-787b9b0227da4dd08df5aeb37f0d0468 on tablet 787b9b0227da4dd08df5aeb37f0d0468 with peer 436e7859396c42a6b60714873cb60495
I20240502 01:59:03.459719 22569 tablet_copy_client.cc:523] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:03.460856 22569 tablet_bootstrap.cc:492] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495: Bootstrap starting.
I20240502 01:59:03.461449 22544 tablet_bootstrap.cc:492] T 086b486997ae4d15a4b070e79552807f P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:03.461711 22544 tablet_bootstrap.cc:492] T 086b486997ae4d15a4b070e79552807f P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap complete.
I20240502 01:59:03.461896 22544 ts_tablet_manager.cc:1367] T 086b486997ae4d15a4b070e79552807f P 71c28e01ad304ab2a6adf2eb26ba7cc9: Time spent bootstrapping tablet: real 0.021s user 0.018s sys 0.004s
I20240502 01:59:03.462443 22544 raft_consensus.cc:348] T 086b486997ae4d15a4b070e79552807f P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:03.462545 22544 raft_consensus.cc:729] T 086b486997ae4d15a4b070e79552807f P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 71c28e01ad304ab2a6adf2eb26ba7cc9, State: Initialized, Role: LEARNER
I20240502 01:59:03.462658 22544 consensus_queue.cc:260] T 086b486997ae4d15a4b070e79552807f P 71c28e01ad304ab2a6adf2eb26ba7cc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 2.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:03.463243 22544 ts_tablet_manager.cc:1398] T 086b486997ae4d15a4b070e79552807f P 71c28e01ad304ab2a6adf2eb26ba7cc9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:03.463745 17214 tablet_copy_service.cc:342] P a1c00c21761540dea7ddae8d0dd26df4: Request end of tablet copy session 71c28e01ad304ab2a6adf2eb26ba7cc9-086b486997ae4d15a4b070e79552807f received from {username='slave'} at 127.10.133.201:58657
I20240502 01:59:03.463852 17214 tablet_copy_service.cc:433] P a1c00c21761540dea7ddae8d0dd26df4: ending tablet copy session 71c28e01ad304ab2a6adf2eb26ba7cc9-086b486997ae4d15a4b070e79552807f on tablet 086b486997ae4d15a4b070e79552807f with peer 71c28e01ad304ab2a6adf2eb26ba7cc9
I20240502 01:59:03.470046 18650 raft_consensus.cc:1203] T 787b9b0227da4dd08df5aeb37f0d0468 P 436e7859396c42a6b60714873cb60495 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.7->[2.8-2.8] Dedup: 2.8->[]
I20240502 01:59:03.476141 22584 tablet_copy_client.cc:523] T f7d9d4310df14878a5ae4167c5320e3a P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:03.477561 22584 tablet_bootstrap.cc:492] T f7d9d4310df14878a5ae4167c5320e3a P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap starting.
I20240502 01:59:03.480860 22569 tablet_bootstrap.cc:492] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:03.481110 22569 tablet_bootstrap.cc:492] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495: Bootstrap complete.
I20240502 01:59:03.481282 22569 ts_tablet_manager.cc:1367] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495: Time spent bootstrapping tablet: real 0.020s user 0.015s sys 0.002s
I20240502 01:59:03.481711 22569 raft_consensus.cc:348] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:59:03.481833 22569 raft_consensus.cc:729] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 436e7859396c42a6b60714873cb60495, State: Initialized, Role: LEARNER
I20240502 01:59:03.481962 22569 consensus_queue.cc:260] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:59:03.482348 22569 ts_tablet_manager.cc:1398] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 01:59:03.482900 16943 tablet_copy_service.cc:342] P 191fe00ca08b44c9aef6646e86aecebc: Request end of tablet copy session 436e7859396c42a6b60714873cb60495-2162035e4ed4433fafcc49934be62a9c received from {username='slave'} at 127.10.133.197:36399
I20240502 01:59:03.482986 16943 tablet_copy_service.cc:433] P 191fe00ca08b44c9aef6646e86aecebc: ending tablet copy session 436e7859396c42a6b60714873cb60495-2162035e4ed4433fafcc49934be62a9c on tablet 2162035e4ed4433fafcc49934be62a9c with peer 436e7859396c42a6b60714873cb60495
I20240502 01:59:03.487071 22589 tablet_copy_client.cc:523] T a475490b83164ff3930aae5978e7845e P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:03.488408 22589 tablet_bootstrap.cc:492] T a475490b83164ff3930aae5978e7845e P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap starting.
I20240502 01:59:03.500922 22584 tablet_bootstrap.cc:492] T f7d9d4310df14878a5ae4167c5320e3a P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:03.501227 22584 tablet_bootstrap.cc:492] T f7d9d4310df14878a5ae4167c5320e3a P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap complete.
I20240502 01:59:03.501389 22584 ts_tablet_manager.cc:1367] T f7d9d4310df14878a5ae4167c5320e3a P b6aa9ef40e50468ca7a9742c21140d24: Time spent bootstrapping tablet: real 0.024s user 0.017s sys 0.005s
I20240502 01:59:03.501821 22584 raft_consensus.cc:348] T f7d9d4310df14878a5ae4167c5320e3a P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:59:03.501960 22584 raft_consensus.cc:729] T f7d9d4310df14878a5ae4167c5320e3a P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b6aa9ef40e50468ca7a9742c21140d24, State: Initialized, Role: LEARNER
I20240502 01:59:03.502081 22584 consensus_queue.cc:260] T f7d9d4310df14878a5ae4167c5320e3a P b6aa9ef40e50468ca7a9742c21140d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:59:03.502364 22584 ts_tablet_manager.cc:1398] T f7d9d4310df14878a5ae4167c5320e3a P b6aa9ef40e50468ca7a9742c21140d24: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 01:59:03.503191 17079 tablet_copy_service.cc:342] P 6431e35365644aac943c07c97e370fee: Request end of tablet copy session b6aa9ef40e50468ca7a9742c21140d24-f7d9d4310df14878a5ae4167c5320e3a received from {username='slave'} at 127.10.133.200:46059
I20240502 01:59:03.503278 17079 tablet_copy_service.cc:433] P 6431e35365644aac943c07c97e370fee: ending tablet copy session b6aa9ef40e50468ca7a9742c21140d24-f7d9d4310df14878a5ae4167c5320e3a on tablet f7d9d4310df14878a5ae4167c5320e3a with peer b6aa9ef40e50468ca7a9742c21140d24
I20240502 01:59:03.511799 22589 tablet_bootstrap.cc:492] T a475490b83164ff3930aae5978e7845e P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:03.512079 22589 tablet_bootstrap.cc:492] T a475490b83164ff3930aae5978e7845e P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap complete.
I20240502 01:59:03.512223 22589 ts_tablet_manager.cc:1367] T a475490b83164ff3930aae5978e7845e P 71c28e01ad304ab2a6adf2eb26ba7cc9: Time spent bootstrapping tablet: real 0.024s user 0.023s sys 0.000s
I20240502 01:59:03.512544 22589 raft_consensus.cc:348] T a475490b83164ff3930aae5978e7845e P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:03.512657 22589 raft_consensus.cc:729] T a475490b83164ff3930aae5978e7845e P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71c28e01ad304ab2a6adf2eb26ba7cc9, State: Initialized, Role: LEARNER
I20240502 01:59:03.512730 22589 consensus_queue.cc:260] T a475490b83164ff3930aae5978e7845e P 71c28e01ad304ab2a6adf2eb26ba7cc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:03.512974 22589 ts_tablet_manager.cc:1398] T a475490b83164ff3930aae5978e7845e P 71c28e01ad304ab2a6adf2eb26ba7cc9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:03.513540 17214 tablet_copy_service.cc:342] P a1c00c21761540dea7ddae8d0dd26df4: Request end of tablet copy session 71c28e01ad304ab2a6adf2eb26ba7cc9-a475490b83164ff3930aae5978e7845e received from {username='slave'} at 127.10.133.201:58657
I20240502 01:59:03.513654 17214 tablet_copy_service.cc:433] P a1c00c21761540dea7ddae8d0dd26df4: ending tablet copy session 71c28e01ad304ab2a6adf2eb26ba7cc9-a475490b83164ff3930aae5978e7845e on tablet a475490b83164ff3930aae5978e7845e with peer 71c28e01ad304ab2a6adf2eb26ba7cc9
I20240502 01:59:03.517684 22594 tablet_copy_client.cc:523] T 47f0db0b9b7744758b9ca7f1e797bdb0 P b7ec79239ce64b38a1d55f66a95407c0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:03.518437 22600 tablet_copy_client.cc:523] T e03fff9bc743475d92ae26b85e7f39ff P d7989bd96de94be4a94995fcfcd6b16b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:03.519047 22594 tablet_bootstrap.cc:492] T 47f0db0b9b7744758b9ca7f1e797bdb0 P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap starting.
I20240502 01:59:03.519692 22600 tablet_bootstrap.cc:492] T e03fff9bc743475d92ae26b85e7f39ff P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap starting.
I20240502 01:59:03.527073 22605 tablet_copy_client.cc:523] T 1a396235bc534141bcd180430c51e7e1 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:03.528457 22605 tablet_bootstrap.cc:492] T 1a396235bc534141bcd180430c51e7e1 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap starting.
I20240502 01:59:03.531255 22610 tablet_copy_client.cc:523] T 029dba0050a64bd4adb35e9815450450 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:03.532583 22610 tablet_bootstrap.cc:492] T 029dba0050a64bd4adb35e9815450450 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap starting.
I20240502 01:59:03.540942 22600 tablet_bootstrap.cc:492] T e03fff9bc743475d92ae26b85e7f39ff P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:03.541188 22600 tablet_bootstrap.cc:492] T e03fff9bc743475d92ae26b85e7f39ff P d7989bd96de94be4a94995fcfcd6b16b: Bootstrap complete.
I20240502 01:59:03.541322 22600 ts_tablet_manager.cc:1367] T e03fff9bc743475d92ae26b85e7f39ff P d7989bd96de94be4a94995fcfcd6b16b: Time spent bootstrapping tablet: real 0.022s user 0.019s sys 0.000s
I20240502 01:59:03.541775 22600 raft_consensus.cc:348] T e03fff9bc743475d92ae26b85e7f39ff P d7989bd96de94be4a94995fcfcd6b16b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:59:03.541911 22600 raft_consensus.cc:729] T e03fff9bc743475d92ae26b85e7f39ff P d7989bd96de94be4a94995fcfcd6b16b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: d7989bd96de94be4a94995fcfcd6b16b, State: Initialized, Role: LEARNER
I20240502 01:59:03.542037 22600 consensus_queue.cc:260] T e03fff9bc743475d92ae26b85e7f39ff P d7989bd96de94be4a94995fcfcd6b16b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 2.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: NON_VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: true } }
I20240502 01:59:03.542412 22600 ts_tablet_manager.cc:1398] T e03fff9bc743475d92ae26b85e7f39ff P d7989bd96de94be4a94995fcfcd6b16b: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 01:59:03.543664 17346 tablet_copy_service.cc:342] P ec11d4bb3a064a94a80084142637b441: Request end of tablet copy session d7989bd96de94be4a94995fcfcd6b16b-e03fff9bc743475d92ae26b85e7f39ff received from {username='slave'} at 127.10.133.198:57185
I20240502 01:59:03.543749 17346 tablet_copy_service.cc:433] P ec11d4bb3a064a94a80084142637b441: ending tablet copy session d7989bd96de94be4a94995fcfcd6b16b-e03fff9bc743475d92ae26b85e7f39ff on tablet e03fff9bc743475d92ae26b85e7f39ff with peer d7989bd96de94be4a94995fcfcd6b16b
I20240502 01:59:03.546237 22594 tablet_bootstrap.cc:492] T 47f0db0b9b7744758b9ca7f1e797bdb0 P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:03.546567 22594 tablet_bootstrap.cc:492] T 47f0db0b9b7744758b9ca7f1e797bdb0 P b7ec79239ce64b38a1d55f66a95407c0: Bootstrap complete.
I20240502 01:59:03.546737 22594 ts_tablet_manager.cc:1367] T 47f0db0b9b7744758b9ca7f1e797bdb0 P b7ec79239ce64b38a1d55f66a95407c0: Time spent bootstrapping tablet: real 0.028s user 0.028s sys 0.000s
I20240502 01:59:03.547142 22594 raft_consensus.cc:348] T 47f0db0b9b7744758b9ca7f1e797bdb0 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:59:03.547271 22594 raft_consensus.cc:729] T 47f0db0b9b7744758b9ca7f1e797bdb0 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b7ec79239ce64b38a1d55f66a95407c0, State: Initialized, Role: LEARNER
I20240502 01:59:03.547372 22594 consensus_queue.cc:260] T 47f0db0b9b7744758b9ca7f1e797bdb0 P b7ec79239ce64b38a1d55f66a95407c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: NON_VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: true } }
I20240502 01:59:03.548143 22594 ts_tablet_manager.cc:1398] T 47f0db0b9b7744758b9ca7f1e797bdb0 P b7ec79239ce64b38a1d55f66a95407c0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:03.548552 17214 tablet_copy_service.cc:342] P a1c00c21761540dea7ddae8d0dd26df4: Request end of tablet copy session b7ec79239ce64b38a1d55f66a95407c0-47f0db0b9b7744758b9ca7f1e797bdb0 received from {username='slave'} at 127.10.133.199:40327
I20240502 01:59:03.548633 17214 tablet_copy_service.cc:433] P a1c00c21761540dea7ddae8d0dd26df4: ending tablet copy session b7ec79239ce64b38a1d55f66a95407c0-47f0db0b9b7744758b9ca7f1e797bdb0 on tablet 47f0db0b9b7744758b9ca7f1e797bdb0 with peer b7ec79239ce64b38a1d55f66a95407c0
I20240502 01:59:03.556164 22605 tablet_bootstrap.cc:492] T 1a396235bc534141bcd180430c51e7e1 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:03.556447 22605 tablet_bootstrap.cc:492] T 1a396235bc534141bcd180430c51e7e1 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap complete.
I20240502 01:59:03.556630 22605 ts_tablet_manager.cc:1367] T 1a396235bc534141bcd180430c51e7e1 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Time spent bootstrapping tablet: real 0.028s user 0.023s sys 0.000s
I20240502 01:59:03.557039 22605 raft_consensus.cc:348] T 1a396235bc534141bcd180430c51e7e1 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:03.557152 22605 raft_consensus.cc:729] T 1a396235bc534141bcd180430c51e7e1 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71c28e01ad304ab2a6adf2eb26ba7cc9, State: Initialized, Role: LEARNER
I20240502 01:59:03.557245 22605 consensus_queue.cc:260] T 1a396235bc534141bcd180430c51e7e1 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:03.557225 19971 raft_consensus.cc:1203] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 01:59:03.557509 22605 ts_tablet_manager.cc:1398] T 1a396235bc534141bcd180430c51e7e1 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:03.558130 17079 tablet_copy_service.cc:342] P 6431e35365644aac943c07c97e370fee: Request end of tablet copy session 71c28e01ad304ab2a6adf2eb26ba7cc9-1a396235bc534141bcd180430c51e7e1 received from {username='slave'} at 127.10.133.201:33809
I20240502 01:59:03.558205 17079 tablet_copy_service.cc:433] P 6431e35365644aac943c07c97e370fee: ending tablet copy session 71c28e01ad304ab2a6adf2eb26ba7cc9-1a396235bc534141bcd180430c51e7e1 on tablet 1a396235bc534141bcd180430c51e7e1 with peer 71c28e01ad304ab2a6adf2eb26ba7cc9
I20240502 01:59:03.565297 22610 tablet_bootstrap.cc:492] T 029dba0050a64bd4adb35e9815450450 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:03.565533 22610 tablet_bootstrap.cc:492] T 029dba0050a64bd4adb35e9815450450 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap complete.
I20240502 01:59:03.565662 22610 ts_tablet_manager.cc:1367] T 029dba0050a64bd4adb35e9815450450 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Time spent bootstrapping tablet: real 0.033s user 0.019s sys 0.001s
I20240502 01:59:03.565953 22610 raft_consensus.cc:348] T 029dba0050a64bd4adb35e9815450450 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:03.566108 22610 raft_consensus.cc:729] T 029dba0050a64bd4adb35e9815450450 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71c28e01ad304ab2a6adf2eb26ba7cc9, State: Initialized, Role: LEARNER
I20240502 01:59:03.566183 22610 consensus_queue.cc:260] T 029dba0050a64bd4adb35e9815450450 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:03.566406 22610 ts_tablet_manager.cc:1398] T 029dba0050a64bd4adb35e9815450450 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 01:59:03.566860 16943 tablet_copy_service.cc:342] P 191fe00ca08b44c9aef6646e86aecebc: Request end of tablet copy session 71c28e01ad304ab2a6adf2eb26ba7cc9-029dba0050a64bd4adb35e9815450450 received from {username='slave'} at 127.10.133.201:46641
I20240502 01:59:03.566946 16943 tablet_copy_service.cc:433] P 191fe00ca08b44c9aef6646e86aecebc: ending tablet copy session 71c28e01ad304ab2a6adf2eb26ba7cc9-029dba0050a64bd4adb35e9815450450 on tablet 029dba0050a64bd4adb35e9815450450 with peer 71c28e01ad304ab2a6adf2eb26ba7cc9
I20240502 01:59:03.604404 22616 tablet_copy_client.cc:523] T 64b3111c603247ac8ff4a1eb9369086f P b6aa9ef40e50468ca7a9742c21140d24: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:03.606094 22616 tablet_bootstrap.cc:492] T 64b3111c603247ac8ff4a1eb9369086f P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap starting.
I20240502 01:59:03.612587 19050 raft_consensus.cc:1203] T f7d9d4310df14878a5ae4167c5320e3a P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 01:59:03.629597 22616 tablet_bootstrap.cc:492] T 64b3111c603247ac8ff4a1eb9369086f P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:03.629884 22616 tablet_bootstrap.cc:492] T 64b3111c603247ac8ff4a1eb9369086f P b6aa9ef40e50468ca7a9742c21140d24: Bootstrap complete.
I20240502 01:59:03.630074 22616 ts_tablet_manager.cc:1367] T 64b3111c603247ac8ff4a1eb9369086f P b6aa9ef40e50468ca7a9742c21140d24: Time spent bootstrapping tablet: real 0.024s user 0.015s sys 0.008s
I20240502 01:59:03.630436 22616 raft_consensus.cc:348] T 64b3111c603247ac8ff4a1eb9369086f P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:59:03.630546 22616 raft_consensus.cc:729] T 64b3111c603247ac8ff4a1eb9369086f P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: b6aa9ef40e50468ca7a9742c21140d24, State: Initialized, Role: LEARNER
I20240502 01:59:03.630649 22616 consensus_queue.cc:260] T 64b3111c603247ac8ff4a1eb9369086f P b6aa9ef40e50468ca7a9742c21140d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: true } }
I20240502 01:59:03.630934 22616 ts_tablet_manager.cc:1398] T 64b3111c603247ac8ff4a1eb9369086f P b6aa9ef40e50468ca7a9742c21140d24: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:03.631980 17346 tablet_copy_service.cc:342] P ec11d4bb3a064a94a80084142637b441: Request end of tablet copy session b6aa9ef40e50468ca7a9742c21140d24-64b3111c603247ac8ff4a1eb9369086f received from {username='slave'} at 127.10.133.200:54049
I20240502 01:59:03.632071 17346 tablet_copy_service.cc:433] P ec11d4bb3a064a94a80084142637b441: ending tablet copy session b6aa9ef40e50468ca7a9742c21140d24-64b3111c603247ac8ff4a1eb9369086f on tablet 64b3111c603247ac8ff4a1eb9369086f with peer b6aa9ef40e50468ca7a9742c21140d24
I20240502 01:59:03.636346 19971 raft_consensus.cc:1203] T a475490b83164ff3930aae5978e7845e P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 01:59:03.673890 18650 raft_consensus.cc:1203] T 8a386a1fd8ae4d70ae482b3ce958825b P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 01:59:03.676290 19050 raft_consensus.cc:1203] T 7c92206bbd4340d59a7ee7379f581bb7 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 01:59:03.682353 18918 raft_consensus.cc:1203] T 47f0db0b9b7744758b9ca7f1e797bdb0 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 01:59:03.689111 22636 tablet_copy_client.cc:523] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:03.690521 22636 tablet_bootstrap.cc:492] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495: Bootstrap starting.
I20240502 01:59:03.709298 22636 tablet_bootstrap.cc:492] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:03.709556 22636 tablet_bootstrap.cc:492] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495: Bootstrap complete.
I20240502 01:59:03.709724 22636 ts_tablet_manager.cc:1367] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.006s
I20240502 01:59:03.710217 22636 raft_consensus.cc:348] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:59:03.710330 22636 raft_consensus.cc:729] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 436e7859396c42a6b60714873cb60495, State: Initialized, Role: LEARNER
I20240502 01:59:03.710431 22636 consensus_queue.cc:260] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } }
I20240502 01:59:03.710495 19971 raft_consensus.cc:1203] T 086b486997ae4d15a4b070e79552807f P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.7->[2.8-2.8] Dedup: 2.8->[]
I20240502 01:59:03.710696 22636 ts_tablet_manager.cc:1398] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 01:59:03.711517 17079 tablet_copy_service.cc:342] P 6431e35365644aac943c07c97e370fee: Request end of tablet copy session 436e7859396c42a6b60714873cb60495-d9de883c491f43378a26c5a370062555 received from {username='slave'} at 127.10.133.197:58823
I20240502 01:59:03.711611 17079 tablet_copy_service.cc:433] P 6431e35365644aac943c07c97e370fee: ending tablet copy session 436e7859396c42a6b60714873cb60495-d9de883c491f43378a26c5a370062555 on tablet d9de883c491f43378a26c5a370062555 with peer 436e7859396c42a6b60714873cb60495
I20240502 01:59:03.758747 18650 raft_consensus.cc:1203] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 01:59:03.776185 18918 raft_consensus.cc:1203] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 01:59:03.916252 18784 raft_consensus.cc:1203] T e03fff9bc743475d92ae26b85e7f39ff P d7989bd96de94be4a94995fcfcd6b16b [term 2 LEARNER]: Deduplicated request from leader. Original: 2.7->[2.8-2.8] Dedup: 2.8->[]
I20240502 01:59:03.970019 18650 raft_consensus.cc:1203] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 01:59:03.982394 19971 raft_consensus.cc:1203] T 1a396235bc534141bcd180430c51e7e1 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 01:59:04.003140 23190 raft_consensus.cc:1050] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4: attempting to promote NON_VOTER 436e7859396c42a6b60714873cb60495 to VOTER
I20240502 01:59:04.003538 23190 consensus_queue.cc:237] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 2.8, Last appended by leader: 5, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:59:04.005030 18650 raft_consensus.cc:1261] T 787b9b0227da4dd08df5aeb37f0d0468 P 436e7859396c42a6b60714873cb60495 [term 2 LEARNER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:04.005259 19050 raft_consensus.cc:1261] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:04.005506 16923 raft_consensus.cc:1261] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:04.005479 23190 consensus_queue.cc:1035] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.005681 23189 consensus_queue.cc:1035] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.005975 22703 consensus_queue.cc:1035] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.008138 22703 raft_consensus.cc:2932] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [term 2 LEADER]: Committing config change with OpId 2.9: config changed from index 8 to 9, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.010219 19050 raft_consensus.cc:2932] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 8 to 9, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.010650 16923 raft_consensus.cc:2932] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 8 to 9, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.011140 16774 catalog_manager.cc:5484] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 8 to 9, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:04.016800 18650 raft_consensus.cc:2932] T 787b9b0227da4dd08df5aeb37f0d0468 P 436e7859396c42a6b60714873cb60495 [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 8 to 9, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.017573 19050 raft_consensus.cc:1203] T 64b3111c603247ac8ff4a1eb9369086f P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 01:59:04.020977 17192 consensus_queue.cc:237] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:59:04.022118 19050 raft_consensus.cc:1261] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 01:59:04.022118 18650 raft_consensus.cc:1261] T 787b9b0227da4dd08df5aeb37f0d0468 P 436e7859396c42a6b60714873cb60495 [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 01:59:04.022490 23195 consensus_queue.cc:1035] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:04.022679 23190 consensus_queue.cc:1035] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:04.024271 22703 raft_consensus.cc:2932] T 787b9b0227da4dd08df5aeb37f0d0468 P a1c00c21761540dea7ddae8d0dd26df4 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.024739 19050 raft_consensus.cc:2932] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.026479 16765 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 787b9b0227da4dd08df5aeb37f0d0468 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:04.026538 18650 raft_consensus.cc:2932] T 787b9b0227da4dd08df5aeb37f0d0468 P 436e7859396c42a6b60714873cb60495 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.027354 16772 catalog_manager.cc:5484] T 787b9b0227da4dd08df5aeb37f0d0468 P b6aa9ef40e50468ca7a9742c21140d24 reported cstate change: config changed from index 9 to 10, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New cstate: current_term: 2 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.030591 16901 tablet_service.cc:1514] Processing DeleteTablet for tablet 787b9b0227da4dd08df5aeb37f0d0468 with delete_type TABLET_DATA_TOMBSTONED (TS 191fe00ca08b44c9aef6646e86aecebc not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:40018
I20240502 01:59:04.030982 23200 tablet_replica.cc:330] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc: stopping tablet replica
I20240502 01:59:04.031111 23200 raft_consensus.cc:2229] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:04.031307 23200 raft_consensus.cc:2258] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:04.031963 23200 ts_tablet_manager.cc:1875] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:04.033914 23200 ts_tablet_manager.cc:1888] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20240502 01:59:04.034014 23200 log.cc:1196] T 787b9b0227da4dd08df5aeb37f0d0468 P 191fe00ca08b44c9aef6646e86aecebc: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/787b9b0227da4dd08df5aeb37f0d0468
I20240502 01:59:04.034500 16764 catalog_manager.cc:4830] TS 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571): tablet 787b9b0227da4dd08df5aeb37f0d0468 (table rebalance_test_table_3 [id=0c4182cf7d98406d87a12a073ef6b915]) successfully deleted
I20240502 01:59:04.036309 23202 raft_consensus.cc:1050] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee: attempting to promote NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 to VOTER
I20240502 01:59:04.036793 23202 consensus_queue.cc:237] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:59:04.038206 18918 raft_consensus.cc:1261] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.038229 16923 raft_consensus.cc:1261] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.038581 19050 raft_consensus.cc:1261] T f7d9d4310df14878a5ae4167c5320e3a P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.038633 23201 consensus_queue.cc:1035] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.038908 23202 consensus_queue.cc:1035] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.039052 23201 consensus_queue.cc:1035] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.040942 23201 raft_consensus.cc:2932] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.041393 18918 raft_consensus.cc:2932] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.041471 19050 raft_consensus.cc:2932] T f7d9d4310df14878a5ae4167c5320e3a P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.042796 16923 raft_consensus.cc:2932] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.043485 16774 catalog_manager.cc:5484] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 7 to 8, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:04.046412 17059 consensus_queue.cc:237] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:59:04.047623 18918 raft_consensus.cc:1261] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:04.047675 19050 raft_consensus.cc:1261] T f7d9d4310df14878a5ae4167c5320e3a P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:04.047993 23202 consensus_queue.cc:1035] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.048172 23204 consensus_queue.cc:1035] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.049640 22708 raft_consensus.cc:2932] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.050089 18918 raft_consensus.cc:2932] T f7d9d4310df14878a5ae4167c5320e3a P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.050163 19050 raft_consensus.cc:2932] T f7d9d4310df14878a5ae4167c5320e3a P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.050969 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet f7d9d4310df14878a5ae4167c5320e3a with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:04.052039 16772 catalog_manager.cc:5484] T f7d9d4310df14878a5ae4167c5320e3a P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 8 to 9, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:04.054528 16901 tablet_service.cc:1514] Processing DeleteTablet for tablet f7d9d4310df14878a5ae4167c5320e3a with delete_type TABLET_DATA_TOMBSTONED (TS 191fe00ca08b44c9aef6646e86aecebc not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:40018
I20240502 01:59:04.054777 23200 tablet_replica.cc:330] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc: stopping tablet replica
I20240502 01:59:04.054924 23200 raft_consensus.cc:2229] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:04.055121 23200 raft_consensus.cc:2258] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:04.055999 23200 ts_tablet_manager.cc:1875] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:04.056470 23189 raft_consensus.cc:1050] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4: attempting to promote NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 to VOTER
I20240502 01:59:04.056880 23189 consensus_queue.cc:237] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:04.058379 18650 raft_consensus.cc:1261] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.058529 19971 raft_consensus.cc:1261] T a475490b83164ff3930aae5978e7845e P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.058785 22703 consensus_queue.cc:1035] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.059034 17325 raft_consensus.cc:1261] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.059370 22703 consensus_queue.cc:1035] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.059646 23200 ts_tablet_manager.cc:1888] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 01:59:04.059736 23200 log.cc:1196] T f7d9d4310df14878a5ae4167c5320e3a P 191fe00ca08b44c9aef6646e86aecebc: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/f7d9d4310df14878a5ae4167c5320e3a
I20240502 01:59:04.059520 23195 consensus_queue.cc:1035] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.060611 16764 catalog_manager.cc:4830] TS 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571): tablet f7d9d4310df14878a5ae4167c5320e3a (table rebalance_test_table_0 [id=61315444265f4e1e9a2b3fed3a82c4a5]) successfully deleted
I20240502 01:59:04.061779 22703 raft_consensus.cc:2932] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.062142 17325 raft_consensus.cc:2932] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.063978 18650 raft_consensus.cc:2932] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.065008 16773 catalog_manager.cc:5484] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:04.065608 19970 raft_consensus.cc:2932] T a475490b83164ff3930aae5978e7845e P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.069386 23152 raft_consensus.cc:1050] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc: attempting to promote NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 to VOTER
I20240502 01:59:04.069766 23152 consensus_queue.cc:237] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:04.070446 17192 consensus_queue.cc:237] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:04.071152 19971 raft_consensus.cc:1261] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.071233 18784 raft_consensus.cc:1261] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.071554 23213 consensus_queue.cc:1035] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.071820 18650 raft_consensus.cc:1261] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:04.071838 23214 consensus_queue.cc:1035] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.072243 17059 raft_consensus.cc:1261] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.072432 19971 raft_consensus.cc:1261] T a475490b83164ff3930aae5978e7845e P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:04.072533 23190 consensus_queue.cc:1035] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.072681 23213 consensus_queue.cc:1035] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.073207 23190 consensus_queue.cc:1035] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.074479 23195 raft_consensus.cc:2932] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.075065 23214 raft_consensus.cc:2932] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.075170 18784 raft_consensus.cc:2932] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.076375 18650 raft_consensus.cc:2932] T a475490b83164ff3930aae5978e7845e P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.077088 16765 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet a475490b83164ff3930aae5978e7845e with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:04.077371 19970 raft_consensus.cc:2932] T a475490b83164ff3930aae5978e7845e P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.077605 16772 catalog_manager.cc:5484] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b reported cstate change: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.078083 16773 catalog_manager.cc:5484] T a475490b83164ff3930aae5978e7845e P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 8 to 9, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:04.078907 19971 raft_consensus.cc:2932] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.081084 17059 raft_consensus.cc:2932] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.082628 16923 consensus_queue.cc:237] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:04.083909 19971 raft_consensus.cc:1261] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:04.084312 23152 consensus_queue.cc:1035] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.085057 17304 tablet_service.cc:1514] Processing DeleteTablet for tablet a475490b83164ff3930aae5978e7845e with delete_type TABLET_DATA_TOMBSTONED (TS ec11d4bb3a064a94a80084142637b441 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:58608
I20240502 01:59:04.085443 23219 tablet_replica.cc:330] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441: stopping tablet replica
I20240502 01:59:04.085719 23219 raft_consensus.cc:2229] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:04.086030 23219 raft_consensus.cc:2258] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:04.086223 18784 raft_consensus.cc:1261] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:04.086583 23152 consensus_queue.cc:1035] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.087424 23219 ts_tablet_manager.cc:1875] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:04.087597 23213 raft_consensus.cc:2932] T df21aa40548c4f49bae79294085c80f4 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.087895 19971 raft_consensus.cc:2932] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.089217 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet df21aa40548c4f49bae79294085c80f4 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:04.089922 16776 catalog_manager.cc:5484] T df21aa40548c4f49bae79294085c80f4 P 71c28e01ad304ab2a6adf2eb26ba7cc9 reported cstate change: config changed from index 8 to 9, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.090564 18784 raft_consensus.cc:2932] T df21aa40548c4f49bae79294085c80f4 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.090847 23219 ts_tablet_manager.cc:1888] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 01:59:04.091163 23219 log.cc:1196] T a475490b83164ff3930aae5978e7845e P ec11d4bb3a064a94a80084142637b441: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/a475490b83164ff3930aae5978e7845e
I20240502 01:59:04.092180 17039 tablet_service.cc:1514] Processing DeleteTablet for tablet df21aa40548c4f49bae79294085c80f4 with delete_type TABLET_DATA_TOMBSTONED (TS 6431e35365644aac943c07c97e370fee not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:58394
I20240502 01:59:04.092778 23220 tablet_replica.cc:330] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee: stopping tablet replica
I20240502 01:59:04.092847 16764 catalog_manager.cc:4830] TS ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135): tablet a475490b83164ff3930aae5978e7845e (table rebalance_test_table_4 [id=ed83c8027ba34b24b41cae8d5a7a294c]) successfully deleted
I20240502 01:59:04.093008 23220 raft_consensus.cc:2229] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:04.093205 23220 raft_consensus.cc:2258] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:04.093909 23220 ts_tablet_manager.cc:1875] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:04.095845 23220 ts_tablet_manager.cc:1888] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 01:59:04.095930 23220 log.cc:1196] T df21aa40548c4f49bae79294085c80f4 P 6431e35365644aac943c07c97e370fee: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/df21aa40548c4f49bae79294085c80f4
I20240502 01:59:04.096443 16764 catalog_manager.cc:4830] TS 6431e35365644aac943c07c97e370fee (127.10.133.194:37811): tablet df21aa40548c4f49bae79294085c80f4 (table rebalance_test_table_2 [id=e2d3cd2117a14964a0bc535eca4d5850]) successfully deleted
I20240502 01:59:04.124325 23222 raft_consensus.cc:1050] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441: attempting to promote NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 to VOTER
I20240502 01:59:04.124795 23222 consensus_queue.cc:237] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:59:04.126153 19050 raft_consensus.cc:1261] T 7c92206bbd4340d59a7ee7379f581bb7 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.126217 16923 raft_consensus.cc:1261] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.126216 18784 raft_consensus.cc:1261] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.126691 23224 consensus_queue.cc:1035] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.126879 23221 consensus_queue.cc:1035] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.127089 22294 consensus_queue.cc:1035] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.128787 23224 raft_consensus.cc:2932] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.129192 16923 raft_consensus.cc:2932] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.129210 19050 raft_consensus.cc:2932] T 7c92206bbd4340d59a7ee7379f581bb7 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.131680 16775 catalog_manager.cc:5484] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 7 to 8, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.132947 18784 raft_consensus.cc:2932] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.136742 23201 raft_consensus.cc:1050] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee: attempting to promote NON_VOTER 436e7859396c42a6b60714873cb60495 to VOTER
I20240502 01:59:04.137152 23201 consensus_queue.cc:237] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:59:04.138533 17325 consensus_queue.cc:237] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:59:04.138772 17324 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.139129 23201 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.139662 19050 raft_consensus.cc:1261] T 7c92206bbd4340d59a7ee7379f581bb7 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:04.140156 18650 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.140620 23221 consensus_queue.cc:1035] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.140607 23204 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.140745 18784 raft_consensus.cc:1261] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:04.140746 18918 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.141106 23222 consensus_queue.cc:1035] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.141256 22703 raft_consensus.cc:1050] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4: attempting to promote NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 to VOTER
I20240502 01:59:04.141361 23202 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.141691 22703 consensus_queue.cc:237] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:59:04.142695 23222 raft_consensus.cc:2932] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.143319 17059 raft_consensus.cc:1261] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.143527 18919 raft_consensus.cc:1261] T 47f0db0b9b7744758b9ca7f1e797bdb0 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.143874 23190 consensus_queue.cc:1035] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.144039 23189 consensus_queue.cc:1035] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.144304 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 7c92206bbd4340d59a7ee7379f581bb7 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:04.144588 18785 raft_consensus.cc:2932] T 7c92206bbd4340d59a7ee7379f581bb7 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.146184 18784 raft_consensus.cc:1261] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.146191 16775 catalog_manager.cc:5484] T 7c92206bbd4340d59a7ee7379f581bb7 P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index 8 to 9, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:04.146550 23189 consensus_queue.cc:1035] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.147171 19050 raft_consensus.cc:2932] T 7c92206bbd4340d59a7ee7379f581bb7 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.148777 23202 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.148958 23189 raft_consensus.cc:2932] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:59:04.150497 18919 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.151012 18918 raft_consensus.cc:2932] T 47f0db0b9b7744758b9ca7f1e797bdb0 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:59:04.151670 17325 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.152577 16773 catalog_manager.cc:5484] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 7 to 8, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:04.153107 16772 catalog_manager.cc:5484] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 7 to 8, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:04.153679 17059 raft_consensus.cc:2932] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:59:04.153945 18784 raft_consensus.cc:2932] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:59:04.155141 16901 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c92206bbd4340d59a7ee7379f581bb7 with delete_type TABLET_DATA_TOMBSTONED (TS 191fe00ca08b44c9aef6646e86aecebc not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:40018
I20240502 01:59:04.155402 23200 tablet_replica.cc:330] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc: stopping tablet replica
I20240502 01:59:04.155552 23200 raft_consensus.cc:2229] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:04.155755 23200 raft_consensus.cc:2258] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:04.158555 18650 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.161067 23200 ts_tablet_manager.cc:1875] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:04.161549 17192 consensus_queue.cc:237] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:59:04.162622 18918 raft_consensus.cc:1261] T 47f0db0b9b7744758b9ca7f1e797bdb0 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:04.162952 23195 consensus_queue.cc:1035] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.163156 23200 ts_tablet_manager.cc:1888] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 01:59:04.163214 23200 log.cc:1196] T 7c92206bbd4340d59a7ee7379f581bb7 P 191fe00ca08b44c9aef6646e86aecebc: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/7c92206bbd4340d59a7ee7379f581bb7
I20240502 01:59:04.163766 16764 catalog_manager.cc:4830] TS 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571): tablet 7c92206bbd4340d59a7ee7379f581bb7 (table rebalance_test_table_4 [id=ed83c8027ba34b24b41cae8d5a7a294c]) successfully deleted
I20240502 01:59:04.163997 18784 raft_consensus.cc:1261] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:04.164322 23195 consensus_queue.cc:1035] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.164646 22703 raft_consensus.cc:2932] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:59:04.165038 18919 raft_consensus.cc:2932] T 47f0db0b9b7744758b9ca7f1e797bdb0 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:59:04.166635 16765 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 47f0db0b9b7744758b9ca7f1e797bdb0 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:04.167102 16772 catalog_manager.cc:5484] T 47f0db0b9b7744758b9ca7f1e797bdb0 P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 8 to 9, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New cstate: current_term: 1 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:04.167642 18784 raft_consensus.cc:2932] T 47f0db0b9b7744758b9ca7f1e797bdb0 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:59:04.169152 17039 tablet_service.cc:1514] Processing DeleteTablet for tablet 47f0db0b9b7744758b9ca7f1e797bdb0 with delete_type TABLET_DATA_TOMBSTONED (TS 6431e35365644aac943c07c97e370fee not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:58394
I20240502 01:59:04.169360 23220 tablet_replica.cc:330] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee: stopping tablet replica
I20240502 01:59:04.169540 23220 raft_consensus.cc:2229] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:04.169734 23220 raft_consensus.cc:2258] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:04.170737 23220 ts_tablet_manager.cc:1875] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:04.172412 23220 ts_tablet_manager.cc:1888] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 01:59:04.172477 23220 log.cc:1196] T 47f0db0b9b7744758b9ca7f1e797bdb0 P 6431e35365644aac943c07c97e370fee: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/47f0db0b9b7744758b9ca7f1e797bdb0
I20240502 01:59:04.172930 16764 catalog_manager.cc:4830] TS 6431e35365644aac943c07c97e370fee (127.10.133.194:37811): tablet 47f0db0b9b7744758b9ca7f1e797bdb0 (table rebalance_test_table_7 [id=a8b80745166a46a9a386a8805718513d]) successfully deleted
I20240502 01:59:04.179646 19971 raft_consensus.cc:1203] T 029dba0050a64bd4adb35e9815450450 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 01:59:04.249739 17059 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d9de883c491f43378a26c5a370062555"
dest_uuid: "6431e35365644aac943c07c97e370fee"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:47236
I20240502 01:59:04.249876 17059 raft_consensus.cc:595] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Received request to transfer leadership
I20240502 01:59:04.271214 23204 raft_consensus.cc:1050] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee: attempting to promote NON_VOTER b7ec79239ce64b38a1d55f66a95407c0 to VOTER
I20240502 01:59:04.271644 23204 consensus_queue.cc:237] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:59:04.272886 16923 raft_consensus.cc:1261] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.274158 23204 consensus_queue.cc:1035] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.275167 22703 raft_consensus.cc:1050] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4: attempting to promote NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 to VOTER
I20240502 01:59:04.275606 22703 consensus_queue.cc:237] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 2.8, Last appended by leader: 5, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:04.277052 22708 raft_consensus.cc:1050] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee: attempting to promote NON_VOTER 436e7859396c42a6b60714873cb60495 to VOTER
I20240502 01:59:04.277395 19971 raft_consensus.cc:1261] T 086b486997ae4d15a4b070e79552807f P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 2 LEARNER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:04.277433 22708 consensus_queue.cc:237] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:59:04.278030 17325 raft_consensus.cc:1261] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:04.278239 18784 raft_consensus.cc:1261] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.278241 23190 consensus_queue.cc:1035] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.278899 17325 raft_consensus.cc:1261] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.279109 23201 consensus_queue.cc:1035] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.279162 18650 raft_consensus.cc:1261] T 8a386a1fd8ae4d70ae482b3ce958825b P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.279537 23201 consensus_queue.cc:1035] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.279567 23195 consensus_queue.cc:1035] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.280100 18919 raft_consensus.cc:1261] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0 [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:04.280141 23201 consensus_queue.cc:1035] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.280241 18918 raft_consensus.cc:1261] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 LEARNER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.280544 18917 raft_consensus.cc:1261] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.280771 23195 consensus_queue.cc:1035] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.282663 23201 consensus_queue.cc:1035] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.282976 23201 consensus_queue.cc:1035] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.283690 23190 raft_consensus.cc:2932] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [term 2 LEADER]: Committing config change with OpId 2.9: config changed from index 8 to 9, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.284248 19971 raft_consensus.cc:2932] T 086b486997ae4d15a4b070e79552807f P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 8 to 9, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.285341 18917 raft_consensus.cc:2932] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0 [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 8 to 9, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.287099 16778 catalog_manager.cc:5484] T 086b486997ae4d15a4b070e79552807f P 71c28e01ad304ab2a6adf2eb26ba7cc9 reported cstate change: config changed from index 8 to 9, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.287233 17324 raft_consensus.cc:2932] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 8 to 9, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.291016 23201 raft_consensus.cc:2932] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:59:04.291523 18784 raft_consensus.cc:2932] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:59:04.293555 17192 consensus_queue.cc:237] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:04.294114 16923 raft_consensus.cc:2932] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:59:04.295042 19971 raft_consensus.cc:1261] T 086b486997ae4d15a4b070e79552807f P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 01:59:04.295471 23189 consensus_queue.cc:1035] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:04.295564 18917 raft_consensus.cc:2932] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:59:04.295805 18918 raft_consensus.cc:1261] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0 [term 2 FOLLOWER]: Refusing update from remote peer a1c00c21761540dea7ddae8d0dd26df4: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 01:59:04.296193 23189 consensus_queue.cc:1035] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:04.296667 16778 catalog_manager.cc:5484] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b reported cstate change: config changed from index 7 to 8, b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:59:04.299037 23189 raft_consensus.cc:2932] T 086b486997ae4d15a4b070e79552807f P a1c00c21761540dea7ddae8d0dd26df4 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.301973 16765 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 086b486997ae4d15a4b070e79552807f with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:04.302151 18917 raft_consensus.cc:2932] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.302592 19971 raft_consensus.cc:2932] T 086b486997ae4d15a4b070e79552807f P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.305063 16772 catalog_manager.cc:5484] T 086b486997ae4d15a4b070e79552807f P b7ec79239ce64b38a1d55f66a95407c0 reported cstate change: config changed from index 9 to 10, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New cstate: current_term: 2 leader_uuid: "a1c00c21761540dea7ddae8d0dd26df4" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.307607 17304 tablet_service.cc:1514] Processing DeleteTablet for tablet 086b486997ae4d15a4b070e79552807f with delete_type TABLET_DATA_TOMBSTONED (TS ec11d4bb3a064a94a80084142637b441 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:58608
I20240502 01:59:04.307861 23219 tablet_replica.cc:330] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441: stopping tablet replica
I20240502 01:59:04.307979 23219 raft_consensus.cc:2229] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:04.308171 23219 raft_consensus.cc:2258] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:04.308945 23219 ts_tablet_manager.cc:1875] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:04.310205 16923 consensus_queue.cc:237] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:04.311923 18650 raft_consensus.cc:1261] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:04.311966 17059 raft_consensus.cc:1261] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 01:59:04.311973 16859 consensus_peers.cc:485] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc -> Peer 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201:36215): Couldn't send request to peer 71c28e01ad304ab2a6adf2eb26ba7cc9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2aeb35a29ea645288fe123b890452936. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:04.312314 23152 consensus_queue.cc:1035] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:04.312520 22707 consensus_queue.cc:1035] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:04.313354 23201 raft_consensus.cc:2932] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.313740 23219 ts_tablet_manager.cc:1888] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20240502 01:59:04.313843 23219 log.cc:1196] T 086b486997ae4d15a4b070e79552807f P ec11d4bb3a064a94a80084142637b441: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/086b486997ae4d15a4b070e79552807f
I20240502 01:59:04.314067 18919 raft_consensus.cc:2932] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.315239 16764 catalog_manager.cc:4830] TS ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135): tablet 086b486997ae4d15a4b070e79552807f (table rebalance_test_table_5 [id=2cbb40e4a59445dc9a1b5b4161e4c646]) successfully deleted
I20240502 01:59:04.316262 18650 raft_consensus.cc:2932] T 8a386a1fd8ae4d70ae482b3ce958825b P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.316385 16778 catalog_manager.cc:5484] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 7 to 8, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:04.316463 23152 raft_consensus.cc:2932] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:04.319221 16773 catalog_manager.cc:5484] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:04.321059 17058 consensus_queue.cc:237] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:59:04.322503 18652 raft_consensus.cc:1261] T 8a386a1fd8ae4d70ae482b3ce958825b P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:04.323391 18650 raft_consensus.cc:2932] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:04.324234 23202 consensus_queue.cc:1035] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.324340 17059 raft_consensus.cc:2932] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:04.327093 18919 raft_consensus.cc:1261] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:04.327466 23204 consensus_queue.cc:1035] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.328877 22708 raft_consensus.cc:2932] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.329255 18650 raft_consensus.cc:2932] T 8a386a1fd8ae4d70ae482b3ce958825b P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.330444 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 8a386a1fd8ae4d70ae482b3ce958825b with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:04.331717 16772 catalog_manager.cc:5484] T 8a386a1fd8ae4d70ae482b3ce958825b P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 8 to 9, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:04.333184 18919 raft_consensus.cc:2932] T 8a386a1fd8ae4d70ae482b3ce958825b P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.335130 17304 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a386a1fd8ae4d70ae482b3ce958825b with delete_type TABLET_DATA_TOMBSTONED (TS ec11d4bb3a064a94a80084142637b441 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:58608
I20240502 01:59:04.335443 23219 tablet_replica.cc:330] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441: stopping tablet replica
I20240502 01:59:04.335587 23219 raft_consensus.cc:2229] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:04.335773 23219 pending_rounds.cc:62] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441: Trying to abort 1 pending ops.
I20240502 01:59:04.335852 23219 pending_rounds.cc:68] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441: Aborting op as it isn't in flight: id { term: 1 index: 8 } timestamp: 7023063630959009792 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "8a386a1fd8ae4d70ae482b3ce958825b" old_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: true } } } new_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } } }
I20240502 01:59:04.336016 23219 raft_consensus.cc:2894] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Aborting config change with OpId 1.8: Aborted: Op aborted
I20240502 01:59:04.336081 23219 raft_consensus.cc:2866] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20240502 01:59:04.336126 23219 raft_consensus.cc:2258] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:04.337038 16923 consensus_queue.cc:237] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:04.337242 23219 ts_tablet_manager.cc:1875] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:04.338588 18650 raft_consensus.cc:1261] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 01:59:04.339092 16859 consensus_peers.cc:485] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc -> Peer 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201:36215): Couldn't send request to peer 71c28e01ad304ab2a6adf2eb26ba7cc9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cc145366c6244010b42a07e961f9636f. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:04.339339 22707 consensus_queue.cc:1035] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:04.339522 17325 raft_consensus.cc:1261] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:04.339888 22707 consensus_queue.cc:1035] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:04.340652 23219 ts_tablet_manager.cc:1888] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 01:59:04.340778 23219 log.cc:1196] T 8a386a1fd8ae4d70ae482b3ce958825b P ec11d4bb3a064a94a80084142637b441: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/8a386a1fd8ae4d70ae482b3ce958825b
I20240502 01:59:04.341351 16764 catalog_manager.cc:4830] TS ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135): tablet 8a386a1fd8ae4d70ae482b3ce958825b (table rebalance_test_table_6 [id=3b1319b666dc429cb0d33c9c55b7266e]) successfully deleted
I20240502 01:59:04.341373 23152 raft_consensus.cc:2932] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:04.341778 18650 raft_consensus.cc:2932] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:04.342429 17325 raft_consensus.cc:2932] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:04.344424 16772 catalog_manager.cc:5484] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:04.369580 23222 raft_consensus.cc:1050] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441: attempting to promote NON_VOTER d7989bd96de94be4a94995fcfcd6b16b to VOTER
I20240502 01:59:04.370079 23222 consensus_queue.cc:237] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 2.8, Last appended by leader: 5, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } }
I20240502 01:59:04.371599 17192 raft_consensus.cc:1261] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 2 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:04.371599 18784 raft_consensus.cc:1261] T e03fff9bc743475d92ae26b85e7f39ff P d7989bd96de94be4a94995fcfcd6b16b [term 2 LEARNER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:04.371974 23221 consensus_queue.cc:1035] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.372141 23222 consensus_queue.cc:1035] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.372256 19050 raft_consensus.cc:1261] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 2 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:04.372665 23221 consensus_queue.cc:1035] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.375089 22294 raft_consensus.cc:2932] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [term 2 LEADER]: Committing config change with OpId 2.9: config changed from index 8 to 9, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:59:04.376101 18784 raft_consensus.cc:2932] T e03fff9bc743475d92ae26b85e7f39ff P d7989bd96de94be4a94995fcfcd6b16b [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 8 to 9, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:59:04.377012 19050 raft_consensus.cc:2932] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 8 to 9, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:59:04.377012 17192 raft_consensus.cc:2932] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 2 FOLLOWER]: Committing config change with OpId 2.9: config changed from index 8 to 9, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:59:04.379647 16778 catalog_manager.cc:5484] T e03fff9bc743475d92ae26b85e7f39ff P d7989bd96de94be4a94995fcfcd6b16b reported cstate change: config changed from index 8 to 9, d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:59:04.382861 17325 consensus_queue.cc:237] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } }
I20240502 01:59:04.384240 19050 raft_consensus.cc:1261] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 01:59:04.384573 23222 consensus_queue.cc:1035] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:04.384877 18784 raft_consensus.cc:1261] T e03fff9bc743475d92ae26b85e7f39ff P d7989bd96de94be4a94995fcfcd6b16b [term 2 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 01:59:04.385637 23222 consensus_queue.cc:1035] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:04.387111 23221 raft_consensus.cc:2932] T e03fff9bc743475d92ae26b85e7f39ff P ec11d4bb3a064a94a80084142637b441 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:59:04.387512 19050 raft_consensus.cc:2932] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:59:04.387676 18784 raft_consensus.cc:2932] T e03fff9bc743475d92ae26b85e7f39ff P d7989bd96de94be4a94995fcfcd6b16b [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 9 to 10, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:59:04.388769 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet e03fff9bc743475d92ae26b85e7f39ff with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:04.389746 16772 catalog_manager.cc:5484] T e03fff9bc743475d92ae26b85e7f39ff P b6aa9ef40e50468ca7a9742c21140d24 reported cstate change: config changed from index 9 to 10, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New cstate: current_term: 2 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } }
I20240502 01:59:04.392221 17171 tablet_service.cc:1514] Processing DeleteTablet for tablet e03fff9bc743475d92ae26b85e7f39ff with delete_type TABLET_DATA_TOMBSTONED (TS a1c00c21761540dea7ddae8d0dd26df4 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:50964
I20240502 01:59:04.392824 23386 tablet_replica.cc:330] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4: stopping tablet replica
I20240502 01:59:04.393078 23386 raft_consensus.cc:2229] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:04.393292 23386 raft_consensus.cc:2258] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:04.393939 23386 ts_tablet_manager.cc:1875] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:04.396287 23386 ts_tablet_manager.cc:1888] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20240502 01:59:04.396358 23386 log.cc:1196] T e03fff9bc743475d92ae26b85e7f39ff P a1c00c21761540dea7ddae8d0dd26df4: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/wals/e03fff9bc743475d92ae26b85e7f39ff
I20240502 01:59:04.396854 16765 catalog_manager.cc:4830] TS a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923): tablet e03fff9bc743475d92ae26b85e7f39ff (table rebalance_test_table_5 [id=2cbb40e4a59445dc9a1b5b4161e4c646]) successfully deleted
I20240502 01:59:04.410387 17059 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d9de883c491f43378a26c5a370062555"
dest_uuid: "6431e35365644aac943c07c97e370fee"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:47276
I20240502 01:59:04.410511 17059 raft_consensus.cc:595] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Received request to transfer leadership
I20240502 01:59:04.412281 23202 raft_consensus.cc:1050] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee: attempting to promote NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 to VOTER
I20240502 01:59:04.412740 23202 consensus_queue.cc:237] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:04.414381 19050 raft_consensus.cc:1261] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.414388 17325 raft_consensus.cc:1261] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.414737 19971 raft_consensus.cc:1261] T 1a396235bc534141bcd180430c51e7e1 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.414872 22708 consensus_queue.cc:1035] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.415210 22708 consensus_queue.cc:1035] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.416723 23201 consensus_queue.cc:1035] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.418008 23202 raft_consensus.cc:2932] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.418430 19050 raft_consensus.cc:2932] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.420002 17325 raft_consensus.cc:2932] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.421101 16776 catalog_manager.cc:5484] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24 reported cstate change: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.422546 19971 raft_consensus.cc:2932] T 1a396235bc534141bcd180430c51e7e1 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.426422 23214 raft_consensus.cc:1050] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc: attempting to promote NON_VOTER 436e7859396c42a6b60714873cb60495 to VOTER
I20240502 01:59:04.426858 23214 consensus_queue.cc:237] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:59:04.428124 17059 consensus_queue.cc:237] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:04.429281 19050 raft_consensus.cc:1261] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:04.429319 18652 raft_consensus.cc:1261] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [term 1 LEARNER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.429697 22708 consensus_queue.cc:1035] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.429898 23214 consensus_queue.cc:1035] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.430156 19050 raft_consensus.cc:1261] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.430507 23213 consensus_queue.cc:1035] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.431015 17192 raft_consensus.cc:1261] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.431201 19971 raft_consensus.cc:1261] T 1a396235bc534141bcd180430c51e7e1 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:04.431429 22707 consensus_queue.cc:1035] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.431558 22708 raft_consensus.cc:2932] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.432941 22708 consensus_queue.cc:1035] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.433300 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 1a396235bc534141bcd180430c51e7e1 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:04.433729 19050 raft_consensus.cc:2932] T 1a396235bc534141bcd180430c51e7e1 P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.434087 19971 raft_consensus.cc:2932] T 1a396235bc534141bcd180430c51e7e1 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.434602 16772 catalog_manager.cc:5484] T 1a396235bc534141bcd180430c51e7e1 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 8 to 9, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:04.435220 22707 raft_consensus.cc:2932] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.437296 17304 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a396235bc534141bcd180430c51e7e1 with delete_type TABLET_DATA_TOMBSTONED (TS ec11d4bb3a064a94a80084142637b441 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:58608
I20240502 01:59:04.437553 23219 tablet_replica.cc:330] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441: stopping tablet replica
I20240502 01:59:04.437709 23219 raft_consensus.cc:2229] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:04.437899 23219 raft_consensus.cc:2258] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:04.438073 16773 catalog_manager.cc:5484] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 7 to 8, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:04.439110 23219 ts_tablet_manager.cc:1875] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:04.439378 17192 raft_consensus.cc:2932] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.440948 18652 raft_consensus.cc:2932] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.441370 19049 raft_consensus.cc:2932] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 436e7859396c42a6b60714873cb60495 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:04.441702 23219 ts_tablet_manager.cc:1888] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 01:59:04.441839 23219 log.cc:1196] T 1a396235bc534141bcd180430c51e7e1 P ec11d4bb3a064a94a80084142637b441: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/1a396235bc534141bcd180430c51e7e1
I20240502 01:59:04.442498 16764 catalog_manager.cc:4830] TS ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135): tablet 1a396235bc534141bcd180430c51e7e1 (table rebalance_test_table_1 [id=e1f098a771d942879080a8a67a25fa1c]) successfully deleted
I20240502 01:59:04.452926 17059 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1a375533a25a4da5b0030b0e06488351"
dest_uuid: "6431e35365644aac943c07c97e370fee"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:47292
I20240502 01:59:04.453050 17059 raft_consensus.cc:595] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Received request to transfer leadership
I20240502 01:59:04.460739 16923 consensus_queue.cc:237] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:04.462240 17059 raft_consensus.cc:1261] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:04.462256 18784 raft_consensus.cc:1261] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:04.462606 23214 consensus_queue.cc:1035] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:04.462854 23213 consensus_queue.cc:1035] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20240502 01:59:04.463198 16859 consensus_peers.cc:485] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc -> Peer 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201:36215): Couldn't send request to peer 71c28e01ad304ab2a6adf2eb26ba7cc9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: adf06dd039c4433890e31c1ad9b44e98. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:04.464761 23213 raft_consensus.cc:2932] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:04.465204 17059 raft_consensus.cc:2932] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:04.465420 18784 raft_consensus.cc:2932] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:04.467818 16778 catalog_manager.cc:5484] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:04.498772 16923 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2162035e4ed4433fafcc49934be62a9c"
dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:39576
I20240502 01:59:04.498929 16923 raft_consensus.cc:595] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Received request to transfer leadership
I20240502 01:59:04.524993 17059 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d9de883c491f43378a26c5a370062555"
dest_uuid: "6431e35365644aac943c07c97e370fee"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:47310
I20240502 01:59:04.525128 17059 raft_consensus.cc:595] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Received request to transfer leadership
I20240502 01:59:04.535336 17059 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1a375533a25a4da5b0030b0e06488351"
dest_uuid: "6431e35365644aac943c07c97e370fee"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:47326
I20240502 01:59:04.535465 17059 raft_consensus.cc:595] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Received request to transfer leadership
I20240502 01:59:04.543241 16923 consensus_queue.cc:237] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:04.544683 17059 raft_consensus.cc:1261] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:04.544682 18652 raft_consensus.cc:1261] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
W20240502 01:59:04.544987 16859 consensus_peers.cc:485] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc -> Peer 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201:36215): Couldn't send request to peer 71c28e01ad304ab2a6adf2eb26ba7cc9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6fb89894cf594139aecab491957f96c9. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:04.545076 23214 consensus_queue.cc:1035] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:04.545265 23152 consensus_queue.cc:1035] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:04.547187 22707 raft_consensus.cc:2932] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:04.547672 18652 raft_consensus.cc:2932] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:04.547747 17059 raft_consensus.cc:2932] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:04.550602 16776 catalog_manager.cc:5484] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495 reported cstate change: config changed from index 6 to 7, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:04.581285 16923 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2162035e4ed4433fafcc49934be62a9c"
dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:39676
I20240502 01:59:04.581415 16923 raft_consensus.cc:595] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Received request to transfer leadership
I20240502 01:59:04.581959 23204 raft_consensus.cc:979] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee: : Instructing follower b7ec79239ce64b38a1d55f66a95407c0 to start an election
I20240502 01:59:04.582096 23202 raft_consensus.cc:1067] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Signalling peer b7ec79239ce64b38a1d55f66a95407c0 to start an election
I20240502 01:59:04.582672 18919 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d9de883c491f43378a26c5a370062555"
dest_uuid: "b7ec79239ce64b38a1d55f66a95407c0"
from {username='slave'} at 127.10.133.194:35253
I20240502 01:59:04.582875 18919 raft_consensus.cc:482] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:59:04.582950 18919 raft_consensus.cc:3037] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:59:04.584060 18919 raft_consensus.cc:504] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:59:04.585228 18919 leader_election.cc:288] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [CANDIDATE]: Term 2 election: Requested vote from peers 6431e35365644aac943c07c97e370fee (127.10.133.194:37811), ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135), 436e7859396c42a6b60714873cb60495 (127.10.133.197:45213)
I20240502 01:59:04.585474 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9de883c491f43378a26c5a370062555" candidate_uuid: "b7ec79239ce64b38a1d55f66a95407c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "6431e35365644aac943c07c97e370fee"
I20240502 01:59:04.585604 17059 raft_consensus.cc:3032] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:59:04.585570 17325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9de883c491f43378a26c5a370062555" candidate_uuid: "b7ec79239ce64b38a1d55f66a95407c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "ec11d4bb3a064a94a80084142637b441"
I20240502 01:59:04.585644 17059 raft_consensus.cc:729] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Running, Role: LEADER
I20240502 01:59:04.585711 17325 raft_consensus.cc:3037] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:59:04.585775 17059 consensus_queue.cc:260] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:59:04.585942 17059 raft_consensus.cc:3037] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:59:04.586737 17325 raft_consensus.cc:2454] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ec79239ce64b38a1d55f66a95407c0 in term 2.
I20240502 01:59:04.586877 17059 raft_consensus.cc:2454] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ec79239ce64b38a1d55f66a95407c0 in term 2.
I20240502 01:59:04.587514 18850 leader_election.cc:302] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6431e35365644aac943c07c97e370fee, b7ec79239ce64b38a1d55f66a95407c0, ec11d4bb3a064a94a80084142637b441; no voters:
I20240502 01:59:04.587752 23236 raft_consensus.cc:2781] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:59:04.587862 23236 raft_consensus.cc:686] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [term 2 LEADER]: Becoming Leader. State: Replica: b7ec79239ce64b38a1d55f66a95407c0, State: Running, Role: LEADER
I20240502 01:59:04.588157 23236 consensus_queue.cc:237] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:59:04.590962 16772 catalog_manager.cc:5484] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 reported cstate change: term changed from 1 to 2, leader changed from 6431e35365644aac943c07c97e370fee (127.10.133.194) to b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199). New cstate: current_term: 2 leader_uuid: "b7ec79239ce64b38a1d55f66a95407c0" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:04.591218 18652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9de883c491f43378a26c5a370062555" candidate_uuid: "b7ec79239ce64b38a1d55f66a95407c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "436e7859396c42a6b60714873cb60495"
I20240502 01:59:04.591405 18652 raft_consensus.cc:3037] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:59:04.592398 18652 raft_consensus.cc:2454] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7ec79239ce64b38a1d55f66a95407c0 in term 2.
I20240502 01:59:04.612681 17059 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1a375533a25a4da5b0030b0e06488351"
dest_uuid: "6431e35365644aac943c07c97e370fee"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:47350
I20240502 01:59:04.612805 17059 raft_consensus.cc:595] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Received request to transfer leadership
I20240502 01:59:04.620177 23224 raft_consensus.cc:1050] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441: attempting to promote NON_VOTER b6aa9ef40e50468ca7a9742c21140d24 to VOTER
I20240502 01:59:04.620666 23224 consensus_queue.cc:237] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:59:04.622130 19049 raft_consensus.cc:1261] T 64b3111c603247ac8ff4a1eb9369086f P b6aa9ef40e50468ca7a9742c21140d24 [term 1 LEARNER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.622200 17059 raft_consensus.cc:1261] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.622192 18919 raft_consensus.cc:1261] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.622525 22294 consensus_queue.cc:1035] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.622706 23222 consensus_queue.cc:1035] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.622925 23221 consensus_queue.cc:1035] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.624811 23221 raft_consensus.cc:2932] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.625308 18919 raft_consensus.cc:2932] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.625638 19049 raft_consensus.cc:2932] T 64b3111c603247ac8ff4a1eb9369086f P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.629005 16772 catalog_manager.cc:5484] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index 7 to 8, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:04.630169 17059 raft_consensus.cc:2932] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.633502 17325 consensus_queue.cc:237] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } }
I20240502 01:59:04.634819 19049 raft_consensus.cc:1261] T 64b3111c603247ac8ff4a1eb9369086f P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:04.634966 18919 raft_consensus.cc:1261] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer ec11d4bb3a064a94a80084142637b441: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:04.635231 22294 consensus_queue.cc:1035] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.635397 23222 consensus_queue.cc:1035] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.636858 23224 raft_consensus.cc:2932] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.637403 19049 raft_consensus.cc:2932] T 64b3111c603247ac8ff4a1eb9369086f P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.637486 18919 raft_consensus.cc:2932] T 64b3111c603247ac8ff4a1eb9369086f P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } }
I20240502 01:59:04.638271 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 64b3111c603247ac8ff4a1eb9369086f with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:04.639600 16773 catalog_manager.cc:5484] T 64b3111c603247ac8ff4a1eb9369086f P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index 8 to 9, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New cstate: current_term: 1 leader_uuid: "ec11d4bb3a064a94a80084142637b441" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:04.642146 17039 tablet_service.cc:1514] Processing DeleteTablet for tablet 64b3111c603247ac8ff4a1eb9369086f with delete_type TABLET_DATA_TOMBSTONED (TS 6431e35365644aac943c07c97e370fee not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:58394
I20240502 01:59:04.642344 23220 tablet_replica.cc:330] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee: stopping tablet replica
I20240502 01:59:04.642452 23220 raft_consensus.cc:2229] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:04.642596 23220 raft_consensus.cc:2258] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:04.643208 23220 ts_tablet_manager.cc:1875] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:04.644973 23220 ts_tablet_manager.cc:1888] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 01:59:04.645041 23220 log.cc:1196] T 64b3111c603247ac8ff4a1eb9369086f P 6431e35365644aac943c07c97e370fee: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/64b3111c603247ac8ff4a1eb9369086f
I20240502 01:59:04.645512 16764 catalog_manager.cc:4830] TS 6431e35365644aac943c07c97e370fee (127.10.133.194:37811): tablet 64b3111c603247ac8ff4a1eb9369086f (table rebalance_test_table_8 [id=cd393e2f31fe436b87329907984e9dcd]) successfully deleted
I20240502 01:59:04.684049 23204 raft_consensus.cc:979] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee: : Instructing follower 191fe00ca08b44c9aef6646e86aecebc to start an election
I20240502 01:59:04.684157 23204 raft_consensus.cc:1067] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Signalling peer 191fe00ca08b44c9aef6646e86aecebc to start an election
I20240502 01:59:04.684607 16923 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1a375533a25a4da5b0030b0e06488351"
dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
from {username='slave'} at 127.10.133.194:40907
I20240502 01:59:04.684741 16923 raft_consensus.cc:482] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:59:04.684806 16923 raft_consensus.cc:3037] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:59:04.685652 16923 raft_consensus.cc:504] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:59:04.686102 16923 leader_election.cc:288] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 2 election: Requested vote from peers 6431e35365644aac943c07c97e370fee (127.10.133.194:37811), d7989bd96de94be4a94995fcfcd6b16b (127.10.133.198:45549), b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199:34045)
I20240502 01:59:04.686462 17059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a375533a25a4da5b0030b0e06488351" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "6431e35365644aac943c07c97e370fee"
I20240502 01:59:04.686534 18919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a375533a25a4da5b0030b0e06488351" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "b7ec79239ce64b38a1d55f66a95407c0"
I20240502 01:59:04.686579 17059 raft_consensus.cc:3032] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:59:04.686623 17059 raft_consensus.cc:729] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6431e35365644aac943c07c97e370fee, State: Running, Role: LEADER
I20240502 01:59:04.686599 18784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a375533a25a4da5b0030b0e06488351" candidate_uuid: "191fe00ca08b44c9aef6646e86aecebc" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "d7989bd96de94be4a94995fcfcd6b16b"
I20240502 01:59:04.686662 18919 raft_consensus.cc:3037] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:59:04.686761 18784 raft_consensus.cc:3037] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:59:04.686812 17059 consensus_queue.cc:260] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:59:04.687017 17059 raft_consensus.cc:3037] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:59:04.687675 18784 raft_consensus.cc:2454] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 2.
I20240502 01:59:04.687731 18919 raft_consensus.cc:2454] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 2.
I20240502 01:59:04.688071 17059 raft_consensus.cc:2454] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191fe00ca08b44c9aef6646e86aecebc in term 2.
I20240502 01:59:04.688433 16858 leader_election.cc:302] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, b7ec79239ce64b38a1d55f66a95407c0, d7989bd96de94be4a94995fcfcd6b16b; no voters:
I20240502 01:59:04.688621 23152 raft_consensus.cc:2781] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:59:04.688702 23152 raft_consensus.cc:686] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 2 LEADER]: Becoming Leader. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Running, Role: LEADER
I20240502 01:59:04.688864 23152 consensus_queue.cc:237] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:59:04.690855 16776 catalog_manager.cc:5484] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: term changed from 1 to 2, leader changed from 6431e35365644aac943c07c97e370fee (127.10.133.194) to 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193). New cstate: current_term: 2 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:04.727232 23565 ts_tablet_manager.cc:902] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Initiating tablet copy from peer 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:59:04.727751 23565 tablet_copy_client.cc:308] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:45571
I20240502 01:59:04.728209 16943 tablet_copy_service.cc:140] P 191fe00ca08b44c9aef6646e86aecebc: Received BeginTabletCopySession request for tablet 2aeb35a29ea645288fe123b890452936 from peer 71c28e01ad304ab2a6adf2eb26ba7cc9 ({username='slave'} at 127.10.133.201:46641)
I20240502 01:59:04.728314 16943 tablet_copy_service.cc:161] P 191fe00ca08b44c9aef6646e86aecebc: Beginning new tablet copy session on tablet 2aeb35a29ea645288fe123b890452936 from peer 71c28e01ad304ab2a6adf2eb26ba7cc9 at {username='slave'} at 127.10.133.201:46641: session id = 71c28e01ad304ab2a6adf2eb26ba7cc9-2aeb35a29ea645288fe123b890452936
I20240502 01:59:04.729048 16943 tablet_copy_source_session.cc:205] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:04.729903 23565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2aeb35a29ea645288fe123b890452936. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:04.731709 23565 tablet_copy_client.cc:783] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:04.731853 23565 tablet_copy_client.cc:647] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:04.732914 23569 tablet_copy_client.cc:1002] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Injecting latency into file download: 1500
I20240502 01:59:04.746848 23152 raft_consensus.cc:1050] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc: attempting to promote NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 to VOTER
I20240502 01:59:04.747241 23152 consensus_queue.cc:237] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:04.748538 19971 raft_consensus.cc:1261] T 029dba0050a64bd4adb35e9815450450 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.748677 18919 raft_consensus.cc:1261] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.748831 17192 raft_consensus.cc:1261] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:04.748931 22707 consensus_queue.cc:1035] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.749145 23214 consensus_queue.cc:1035] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.749464 22707 consensus_queue.cc:1035] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:04.751358 23214 raft_consensus.cc:2932] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.751896 17192 raft_consensus.cc:2932] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.751909 18919 raft_consensus.cc:2932] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.754474 16776 catalog_manager.cc:5484] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0 reported cstate change: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.755206 19971 raft_consensus.cc:2932] T 029dba0050a64bd4adb35e9815450450 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.758188 16923 consensus_queue.cc:237] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:04.759222 19971 raft_consensus.cc:1261] T 029dba0050a64bd4adb35e9815450450 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:04.759286 18919 raft_consensus.cc:1261] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:04.759565 23213 consensus_queue.cc:1035] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.759729 22707 consensus_queue.cc:1035] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:04.761507 22707 raft_consensus.cc:2932] T 029dba0050a64bd4adb35e9815450450 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.762143 19971 raft_consensus.cc:2932] T 029dba0050a64bd4adb35e9815450450 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.762904 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 029dba0050a64bd4adb35e9815450450 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:04.764361 16778 catalog_manager.cc:5484] T 029dba0050a64bd4adb35e9815450450 P 71c28e01ad304ab2a6adf2eb26ba7cc9 reported cstate change: config changed from index 8 to 9, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.766917 17171 tablet_service.cc:1514] Processing DeleteTablet for tablet 029dba0050a64bd4adb35e9815450450 with delete_type TABLET_DATA_TOMBSTONED (TS a1c00c21761540dea7ddae8d0dd26df4 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:50964
I20240502 01:59:04.766894 18919 raft_consensus.cc:2932] T 029dba0050a64bd4adb35e9815450450 P b7ec79239ce64b38a1d55f66a95407c0 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:04.767133 23386 tablet_replica.cc:330] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4: stopping tablet replica
I20240502 01:59:04.767269 23386 raft_consensus.cc:2229] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:04.767475 23386 raft_consensus.cc:2258] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:04.768263 23386 ts_tablet_manager.cc:1875] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:04.770387 23386 ts_tablet_manager.cc:1888] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 01:59:04.770459 23386 log.cc:1196] T 029dba0050a64bd4adb35e9815450450 P a1c00c21761540dea7ddae8d0dd26df4: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/wals/029dba0050a64bd4adb35e9815450450
I20240502 01:59:04.770900 16765 catalog_manager.cc:4830] TS a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923): tablet 029dba0050a64bd4adb35e9815450450 (table rebalance_test_table_3 [id=0c4182cf7d98406d87a12a073ef6b915]) successfully deleted
I20240502 01:59:04.839026 23595 ts_tablet_manager.cc:902] T cc145366c6244010b42a07e961f9636f P 71c28e01ad304ab2a6adf2eb26ba7cc9: Initiating tablet copy from peer 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:59:04.839502 23595 tablet_copy_client.cc:308] T cc145366c6244010b42a07e961f9636f P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:45571
I20240502 01:59:04.839977 16943 tablet_copy_service.cc:140] P 191fe00ca08b44c9aef6646e86aecebc: Received BeginTabletCopySession request for tablet cc145366c6244010b42a07e961f9636f from peer 71c28e01ad304ab2a6adf2eb26ba7cc9 ({username='slave'} at 127.10.133.201:46641)
I20240502 01:59:04.840070 16943 tablet_copy_service.cc:161] P 191fe00ca08b44c9aef6646e86aecebc: Beginning new tablet copy session on tablet cc145366c6244010b42a07e961f9636f from peer 71c28e01ad304ab2a6adf2eb26ba7cc9 at {username='slave'} at 127.10.133.201:46641: session id = 71c28e01ad304ab2a6adf2eb26ba7cc9-cc145366c6244010b42a07e961f9636f
I20240502 01:59:04.840763 16943 tablet_copy_source_session.cc:205] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:04.841656 23595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc145366c6244010b42a07e961f9636f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:04.843961 23595 tablet_copy_client.cc:783] T cc145366c6244010b42a07e961f9636f P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:04.844117 23595 tablet_copy_client.cc:647] T cc145366c6244010b42a07e961f9636f P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:04.845443 23599 tablet_copy_client.cc:1002] T cc145366c6244010b42a07e961f9636f P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Injecting latency into file download: 1500
I20240502 01:59:04.851397 16923 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2162035e4ed4433fafcc49934be62a9c"
dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:39728
I20240502 01:59:04.851534 16923 raft_consensus.cc:595] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Received request to transfer leadership
I20240502 01:59:04.898837 23655 ts_tablet_manager.cc:902] T adf06dd039c4433890e31c1ad9b44e98 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Initiating tablet copy from peer 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:59:04.899447 23655 tablet_copy_client.cc:308] T adf06dd039c4433890e31c1ad9b44e98 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:45571
I20240502 01:59:04.900003 16943 tablet_copy_service.cc:140] P 191fe00ca08b44c9aef6646e86aecebc: Received BeginTabletCopySession request for tablet adf06dd039c4433890e31c1ad9b44e98 from peer 71c28e01ad304ab2a6adf2eb26ba7cc9 ({username='slave'} at 127.10.133.201:46641)
I20240502 01:59:04.900112 16943 tablet_copy_service.cc:161] P 191fe00ca08b44c9aef6646e86aecebc: Beginning new tablet copy session on tablet adf06dd039c4433890e31c1ad9b44e98 from peer 71c28e01ad304ab2a6adf2eb26ba7cc9 at {username='slave'} at 127.10.133.201:46641: session id = 71c28e01ad304ab2a6adf2eb26ba7cc9-adf06dd039c4433890e31c1ad9b44e98
I20240502 01:59:04.900840 16943 tablet_copy_source_session.cc:205] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:04.901667 23655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adf06dd039c4433890e31c1ad9b44e98. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:04.903026 16923 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2162035e4ed4433fafcc49934be62a9c"
dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:39808
I20240502 01:59:04.903136 16923 raft_consensus.cc:595] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Received request to transfer leadership
I20240502 01:59:04.903739 23655 tablet_copy_client.cc:783] T adf06dd039c4433890e31c1ad9b44e98 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:04.903906 23655 tablet_copy_client.cc:647] T adf06dd039c4433890e31c1ad9b44e98 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:04.905014 23659 tablet_copy_client.cc:1002] T adf06dd039c4433890e31c1ad9b44e98 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Injecting latency into file download: 1500
I20240502 01:59:04.947409 23213 raft_consensus.cc:979] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc: : Instructing follower 436e7859396c42a6b60714873cb60495 to start an election
I20240502 01:59:04.947527 23213 raft_consensus.cc:1067] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Signalling peer 436e7859396c42a6b60714873cb60495 to start an election
I20240502 01:59:04.948053 18652 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2162035e4ed4433fafcc49934be62a9c"
dest_uuid: "436e7859396c42a6b60714873cb60495"
from {username='slave'} at 127.10.133.193:53861
I20240502 01:59:04.948215 18652 raft_consensus.cc:482] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:59:04.948266 18652 raft_consensus.cc:3037] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:59:04.949194 18652 raft_consensus.cc:504] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:59:04.950315 18652 leader_election.cc:288] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [CANDIDATE]: Term 2 election: Requested vote from peers 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571), a1c00c21761540dea7ddae8d0dd26df4 (127.10.133.195:35923), b6aa9ef40e50468ca7a9742c21140d24 (127.10.133.200:46021)
I20240502 01:59:04.950755 17192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2162035e4ed4433fafcc49934be62a9c" candidate_uuid: "436e7859396c42a6b60714873cb60495" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "a1c00c21761540dea7ddae8d0dd26df4"
I20240502 01:59:04.950806 16923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2162035e4ed4433fafcc49934be62a9c" candidate_uuid: "436e7859396c42a6b60714873cb60495" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
I20240502 01:59:04.950897 17192 raft_consensus.cc:3037] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:59:04.950914 16923 raft_consensus.cc:3032] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:59:04.950956 16923 raft_consensus.cc:729] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Running, Role: LEADER
I20240502 01:59:04.951140 16923 consensus_queue.cc:260] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:59:04.951336 16923 raft_consensus.cc:3037] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:59:04.951957 17192 raft_consensus.cc:2454] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e7859396c42a6b60714873cb60495 in term 2.
I20240502 01:59:04.952435 16923 raft_consensus.cc:2454] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e7859396c42a6b60714873cb60495 in term 2.
I20240502 01:59:04.952737 18584 leader_election.cc:302] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 191fe00ca08b44c9aef6646e86aecebc, 436e7859396c42a6b60714873cb60495, a1c00c21761540dea7ddae8d0dd26df4; no voters:
I20240502 01:59:04.952934 22992 raft_consensus.cc:2781] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:59:04.953125 22992 raft_consensus.cc:686] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [term 2 LEADER]: Becoming Leader. State: Replica: 436e7859396c42a6b60714873cb60495, State: Running, Role: LEADER
I20240502 01:59:04.953408 22992 consensus_queue.cc:237] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:59:04.955714 19049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2162035e4ed4433fafcc49934be62a9c" candidate_uuid: "436e7859396c42a6b60714873cb60495" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "b6aa9ef40e50468ca7a9742c21140d24"
I20240502 01:59:04.955828 19049 raft_consensus.cc:3037] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:59:04.955968 16778 catalog_manager.cc:5484] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 reported cstate change: term changed from 1 to 2, leader changed from 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) to 436e7859396c42a6b60714873cb60495 (127.10.133.197). New cstate: current_term: 2 leader_uuid: "436e7859396c42a6b60714873cb60495" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:04.956569 19049 raft_consensus.cc:2454] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436e7859396c42a6b60714873cb60495 in term 2.
I20240502 01:59:04.969530 23678 ts_tablet_manager.cc:902] T 6fb89894cf594139aecab491957f96c9 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Initiating tablet copy from peer 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571)
I20240502 01:59:04.970036 23678 tablet_copy_client.cc:308] T 6fb89894cf594139aecab491957f96c9 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:45571
I20240502 01:59:04.970490 16943 tablet_copy_service.cc:140] P 191fe00ca08b44c9aef6646e86aecebc: Received BeginTabletCopySession request for tablet 6fb89894cf594139aecab491957f96c9 from peer 71c28e01ad304ab2a6adf2eb26ba7cc9 ({username='slave'} at 127.10.133.201:46641)
I20240502 01:59:04.970623 16943 tablet_copy_service.cc:161] P 191fe00ca08b44c9aef6646e86aecebc: Beginning new tablet copy session on tablet 6fb89894cf594139aecab491957f96c9 from peer 71c28e01ad304ab2a6adf2eb26ba7cc9 at {username='slave'} at 127.10.133.201:46641: session id = 71c28e01ad304ab2a6adf2eb26ba7cc9-6fb89894cf594139aecab491957f96c9
I20240502 01:59:04.971395 16943 tablet_copy_source_session.cc:205] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:04.972198 23678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fb89894cf594139aecab491957f96c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:04.973819 23678 tablet_copy_client.cc:783] T 6fb89894cf594139aecab491957f96c9 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:04.973976 23678 tablet_copy_client.cc:647] T 6fb89894cf594139aecab491957f96c9 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:04.975009 23682 tablet_copy_client.cc:1002] T 6fb89894cf594139aecab491957f96c9 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Injecting latency into file download: 1500
I20240502 01:59:05.072081 17325 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Refusing update from remote peer b7ec79239ce64b38a1d55f66a95407c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:05.072533 23236 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:05.100554 18919 raft_consensus.cc:1261] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0 [term 2 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:05.101044 23213 consensus_queue.cc:1035] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:05.107313 18652 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495 [term 2 FOLLOWER]: Refusing update from remote peer b7ec79239ce64b38a1d55f66a95407c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:05.107702 23236 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:05.110348 17059 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 2 FOLLOWER]: Refusing update from remote peer b7ec79239ce64b38a1d55f66a95407c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:05.111917 23236 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:05.117888 18919 consensus_queue.cc:237] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:59:05.119103 17325 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Refusing update from remote peer b7ec79239ce64b38a1d55f66a95407c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 01:59:05.119323 18652 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495 [term 2 FOLLOWER]: Refusing update from remote peer b7ec79239ce64b38a1d55f66a95407c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 01:59:05.119712 23686 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:05.119843 23236 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:05.121472 23686 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:05.121779 18652 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:05.123389 16766 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet d9de883c491f43378a26c5a370062555 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:05.124208 17325 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:05.124765 16778 catalog_manager.cc:5484] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495 reported cstate change: config changed from index 8 to 10, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New cstate: current_term: 2 leader_uuid: "b7ec79239ce64b38a1d55f66a95407c0" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:05.127939 17039 tablet_service.cc:1514] Processing DeleteTablet for tablet d9de883c491f43378a26c5a370062555 with delete_type TABLET_DATA_TOMBSTONED (TS 6431e35365644aac943c07c97e370fee not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:58394
I20240502 01:59:05.128171 23220 tablet_replica.cc:330] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee: stopping tablet replica
I20240502 01:59:05.128320 23220 raft_consensus.cc:2229] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:05.128413 23220 raft_consensus.cc:2258] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:05.129277 23220 ts_tablet_manager.cc:1875] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:05.131554 23220 ts_tablet_manager.cc:1888] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20240502 01:59:05.131628 23220 log.cc:1196] T d9de883c491f43378a26c5a370062555 P 6431e35365644aac943c07c97e370fee: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/d9de883c491f43378a26c5a370062555
I20240502 01:59:05.132160 16764 catalog_manager.cc:4830] TS 6431e35365644aac943c07c97e370fee (127.10.133.194:37811): tablet d9de883c491f43378a26c5a370062555 (table rebalance_test_table_9 [id=dbf980acd7c44315a784f2bc19c4a4a1]) successfully deleted
I20240502 01:59:05.144522 17059 raft_consensus.cc:1261] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 2 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:05.144943 23213 consensus_queue.cc:1035] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:05.148285 18784 raft_consensus.cc:1261] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b [term 2 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:05.149106 23152 consensus_queue.cc:1035] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:05.450963 17192 raft_consensus.cc:1261] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 2 FOLLOWER]: Refusing update from remote peer 436e7859396c42a6b60714873cb60495: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:05.451435 22992 consensus_queue.cc:1035] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:05.504909 16923 raft_consensus.cc:1261] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 2 FOLLOWER]: Refusing update from remote peer 436e7859396c42a6b60714873cb60495: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:05.505358 22992 consensus_queue.cc:1035] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:05.508245 19049 raft_consensus.cc:1261] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Refusing update from remote peer 436e7859396c42a6b60714873cb60495: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:05.508646 23798 consensus_queue.cc:1035] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:05.643927 16923 consensus_queue.cc:237] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } }
I20240502 01:59:05.645107 18785 raft_consensus.cc:1261] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b [term 2 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 01:59:05.645123 18919 raft_consensus.cc:1261] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0 [term 2 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 01:59:05.645546 23213 consensus_queue.cc:1035] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:05.645752 23214 consensus_queue.cc:1035] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:05.647437 23213 raft_consensus.cc:2932] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:59:05.648082 18919 raft_consensus.cc:2932] T 1a375533a25a4da5b0030b0e06488351 P b7ec79239ce64b38a1d55f66a95407c0 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:59:05.648154 18785 raft_consensus.cc:2932] T 1a375533a25a4da5b0030b0e06488351 P d7989bd96de94be4a94995fcfcd6b16b [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } }
I20240502 01:59:05.649456 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 1a375533a25a4da5b0030b0e06488351 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:05.651098 16778 catalog_manager.cc:5484] T 1a375533a25a4da5b0030b0e06488351 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 8 to 10, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New cstate: current_term: 2 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:05.654155 17039 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a375533a25a4da5b0030b0e06488351 with delete_type TABLET_DATA_TOMBSTONED (TS 6431e35365644aac943c07c97e370fee not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:58394
I20240502 01:59:05.654525 23822 tablet_replica.cc:330] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee: stopping tablet replica
I20240502 01:59:05.654671 23822 raft_consensus.cc:2229] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:05.654875 23822 raft_consensus.cc:2258] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:05.655573 23822 ts_tablet_manager.cc:1875] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:05.658807 23822 ts_tablet_manager.cc:1888] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20240502 01:59:05.658917 23822 log.cc:1196] T 1a375533a25a4da5b0030b0e06488351 P 6431e35365644aac943c07c97e370fee: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/1a375533a25a4da5b0030b0e06488351
I20240502 01:59:05.659502 16764 catalog_manager.cc:4830] TS 6431e35365644aac943c07c97e370fee (127.10.133.194:37811): tablet 1a375533a25a4da5b0030b0e06488351 (table rebalance_test_table_1 [id=e1f098a771d942879080a8a67a25fa1c]) successfully deleted
I20240502 01:59:05.969436 18652 consensus_queue.cc:237] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } }
I20240502 01:59:05.970670 17192 raft_consensus.cc:1261] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 2 FOLLOWER]: Refusing update from remote peer 436e7859396c42a6b60714873cb60495: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 01:59:05.970835 19049 raft_consensus.cc:1261] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Refusing update from remote peer 436e7859396c42a6b60714873cb60495: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 01:59:05.971091 23799 consensus_queue.cc:1035] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:05.971266 23798 consensus_queue.cc:1035] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:05.972987 23797 raft_consensus.cc:2932] T 2162035e4ed4433fafcc49934be62a9c P 436e7859396c42a6b60714873cb60495 [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:05.973424 17192 raft_consensus.cc:2932] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:05.974938 16766 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 2162035e4ed4433fafcc49934be62a9c with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:05.975471 19049 raft_consensus.cc:2932] T 2162035e4ed4433fafcc49934be62a9c P b6aa9ef40e50468ca7a9742c21140d24 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:05.975881 16773 catalog_manager.cc:5484] T 2162035e4ed4433fafcc49934be62a9c P a1c00c21761540dea7ddae8d0dd26df4 reported cstate change: config changed from index 8 to 10, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New cstate: current_term: 2 leader_uuid: "436e7859396c42a6b60714873cb60495" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a1c00c21761540dea7ddae8d0dd26df4" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 35923 } } peers { permanent_uuid: "b6aa9ef40e50468ca7a9742c21140d24" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 46021 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } }
I20240502 01:59:05.978400 16901 tablet_service.cc:1514] Processing DeleteTablet for tablet 2162035e4ed4433fafcc49934be62a9c with delete_type TABLET_DATA_TOMBSTONED (TS 191fe00ca08b44c9aef6646e86aecebc not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:40018
I20240502 01:59:05.978950 23891 tablet_replica.cc:330] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc: stopping tablet replica
I20240502 01:59:05.979094 23891 raft_consensus.cc:2229] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:05.979223 23891 raft_consensus.cc:2258] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:05.979773 23891 ts_tablet_manager.cc:1875] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:05.981631 23891 ts_tablet_manager.cc:1888] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20240502 01:59:05.981716 23891 log.cc:1196] T 2162035e4ed4433fafcc49934be62a9c P 191fe00ca08b44c9aef6646e86aecebc: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/2162035e4ed4433fafcc49934be62a9c
I20240502 01:59:05.982223 16764 catalog_manager.cc:4830] TS 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571): tablet 2162035e4ed4433fafcc49934be62a9c (table rebalance_test_table_2 [id=e2d3cd2117a14964a0bc535eca4d5850]) successfully deleted
I20240502 01:59:06.233233 23565 tablet_copy_client.cc:523] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:06.234858 23565 tablet_bootstrap.cc:492] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap starting.
I20240502 01:59:06.253614 23565 tablet_bootstrap.cc:492] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:06.253890 23565 tablet_bootstrap.cc:492] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap complete.
I20240502 01:59:06.254086 23565 ts_tablet_manager.cc:1367] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Time spent bootstrapping tablet: real 0.019s user 0.016s sys 0.003s
I20240502 01:59:06.254478 23565 raft_consensus.cc:348] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:06.254587 23565 raft_consensus.cc:729] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71c28e01ad304ab2a6adf2eb26ba7cc9, State: Initialized, Role: LEARNER
I20240502 01:59:06.254681 23565 consensus_queue.cc:260] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:06.254998 23565 ts_tablet_manager.cc:1398] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:06.255542 16943 tablet_copy_service.cc:342] P 191fe00ca08b44c9aef6646e86aecebc: Request end of tablet copy session 71c28e01ad304ab2a6adf2eb26ba7cc9-2aeb35a29ea645288fe123b890452936 received from {username='slave'} at 127.10.133.201:46641
I20240502 01:59:06.255643 16943 tablet_copy_service.cc:433] P 191fe00ca08b44c9aef6646e86aecebc: ending tablet copy session 71c28e01ad304ab2a6adf2eb26ba7cc9-2aeb35a29ea645288fe123b890452936 on tablet 2aeb35a29ea645288fe123b890452936 with peer 71c28e01ad304ab2a6adf2eb26ba7cc9
I20240502 01:59:06.345726 23595 tablet_copy_client.cc:523] T cc145366c6244010b42a07e961f9636f P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:06.347213 23595 tablet_bootstrap.cc:492] T cc145366c6244010b42a07e961f9636f P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap starting.
I20240502 01:59:06.365516 23595 tablet_bootstrap.cc:492] T cc145366c6244010b42a07e961f9636f P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:06.365841 23595 tablet_bootstrap.cc:492] T cc145366c6244010b42a07e961f9636f P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap complete.
I20240502 01:59:06.366122 23595 ts_tablet_manager.cc:1367] T cc145366c6244010b42a07e961f9636f P 71c28e01ad304ab2a6adf2eb26ba7cc9: Time spent bootstrapping tablet: real 0.019s user 0.015s sys 0.005s
I20240502 01:59:06.366478 23595 raft_consensus.cc:348] T cc145366c6244010b42a07e961f9636f P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:06.366580 23595 raft_consensus.cc:729] T cc145366c6244010b42a07e961f9636f P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71c28e01ad304ab2a6adf2eb26ba7cc9, State: Initialized, Role: LEARNER
I20240502 01:59:06.366654 23595 consensus_queue.cc:260] T cc145366c6244010b42a07e961f9636f P 71c28e01ad304ab2a6adf2eb26ba7cc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:06.366894 23595 ts_tablet_manager.cc:1398] T cc145366c6244010b42a07e961f9636f P 71c28e01ad304ab2a6adf2eb26ba7cc9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:06.367449 16943 tablet_copy_service.cc:342] P 191fe00ca08b44c9aef6646e86aecebc: Request end of tablet copy session 71c28e01ad304ab2a6adf2eb26ba7cc9-cc145366c6244010b42a07e961f9636f received from {username='slave'} at 127.10.133.201:46641
I20240502 01:59:06.367543 16943 tablet_copy_service.cc:433] P 191fe00ca08b44c9aef6646e86aecebc: ending tablet copy session 71c28e01ad304ab2a6adf2eb26ba7cc9-cc145366c6244010b42a07e961f9636f on tablet cc145366c6244010b42a07e961f9636f with peer 71c28e01ad304ab2a6adf2eb26ba7cc9
I20240502 01:59:06.405294 23655 tablet_copy_client.cc:523] T adf06dd039c4433890e31c1ad9b44e98 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:06.406901 23655 tablet_bootstrap.cc:492] T adf06dd039c4433890e31c1ad9b44e98 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap starting.
I20240502 01:59:06.424257 23655 tablet_bootstrap.cc:492] T adf06dd039c4433890e31c1ad9b44e98 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:06.424522 23655 tablet_bootstrap.cc:492] T adf06dd039c4433890e31c1ad9b44e98 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap complete.
I20240502 01:59:06.424693 23655 ts_tablet_manager.cc:1367] T adf06dd039c4433890e31c1ad9b44e98 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Time spent bootstrapping tablet: real 0.018s user 0.014s sys 0.002s
I20240502 01:59:06.425074 23655 raft_consensus.cc:348] T adf06dd039c4433890e31c1ad9b44e98 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:06.425235 23655 raft_consensus.cc:729] T adf06dd039c4433890e31c1ad9b44e98 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71c28e01ad304ab2a6adf2eb26ba7cc9, State: Initialized, Role: LEARNER
I20240502 01:59:06.425383 23655 consensus_queue.cc:260] T adf06dd039c4433890e31c1ad9b44e98 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:06.425710 23655 ts_tablet_manager.cc:1398] T adf06dd039c4433890e31c1ad9b44e98 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:06.426311 16943 tablet_copy_service.cc:342] P 191fe00ca08b44c9aef6646e86aecebc: Request end of tablet copy session 71c28e01ad304ab2a6adf2eb26ba7cc9-adf06dd039c4433890e31c1ad9b44e98 received from {username='slave'} at 127.10.133.201:46641
I20240502 01:59:06.426410 16943 tablet_copy_service.cc:433] P 191fe00ca08b44c9aef6646e86aecebc: ending tablet copy session 71c28e01ad304ab2a6adf2eb26ba7cc9-adf06dd039c4433890e31c1ad9b44e98 on tablet adf06dd039c4433890e31c1ad9b44e98 with peer 71c28e01ad304ab2a6adf2eb26ba7cc9
I20240502 01:59:06.475307 23678 tablet_copy_client.cc:523] T 6fb89894cf594139aecab491957f96c9 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:06.476624 23678 tablet_bootstrap.cc:492] T 6fb89894cf594139aecab491957f96c9 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap starting.
I20240502 01:59:06.498728 23678 tablet_bootstrap.cc:492] T 6fb89894cf594139aecab491957f96c9 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:06.499011 23678 tablet_bootstrap.cc:492] T 6fb89894cf594139aecab491957f96c9 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap complete.
I20240502 01:59:06.499171 23678 ts_tablet_manager.cc:1367] T 6fb89894cf594139aecab491957f96c9 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Time spent bootstrapping tablet: real 0.023s user 0.021s sys 0.002s
I20240502 01:59:06.499564 23678 raft_consensus.cc:348] T 6fb89894cf594139aecab491957f96c9 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:06.499673 23678 raft_consensus.cc:729] T 6fb89894cf594139aecab491957f96c9 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71c28e01ad304ab2a6adf2eb26ba7cc9, State: Initialized, Role: LEARNER
I20240502 01:59:06.499775 23678 consensus_queue.cc:260] T 6fb89894cf594139aecab491957f96c9 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:06.500026 23678 ts_tablet_manager.cc:1398] T 6fb89894cf594139aecab491957f96c9 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:06.500593 16943 tablet_copy_service.cc:342] P 191fe00ca08b44c9aef6646e86aecebc: Request end of tablet copy session 71c28e01ad304ab2a6adf2eb26ba7cc9-6fb89894cf594139aecab491957f96c9 received from {username='slave'} at 127.10.133.201:46641
I20240502 01:59:06.500684 16943 tablet_copy_service.cc:433] P 191fe00ca08b44c9aef6646e86aecebc: ending tablet copy session 71c28e01ad304ab2a6adf2eb26ba7cc9-6fb89894cf594139aecab491957f96c9 on tablet 6fb89894cf594139aecab491957f96c9 with peer 71c28e01ad304ab2a6adf2eb26ba7cc9
I20240502 01:59:06.504577 19971 raft_consensus.cc:1203] T adf06dd039c4433890e31c1ad9b44e98 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 01:59:06.533116 19971 raft_consensus.cc:1203] T 6fb89894cf594139aecab491957f96c9 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 01:59:06.752583 19971 raft_consensus.cc:1203] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 01:59:06.832579 19971 raft_consensus.cc:1203] T cc145366c6244010b42a07e961f9636f P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20240502 01:59:06.958884 23995 raft_consensus.cc:1050] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc: attempting to promote NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 to VOTER
I20240502 01:59:06.959270 23995 consensus_queue.cc:237] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:06.960569 19971 raft_consensus.cc:1261] T adf06dd039c4433890e31c1ad9b44e98 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:06.960692 18785 raft_consensus.cc:1261] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:06.960704 17059 raft_consensus.cc:1261] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:06.961139 23995 consensus_queue.cc:1035] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:06.961324 24008 consensus_queue.cc:1035] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:06.961509 24010 consensus_queue.cc:1035] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:06.963371 24010 raft_consensus.cc:2932] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:06.963793 19971 raft_consensus.cc:2932] T adf06dd039c4433890e31c1ad9b44e98 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:06.964452 17059 raft_consensus.cc:2932] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:06.965485 18785 raft_consensus.cc:2932] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:06.968149 16773 catalog_manager.cc:5484] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee reported cstate change: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:06.971846 16923 consensus_queue.cc:237] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:06.972868 19971 raft_consensus.cc:1261] T adf06dd039c4433890e31c1ad9b44e98 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:06.973167 18785 raft_consensus.cc:1261] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:06.973207 24008 consensus_queue.cc:1035] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:06.973517 23214 consensus_queue.cc:1035] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:06.974916 24008 raft_consensus.cc:2932] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:06.975306 19971 raft_consensus.cc:2932] T adf06dd039c4433890e31c1ad9b44e98 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:06.975513 18785 raft_consensus.cc:2932] T adf06dd039c4433890e31c1ad9b44e98 P d7989bd96de94be4a94995fcfcd6b16b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:06.977525 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet adf06dd039c4433890e31c1ad9b44e98 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:06.977746 16772 catalog_manager.cc:5484] T adf06dd039c4433890e31c1ad9b44e98 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 8 to 9, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7989bd96de94be4a94995fcfcd6b16b" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 45549 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:06.980257 17039 tablet_service.cc:1514] Processing DeleteTablet for tablet adf06dd039c4433890e31c1ad9b44e98 with delete_type TABLET_DATA_TOMBSTONED (TS 6431e35365644aac943c07c97e370fee not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:58394
I20240502 01:59:06.980691 24018 tablet_replica.cc:330] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee: stopping tablet replica
I20240502 01:59:06.980945 24018 raft_consensus.cc:2229] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:06.981264 24018 raft_consensus.cc:2258] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:06.983381 24018 ts_tablet_manager.cc:1875] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:06.985282 24018 ts_tablet_manager.cc:1888] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 01:59:06.985355 24018 log.cc:1196] T adf06dd039c4433890e31c1ad9b44e98 P 6431e35365644aac943c07c97e370fee: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/adf06dd039c4433890e31c1ad9b44e98
I20240502 01:59:06.985879 16764 catalog_manager.cc:4830] TS 6431e35365644aac943c07c97e370fee (127.10.133.194:37811): tablet adf06dd039c4433890e31c1ad9b44e98 (table rebalance_test_table_6 [id=3b1319b666dc429cb0d33c9c55b7266e]) successfully deleted
I20240502 01:59:07.048151 23995 raft_consensus.cc:1050] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc: attempting to promote NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 to VOTER
I20240502 01:59:07.048552 23995 consensus_queue.cc:237] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:07.049893 19971 raft_consensus.cc:1261] T 6fb89894cf594139aecab491957f96c9 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:07.050419 18652 raft_consensus.cc:1261] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:07.050478 17059 raft_consensus.cc:1261] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:07.050690 23995 consensus_queue.cc:1035] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:07.050918 24008 consensus_queue.cc:1035] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:07.051280 24008 consensus_queue.cc:1035] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:07.053483 24008 raft_consensus.cc:2932] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:07.053926 18652 raft_consensus.cc:2932] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:07.056201 17059 raft_consensus.cc:2932] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:07.056310 19971 raft_consensus.cc:2932] T 6fb89894cf594139aecab491957f96c9 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:07.057080 16776 catalog_manager.cc:5484] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495 reported cstate change: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } attrs { replace: true } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:07.062729 16923 consensus_queue.cc:237] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:07.063745 19971 raft_consensus.cc:1261] T 6fb89894cf594139aecab491957f96c9 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:07.063786 18652 raft_consensus.cc:1261] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:07.064132 24010 consensus_queue.cc:1035] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:07.064321 24008 consensus_queue.cc:1035] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:07.065923 23214 raft_consensus.cc:2932] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:07.066301 19971 raft_consensus.cc:2932] T 6fb89894cf594139aecab491957f96c9 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:07.067636 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 6fb89894cf594139aecab491957f96c9 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:07.067925 18652 raft_consensus.cc:2932] T 6fb89894cf594139aecab491957f96c9 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:07.068436 16774 catalog_manager.cc:5484] T 6fb89894cf594139aecab491957f96c9 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 8 to 9, VOTER 6431e35365644aac943c07c97e370fee (127.10.133.194) evicted. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:07.071592 17039 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fb89894cf594139aecab491957f96c9 with delete_type TABLET_DATA_TOMBSTONED (TS 6431e35365644aac943c07c97e370fee not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:58394
I20240502 01:59:07.071995 24018 tablet_replica.cc:330] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee: stopping tablet replica
I20240502 01:59:07.072149 24018 raft_consensus.cc:2229] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:07.072360 24018 raft_consensus.cc:2258] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:07.073220 24018 ts_tablet_manager.cc:1875] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:07.075624 24018 ts_tablet_manager.cc:1888] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 01:59:07.075713 24018 log.cc:1196] T 6fb89894cf594139aecab491957f96c9 P 6431e35365644aac943c07c97e370fee: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/6fb89894cf594139aecab491957f96c9
I20240502 01:59:07.076191 16764 catalog_manager.cc:4830] TS 6431e35365644aac943c07c97e370fee (127.10.133.194:37811): tablet 6fb89894cf594139aecab491957f96c9 (table rebalance_test_table_0 [id=61315444265f4e1e9a2b3fed3a82c4a5]) successfully deleted
I20240502 01:59:07.314790 23995 raft_consensus.cc:1050] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc: attempting to promote NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 to VOTER
I20240502 01:59:07.315230 23995 consensus_queue.cc:237] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:07.316675 18652 raft_consensus.cc:1261] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:07.316691 17059 raft_consensus.cc:1261] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:07.316741 19971 raft_consensus.cc:1261] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:07.317045 24010 consensus_queue.cc:1035] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:07.317227 23214 consensus_queue.cc:1035] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:07.317396 24008 consensus_queue.cc:1035] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:07.319430 24008 raft_consensus.cc:2932] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:07.319964 19971 raft_consensus.cc:2932] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:07.320125 17059 raft_consensus.cc:2932] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:07.321513 18652 raft_consensus.cc:2932] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:07.322584 16773 catalog_manager.cc:5484] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:07.398048 24008 raft_consensus.cc:1050] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc: attempting to promote NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 to VOTER
I20240502 01:59:07.398558 24008 consensus_queue.cc:237] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:07.400367 18652 raft_consensus.cc:1261] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:07.400424 19971 raft_consensus.cc:1261] T cc145366c6244010b42a07e961f9636f P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 LEARNER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:07.400611 17325 raft_consensus.cc:1261] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:07.400985 23995 consensus_queue.cc:1035] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:07.401351 24010 consensus_queue.cc:1035] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:07.401556 23214 consensus_queue.cc:1035] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:07.403509 23214 raft_consensus.cc:2932] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:07.403983 18652 raft_consensus.cc:2932] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:07.404460 19971 raft_consensus.cc:2932] T cc145366c6244010b42a07e961f9636f P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:07.405620 17325 raft_consensus.cc:2932] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:07.406785 16776 catalog_manager.cc:5484] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 7 to 8, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:07.409936 16923 consensus_queue.cc:237] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:07.411015 19971 raft_consensus.cc:1261] T cc145366c6244010b42a07e961f9636f P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:07.411027 18652 raft_consensus.cc:1261] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Refusing update from remote peer 191fe00ca08b44c9aef6646e86aecebc: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:07.411414 24008 consensus_queue.cc:1035] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:07.411576 23214 consensus_queue.cc:1035] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:07.413014 24010 raft_consensus.cc:2932] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:07.413379 18652 raft_consensus.cc:2932] T cc145366c6244010b42a07e961f9636f P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:07.413527 19971 raft_consensus.cc:2932] T cc145366c6244010b42a07e961f9636f P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:07.414590 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet cc145366c6244010b42a07e961f9636f with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:07.415733 16773 catalog_manager.cc:5484] T cc145366c6244010b42a07e961f9636f P 191fe00ca08b44c9aef6646e86aecebc reported cstate change: config changed from index 8 to 9, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "191fe00ca08b44c9aef6646e86aecebc" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:07.417961 17304 tablet_service.cc:1514] Processing DeleteTablet for tablet cc145366c6244010b42a07e961f9636f with delete_type TABLET_DATA_TOMBSTONED (TS ec11d4bb3a064a94a80084142637b441 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:58608
I20240502 01:59:07.418382 24087 tablet_replica.cc:330] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441: stopping tablet replica
I20240502 01:59:07.418537 24087 raft_consensus.cc:2229] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:07.418815 24087 raft_consensus.cc:2258] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:07.419462 24087 ts_tablet_manager.cc:1875] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:07.421111 24087 ts_tablet_manager.cc:1888] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.8
I20240502 01:59:07.421180 24087 log.cc:1196] T cc145366c6244010b42a07e961f9636f P ec11d4bb3a064a94a80084142637b441: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/cc145366c6244010b42a07e961f9636f
I20240502 01:59:07.421645 16764 catalog_manager.cc:4830] TS ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135): tablet cc145366c6244010b42a07e961f9636f (table rebalance_test_table_7 [id=a8b80745166a46a9a386a8805718513d]) successfully deleted
I20240502 01:59:07.528846 16923 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2aeb35a29ea645288fe123b890452936"
dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:40390
I20240502 01:59:07.528995 16923 raft_consensus.cc:595] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Received request to transfer leadership
I20240502 01:59:07.538605 16923 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2aeb35a29ea645288fe123b890452936"
dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:40406
I20240502 01:59:07.538723 16923 raft_consensus.cc:595] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Received request to transfer leadership
I20240502 01:59:07.741716 23214 raft_consensus.cc:979] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc: : Instructing follower 6431e35365644aac943c07c97e370fee to start an election
I20240502 01:59:07.741842 23214 raft_consensus.cc:1067] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Signalling peer 6431e35365644aac943c07c97e370fee to start an election
I20240502 01:59:07.742311 17059 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2aeb35a29ea645288fe123b890452936"
dest_uuid: "6431e35365644aac943c07c97e370fee"
from {username='slave'} at 127.10.133.193:55465
I20240502 01:59:07.742467 17059 raft_consensus.cc:482] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:59:07.742533 17059 raft_consensus.cc:3037] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:59:07.743520 17059 raft_consensus.cc:504] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:07.744084 17059 leader_election.cc:288] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 2 election: Requested vote from peers 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571), 436e7859396c42a6b60714873cb60495 (127.10.133.197:45213), 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201:36215)
I20240502 01:59:07.744428 18652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2aeb35a29ea645288fe123b890452936" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "436e7859396c42a6b60714873cb60495"
I20240502 01:59:07.744566 18652 raft_consensus.cc:3037] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:59:07.744622 19971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2aeb35a29ea645288fe123b890452936" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9"
I20240502 01:59:07.744820 19971 raft_consensus.cc:3037] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:59:07.744855 16923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2aeb35a29ea645288fe123b890452936" candidate_uuid: "6431e35365644aac943c07c97e370fee" candidate_term: 2 candidate_status { last_received { term: 1 index: 8 } } ignore_live_leader: true dest_uuid: "191fe00ca08b44c9aef6646e86aecebc"
I20240502 01:59:07.744985 16923 raft_consensus.cc:3032] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:59:07.745036 16923 raft_consensus.cc:729] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 191fe00ca08b44c9aef6646e86aecebc, State: Running, Role: LEADER
I20240502 01:59:07.745221 16923 consensus_queue.cc:260] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:07.745414 16923 raft_consensus.cc:3037] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:59:07.745680 18652 raft_consensus.cc:2454] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 2.
I20240502 01:59:07.745968 19971 raft_consensus.cc:2454] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 2.
I20240502 01:59:07.746168 16923 raft_consensus.cc:2454] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6431e35365644aac943c07c97e370fee in term 2.
I20240502 01:59:07.746392 16992 leader_election.cc:302] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 436e7859396c42a6b60714873cb60495, 6431e35365644aac943c07c97e370fee, 71c28e01ad304ab2a6adf2eb26ba7cc9; no voters:
I20240502 01:59:07.746649 23683 raft_consensus.cc:2781] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:59:07.746729 23683 raft_consensus.cc:686] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 2 LEADER]: Becoming Leader. State: Replica: 6431e35365644aac943c07c97e370fee, State: Running, Role: LEADER
I20240502 01:59:07.746863 23683 consensus_queue.cc:237] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:07.749043 16778 catalog_manager.cc:5484] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee reported cstate change: term changed from 1 to 2, leader changed from 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) to 6431e35365644aac943c07c97e370fee (127.10.133.194). New cstate: current_term: 2 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:08.180070 16923 raft_consensus.cc:1261] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 2 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:08.180480 24119 consensus_queue.cc:1035] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "191fe00ca08b44c9aef6646e86aecebc" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 45571 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:08.210160 18652 raft_consensus.cc:1261] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495 [term 2 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:08.210561 24119 consensus_queue.cc:1035] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:08.213629 19971 raft_consensus.cc:1261] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 2 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
I20240502 01:59:08.214531 24119 consensus_queue.cc:1035] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:08.638823 17059 consensus_queue.cc:237] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 2.9, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:08.640077 18652 raft_consensus.cc:1261] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495 [term 2 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 01:59:08.640416 19971 raft_consensus.cc:1261] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 2 FOLLOWER]: Refusing update from remote peer 6431e35365644aac943c07c97e370fee: Log matching property violated. Preceding OpId in replica: term: 2 index: 9. Preceding OpId from leader: term: 2 index: 10. (index mismatch)
I20240502 01:59:08.640486 24132 consensus_queue.cc:1035] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:08.640813 24119 consensus_queue.cc:1035] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:08.642151 24132 raft_consensus.cc:2932] T 2aeb35a29ea645288fe123b890452936 P 6431e35365644aac943c07c97e370fee [term 2 LEADER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:08.642671 18652 raft_consensus.cc:2932] T 2aeb35a29ea645288fe123b890452936 P 436e7859396c42a6b60714873cb60495 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:08.642778 19971 raft_consensus.cc:2932] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 2 FOLLOWER]: Committing config change with OpId 2.10: config changed from index 8 to 10, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:08.645529 16773 catalog_manager.cc:5484] T 2aeb35a29ea645288fe123b890452936 P 71c28e01ad304ab2a6adf2eb26ba7cc9 reported cstate change: config changed from index 8 to 10, VOTER 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193) evicted. New cstate: current_term: 2 leader_uuid: "6431e35365644aac943c07c97e370fee" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6431e35365644aac943c07c97e370fee" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37811 } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:08.645783 16764 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 2aeb35a29ea645288fe123b890452936 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:08.648428 16901 tablet_service.cc:1514] Processing DeleteTablet for tablet 2aeb35a29ea645288fe123b890452936 with delete_type TABLET_DATA_TOMBSTONED (TS 191fe00ca08b44c9aef6646e86aecebc not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:40018
I20240502 01:59:08.648774 24152 tablet_replica.cc:330] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc: stopping tablet replica
I20240502 01:59:08.648960 24152 raft_consensus.cc:2229] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:08.649087 24152 raft_consensus.cc:2258] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:08.649721 24152 ts_tablet_manager.cc:1875] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:08.651798 24152 ts_tablet_manager.cc:1888] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.9
I20240502 01:59:08.651868 24152 log.cc:1196] T 2aeb35a29ea645288fe123b890452936 P 191fe00ca08b44c9aef6646e86aecebc: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/2aeb35a29ea645288fe123b890452936
I20240502 01:59:08.652387 16764 catalog_manager.cc:4830] TS 191fe00ca08b44c9aef6646e86aecebc (127.10.133.193:45571): tablet 2aeb35a29ea645288fe123b890452936 (table rebalance_test_table_8 [id=cd393e2f31fe436b87329907984e9dcd]) successfully deleted
I20240502 01:59:08.848071 18632 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:08.849288 17039 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 01:59:08.850605 19951 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:08.856182 16901 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 01:59:08.859449 18898 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:08.868618 17171 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:08.874341 19030 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:08.885188 18765 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:08.892673 17304 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:08.933387 18919 consensus_queue.cc:237] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 2.10, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:08.935189 17325 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Refusing update from remote peer b7ec79239ce64b38a1d55f66a95407c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 10. Preceding OpId from leader: term: 2 index: 11. (index mismatch)
I20240502 01:59:08.935322 18652 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495 [term 2 FOLLOWER]: Refusing update from remote peer b7ec79239ce64b38a1d55f66a95407c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 10. Preceding OpId from leader: term: 2 index: 11. (index mismatch)
I20240502 01:59:08.935704 23236 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:08.936856 24212 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:08.937662 23236 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [term 2 LEADER]: Committing config change with OpId 2.11: config changed from index 10 to 11, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:08.938421 17325 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Committing config change with OpId 2.11: config changed from index 10 to 11, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
W20240502 01:59:08.939033 18853 consensus_peers.cc:485] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 -> Peer 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201:36215): Couldn't send request to peer 71c28e01ad304ab2a6adf2eb26ba7cc9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d9de883c491f43378a26c5a370062555. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:08.941417 16774 catalog_manager.cc:5484] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 reported cstate change: config changed from index 10 to 11, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New cstate: current_term: 2 leader_uuid: "b7ec79239ce64b38a1d55f66a95407c0" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:08.943571 18652 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495 [term 2 FOLLOWER]: Committing config change with OpId 2.11: config changed from index 10 to 11, NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } } }
I20240502 01:59:09.419883 24235 ts_tablet_manager.cc:902] T d9de883c491f43378a26c5a370062555 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Initiating tablet copy from peer b7ec79239ce64b38a1d55f66a95407c0 (127.10.133.199:34045)
I20240502 01:59:09.420387 24235 tablet_copy_client.cc:308] T d9de883c491f43378a26c5a370062555 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.199:34045
I20240502 01:59:09.423905 18939 tablet_copy_service.cc:140] P b7ec79239ce64b38a1d55f66a95407c0: Received BeginTabletCopySession request for tablet d9de883c491f43378a26c5a370062555 from peer 71c28e01ad304ab2a6adf2eb26ba7cc9 ({username='slave'} at 127.10.133.201:43443)
I20240502 01:59:09.424021 18939 tablet_copy_service.cc:161] P b7ec79239ce64b38a1d55f66a95407c0: Beginning new tablet copy session on tablet d9de883c491f43378a26c5a370062555 from peer 71c28e01ad304ab2a6adf2eb26ba7cc9 at {username='slave'} at 127.10.133.201:43443: session id = 71c28e01ad304ab2a6adf2eb26ba7cc9-d9de883c491f43378a26c5a370062555
I20240502 01:59:09.425196 18939 tablet_copy_source_session.cc:205] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:09.426309 24235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9de883c491f43378a26c5a370062555. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:09.428978 24235 tablet_copy_client.cc:783] T d9de883c491f43378a26c5a370062555 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:09.429124 24235 tablet_copy_client.cc:647] T d9de883c491f43378a26c5a370062555 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:09.430409 24239 tablet_copy_client.cc:1002] T d9de883c491f43378a26c5a370062555 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Injecting latency into file download: 1500
I20240502 01:59:10.930709 24235 tablet_copy_client.cc:523] T d9de883c491f43378a26c5a370062555 P 71c28e01ad304ab2a6adf2eb26ba7cc9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:10.932368 24235 tablet_bootstrap.cc:492] T d9de883c491f43378a26c5a370062555 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap starting.
I20240502 01:59:10.952260 24235 tablet_bootstrap.cc:492] T d9de883c491f43378a26c5a370062555 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:10.952579 24235 tablet_bootstrap.cc:492] T d9de883c491f43378a26c5a370062555 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Bootstrap complete.
I20240502 01:59:10.952759 24235 ts_tablet_manager.cc:1367] T d9de883c491f43378a26c5a370062555 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Time spent bootstrapping tablet: real 0.020s user 0.019s sys 0.000s
I20240502 01:59:10.953155 24235 raft_consensus.cc:348] T d9de883c491f43378a26c5a370062555 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:10.953265 24235 raft_consensus.cc:729] T d9de883c491f43378a26c5a370062555 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 71c28e01ad304ab2a6adf2eb26ba7cc9, State: Initialized, Role: LEARNER
I20240502 01:59:10.953357 24235 consensus_queue.cc:260] T d9de883c491f43378a26c5a370062555 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 2.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: true } }
I20240502 01:59:10.953653 24235 ts_tablet_manager.cc:1398] T d9de883c491f43378a26c5a370062555 P 71c28e01ad304ab2a6adf2eb26ba7cc9: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 01:59:10.954277 18939 tablet_copy_service.cc:342] P b7ec79239ce64b38a1d55f66a95407c0: Request end of tablet copy session 71c28e01ad304ab2a6adf2eb26ba7cc9-d9de883c491f43378a26c5a370062555 received from {username='slave'} at 127.10.133.201:43443
I20240502 01:59:10.954373 18939 tablet_copy_service.cc:433] P b7ec79239ce64b38a1d55f66a95407c0: ending tablet copy session 71c28e01ad304ab2a6adf2eb26ba7cc9-d9de883c491f43378a26c5a370062555 on tablet d9de883c491f43378a26c5a370062555 with peer 71c28e01ad304ab2a6adf2eb26ba7cc9
I20240502 01:59:11.371873 19971 raft_consensus.cc:1203] T d9de883c491f43378a26c5a370062555 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.10->[2.11-2.11] Dedup: 2.11->[]
I20240502 01:59:11.864367 24313 raft_consensus.cc:1050] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0: attempting to promote NON_VOTER 71c28e01ad304ab2a6adf2eb26ba7cc9 to VOTER
I20240502 01:59:11.864888 24313 consensus_queue.cc:237] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 2.11, Last appended by leader: 8, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:11.866216 19971 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 2 LEARNER]: Refusing update from remote peer b7ec79239ce64b38a1d55f66a95407c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20240502 01:59:11.866647 17325 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Refusing update from remote peer b7ec79239ce64b38a1d55f66a95407c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20240502 01:59:11.866655 18650 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495 [term 2 FOLLOWER]: Refusing update from remote peer b7ec79239ce64b38a1d55f66a95407c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
I20240502 01:59:11.866637 24313 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:11.866986 24313 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:11.867187 24272 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:11.868882 24312 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [term 2 LEADER]: Committing config change with OpId 2.12: config changed from index 11 to 12, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:11.869365 19971 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 2 FOLLOWER]: Committing config change with OpId 2.12: config changed from index 11 to 12, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:11.870889 17325 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Committing config change with OpId 2.12: config changed from index 11 to 12, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:11.871985 16778 catalog_manager.cc:5484] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 reported cstate change: config changed from index 11 to 12, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b7ec79239ce64b38a1d55f66a95407c0" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:11.872241 18650 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495 [term 2 FOLLOWER]: Committing config change with OpId 2.12: config changed from index 11 to 12, 71c28e01ad304ab2a6adf2eb26ba7cc9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ec11d4bb3a064a94a80084142637b441" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 38135 } attrs { replace: true } } peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:11.875634 18919 consensus_queue.cc:237] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 2.12, Last appended by leader: 8, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } }
I20240502 01:59:11.877135 19971 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 2 FOLLOWER]: Refusing update from remote peer b7ec79239ce64b38a1d55f66a95407c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 12. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
I20240502 01:59:11.877187 18650 raft_consensus.cc:1261] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495 [term 2 FOLLOWER]: Refusing update from remote peer b7ec79239ce64b38a1d55f66a95407c0: Log matching property violated. Preceding OpId in replica: term: 2 index: 12. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
I20240502 01:59:11.877511 24312 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:11.877655 24272 consensus_queue.cc:1035] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:11.879199 24312 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 [term 2 LEADER]: Committing config change with OpId 2.13: config changed from index 12 to 13, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:11.879647 18650 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P 436e7859396c42a6b60714873cb60495 [term 2 FOLLOWER]: Committing config change with OpId 2.13: config changed from index 12 to 13, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:11.881203 16766 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet d9de883c491f43378a26c5a370062555 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:11.881917 16778 catalog_manager.cc:5484] T d9de883c491f43378a26c5a370062555 P b7ec79239ce64b38a1d55f66a95407c0 reported cstate change: config changed from index 12 to 13, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New cstate: current_term: 2 leader_uuid: "b7ec79239ce64b38a1d55f66a95407c0" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:11.881906 19971 raft_consensus.cc:2932] T d9de883c491f43378a26c5a370062555 P 71c28e01ad304ab2a6adf2eb26ba7cc9 [term 2 FOLLOWER]: Committing config change with OpId 2.13: config changed from index 12 to 13, VOTER ec11d4bb3a064a94a80084142637b441 (127.10.133.196) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b7ec79239ce64b38a1d55f66a95407c0" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 34045 } attrs { promote: false } } peers { permanent_uuid: "436e7859396c42a6b60714873cb60495" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 45213 } attrs { promote: false } } peers { permanent_uuid: "71c28e01ad304ab2a6adf2eb26ba7cc9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 36215 } attrs { promote: false } } }
I20240502 01:59:11.884923 17304 tablet_service.cc:1514] Processing DeleteTablet for tablet d9de883c491f43378a26c5a370062555 with delete_type TABLET_DATA_TOMBSTONED (TS ec11d4bb3a064a94a80084142637b441 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:58608
I20240502 01:59:11.885257 24323 tablet_replica.cc:330] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441: stopping tablet replica
I20240502 01:59:11.885393 24323 raft_consensus.cc:2229] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:11.885597 24323 raft_consensus.cc:2258] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441 [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:11.886197 24323 ts_tablet_manager.cc:1875] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:11.887864 24323 ts_tablet_manager.cc:1888] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.12
I20240502 01:59:11.887943 24323 log.cc:1196] T d9de883c491f43378a26c5a370062555 P ec11d4bb3a064a94a80084142637b441: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/d9de883c491f43378a26c5a370062555
I20240502 01:59:11.888427 16764 catalog_manager.cc:4830] TS ec11d4bb3a064a94a80084142637b441 (127.10.133.196:38135): tablet d9de883c491f43378a26c5a370062555 (table rebalance_test_table_9 [id=dbf980acd7c44315a784f2bc19c4a4a1]) successfully deleted
I20240502 01:59:12.125474 16901 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 01:59:12.129791 18632 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:12.135248 19030 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:12.136494 17171 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:12.138391 17039 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 01:59:12.138682 19951 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:12.149535 17304 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:12.151021 18898 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:12.174492 18765 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:12.278381 17171 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:12.279911 18632 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:12.280187 17039 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 01:59:12.286183 16901 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 01:59:12.297398 19030 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:12.297683 18765 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:12.298493 19951 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:12.298923 17304 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:12.319085 18898 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:12.578050 16901 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 01:59:12.580718 17171 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:12.581156 19951 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:12.581909 18632 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:12.598021 17304 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:12.604619 19030 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:12.605501 17039 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 01:59:12.613934 18765 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:12.625695 18898 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:12.735067 16901 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 01:59:12.736654 19951 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:12.737687 17171 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:12.741007 17039 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 01:59:12.742142 18898 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:12.748917 18632 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:12.755337 18765 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:12.779116 19030 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:12.788717 17304 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:12.898187 18632 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:12.902444 17039 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 01:59:12.909706 19951 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:12.911077 18765 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:12.911108 16901 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 01:59:12.913941 19030 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:12.918454 17171 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:12.920867 18898 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:12.951149 17304 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:13.055418 16901 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 01:59:13.055497 18632 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:13.060809 19030 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:13.063287 17039 tablet_service.cc:1429] Tablet server has 8 leaders and 0 scanners
I20240502 01:59:13.070009 18765 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:13.078140 17304 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:13.079442 17171 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:13.082079 18898 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:13.090152 19951 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
c5fc5b5e661947f2a14f067ed4c09d1d | 127.10.133.254:37275 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
raft_prepare_replacement_before_eviction | true | experimental,advanced | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.133.212:45535 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
191fe00ca08b44c9aef6646e86aecebc | 127.10.133.193:45571 | HEALTHY | <none> | 8 | 0
436e7859396c42a6b60714873cb60495 | 127.10.133.197:45213 | HEALTHY | <none> | 1 | 0
6431e35365644aac943c07c97e370fee | 127.10.133.194:37811 | HEALTHY | <none> | 8 | 0
71c28e01ad304ab2a6adf2eb26ba7cc9 | 127.10.133.201:36215 | HEALTHY | <none> | 0 | 0
a1c00c21761540dea7ddae8d0dd26df4 | 127.10.133.195:35923 | HEALTHY | <none> | 6 | 0
b6aa9ef40e50468ca7a9742c21140d24 | 127.10.133.200:46021 | HEALTHY | <none> | 0 | 0
b7ec79239ce64b38a1d55f66a95407c0 | 127.10.133.199:34045 | HEALTHY | <none> | 1 | 0
d7989bd96de94be4a94995fcfcd6b16b | 127.10.133.198:45549 | HEALTHY | <none> | 0 | 0
ec11d4bb3a064a94a80084142637b441 | 127.10.133.196:38135 | HEALTHY | <none> | 6 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 9
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
---------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
ipki_server_key_size | 768 | experimental | all 9 server(s) checked
local_ip_for_outbound_sockets | 127.10.133.193 | experimental | 127.10.133.193:45571
local_ip_for_outbound_sockets | 127.10.133.194 | experimental | 127.10.133.194:37811
local_ip_for_outbound_sockets | 127.10.133.195 | experimental | 127.10.133.195:35923
local_ip_for_outbound_sockets | 127.10.133.196 | experimental | 127.10.133.196:38135
local_ip_for_outbound_sockets | 127.10.133.197 | experimental | 127.10.133.197:45213
local_ip_for_outbound_sockets | 127.10.133.198 | experimental | 127.10.133.198:45549
local_ip_for_outbound_sockets | 127.10.133.199 | experimental | 127.10.133.199:34045
local_ip_for_outbound_sockets | 127.10.133.200 | experimental | 127.10.133.200:46021
local_ip_for_outbound_sockets | 127.10.133.201 | experimental | 127.10.133.201:36215
never_fsync | true | unsafe,advanced | all 9 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 9 server(s) checked
raft_prepare_replacement_before_eviction | true | experimental,advanced | all 9 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 9 server(s) checked
server_dump_info_format | pb | hidden | all 9 server(s) checked
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.10.133.193:45571
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.10.133.194:37811
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.10.133.195:35923
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb | hidden | 127.10.133.196:38135
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/info.pb | hidden | 127.10.133.197:45213
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/info.pb | hidden | 127.10.133.198:45549
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/info.pb | hidden | 127.10.133.199:34045
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/info.pb | hidden | 127.10.133.200:46021
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.TserverAddedDuringRebalancingTest.TserverStarts_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data/info.pb | hidden | 127.10.133.201:36215
tablet_copy_download_file_inject_latency_ms | 1500 | hidden | all 9 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.133.212:45535 | all 9 server(s) checked
time_source | builtin | all 9 server(s) checked
Version Summary
Version | Servers
-----------------+--------------------------
1.18.0-SNAPSHOT | all 10 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
------------------------+----+---------+---------------+---------+------------+------------------+-------------
rebalance_test_table_0 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_1 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_2 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_3 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_4 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_5 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_6 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_7 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_8 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_9 | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 10
First Quartile | 10
Median | 10
Third Quartile | 10
Maximum | 10
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 9
Tables | 10
Tablets | 30
Replicas | 90
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20240502 01:59:13.129171 10775 log_verifier.cc:126] Checking tablet 029dba0050a64bd4adb35e9815450450
I20240502 01:59:13.157378 10775 log_verifier.cc:177] Verified matching terms for 9 ops in tablet 029dba0050a64bd4adb35e9815450450
I20240502 01:59:13.157450 10775 log_verifier.cc:126] Checking tablet 0429b2d6357546f48b422810148fdce1
I20240502 01:59:13.184383 10775 log_verifier.cc:177] Verified matching terms for 6 ops in tablet 0429b2d6357546f48b422810148fdce1
I20240502 01:59:13.184448 10775 log_verifier.cc:126] Checking tablet 086b486997ae4d15a4b070e79552807f
I20240502 01:59:13.212076 10775 log_verifier.cc:177] Verified matching terms for 10 ops in tablet 086b486997ae4d15a4b070e79552807f
I20240502 01:59:13.212157 10775 log_verifier.cc:126] Checking tablet 0a30ab572eff4a1ebabf95be48e178e2
I20240502 01:59:13.239065 10775 log_verifier.cc:177] Verified matching terms for 6 ops in tablet 0a30ab572eff4a1ebabf95be48e178e2
I20240502 01:59:13.239126 10775 log_verifier.cc:126] Checking tablet 1a375533a25a4da5b0030b0e06488351
I20240502 01:59:13.266638 10775 log_verifier.cc:177] Verified matching terms for 10 ops in tablet 1a375533a25a4da5b0030b0e06488351
I20240502 01:59:13.266714 10775 log_verifier.cc:126] Checking tablet 1a396235bc534141bcd180430c51e7e1
I20240502 01:59:13.296101 10775 log_verifier.cc:177] Verified matching terms for 9 ops in tablet 1a396235bc534141bcd180430c51e7e1
I20240502 01:59:13.296185 10775 log_verifier.cc:126] Checking tablet 20f803864ef14f12a5ba3bafa3a3b0c3
I20240502 01:59:13.324899 10775 log_verifier.cc:177] Verified matching terms for 6 ops in tablet 20f803864ef14f12a5ba3bafa3a3b0c3
I20240502 01:59:13.324975 10775 log_verifier.cc:126] Checking tablet 2162035e4ed4433fafcc49934be62a9c
I20240502 01:59:13.352504 10775 log_verifier.cc:177] Verified matching terms for 10 ops in tablet 2162035e4ed4433fafcc49934be62a9c
I20240502 01:59:13.352581 10775 log_verifier.cc:126] Checking tablet 2aeb35a29ea645288fe123b890452936
I20240502 01:59:13.379881 10775 log_verifier.cc:177] Verified matching terms for 10 ops in tablet 2aeb35a29ea645288fe123b890452936
I20240502 01:59:13.379947 10775 log_verifier.cc:126] Checking tablet 47f0db0b9b7744758b9ca7f1e797bdb0
I20240502 01:59:13.406618 10775 log_verifier.cc:177] Verified matching terms for 9 ops in tablet 47f0db0b9b7744758b9ca7f1e797bdb0
I20240502 01:59:13.406679 10775 log_verifier.cc:126] Checking tablet 4965b4399f744b67807d2d5361bc1bd5
I20240502 01:59:13.433284 10775 log_verifier.cc:177] Verified matching terms for 6 ops in tablet 4965b4399f744b67807d2d5361bc1bd5
I20240502 01:59:13.433346 10775 log_verifier.cc:126] Checking tablet 56450521850a4afbbee4587c351b9ca1
I20240502 01:59:13.459904 10775 log_verifier.cc:177] Verified matching terms for 6 ops in tablet 56450521850a4afbbee4587c351b9ca1
I20240502 01:59:13.459962 10775 log_verifier.cc:126] Checking tablet 58924c2a9bf5433b86985bbde9d9ec33
I20240502 01:59:13.486936 10775 log_verifier.cc:177] Verified matching terms for 6 ops in tablet 58924c2a9bf5433b86985bbde9d9ec33
I20240502 01:59:13.486994 10775 log_verifier.cc:126] Checking tablet 64b3111c603247ac8ff4a1eb9369086f
I20240502 01:59:13.513510 10775 log_verifier.cc:177] Verified matching terms for 9 ops in tablet 64b3111c603247ac8ff4a1eb9369086f
I20240502 01:59:13.513574 10775 log_verifier.cc:126] Checking tablet 6fb89894cf594139aecab491957f96c9
I20240502 01:59:13.540493 10775 log_verifier.cc:177] Verified matching terms for 9 ops in tablet 6fb89894cf594139aecab491957f96c9
I20240502 01:59:13.540561 10775 log_verifier.cc:126] Checking tablet 787b9b0227da4dd08df5aeb37f0d0468
I20240502 01:59:13.567582 10775 log_verifier.cc:177] Verified matching terms for 10 ops in tablet 787b9b0227da4dd08df5aeb37f0d0468
I20240502 01:59:13.567656 10775 log_verifier.cc:126] Checking tablet 7c92206bbd4340d59a7ee7379f581bb7
I20240502 01:59:13.594599 10775 log_verifier.cc:177] Verified matching terms for 9 ops in tablet 7c92206bbd4340d59a7ee7379f581bb7
I20240502 01:59:13.594671 10775 log_verifier.cc:126] Checking tablet 86c8e4b2177946de9d18d4ef657da4be
I20240502 01:59:13.621271 10775 log_verifier.cc:177] Verified matching terms for 6 ops in tablet 86c8e4b2177946de9d18d4ef657da4be
I20240502 01:59:13.621336 10775 log_verifier.cc:126] Checking tablet 8a386a1fd8ae4d70ae482b3ce958825b
I20240502 01:59:13.648829 10775 log_verifier.cc:177] Verified matching terms for 9 ops in tablet 8a386a1fd8ae4d70ae482b3ce958825b
I20240502 01:59:13.648893 10775 log_verifier.cc:126] Checking tablet a475490b83164ff3930aae5978e7845e
I20240502 01:59:13.676863 10775 log_verifier.cc:177] Verified matching terms for 9 ops in tablet a475490b83164ff3930aae5978e7845e
I20240502 01:59:13.676942 10775 log_verifier.cc:126] Checking tablet adf06dd039c4433890e31c1ad9b44e98
I20240502 01:59:13.703805 10775 log_verifier.cc:177] Verified matching terms for 9 ops in tablet adf06dd039c4433890e31c1ad9b44e98
I20240502 01:59:13.703874 10775 log_verifier.cc:126] Checking tablet c7f53fd60e7541f98c0e20f259a86b45
I20240502 01:59:13.729835 10775 log_verifier.cc:177] Verified matching terms for 6 ops in tablet c7f53fd60e7541f98c0e20f259a86b45
I20240502 01:59:13.729893 10775 log_verifier.cc:126] Checking tablet c9240a82777b44648966e18a616fdfa2
I20240502 01:59:13.756855 10775 log_verifier.cc:177] Verified matching terms for 6 ops in tablet c9240a82777b44648966e18a616fdfa2
I20240502 01:59:13.756917 10775 log_verifier.cc:126] Checking tablet cc145366c6244010b42a07e961f9636f
I20240502 01:59:13.783933 10775 log_verifier.cc:177] Verified matching terms for 9 ops in tablet cc145366c6244010b42a07e961f9636f
I20240502 01:59:13.784004 10775 log_verifier.cc:126] Checking tablet cd6925b06dd64a028757d8527f896d10
I20240502 01:59:13.811118 10775 log_verifier.cc:177] Verified matching terms for 6 ops in tablet cd6925b06dd64a028757d8527f896d10
I20240502 01:59:13.811182 10775 log_verifier.cc:126] Checking tablet d9de883c491f43378a26c5a370062555
I20240502 01:59:13.839107 10775 log_verifier.cc:177] Verified matching terms for 13 ops in tablet d9de883c491f43378a26c5a370062555
I20240502 01:59:13.839175 10775 log_verifier.cc:126] Checking tablet df21aa40548c4f49bae79294085c80f4
I20240502 01:59:13.865738 10775 log_verifier.cc:177] Verified matching terms for 9 ops in tablet df21aa40548c4f49bae79294085c80f4
I20240502 01:59:13.865803 10775 log_verifier.cc:126] Checking tablet e03fff9bc743475d92ae26b85e7f39ff
I20240502 01:59:13.898555 10775 log_verifier.cc:177] Verified matching terms for 10 ops in tablet e03fff9bc743475d92ae26b85e7f39ff
I20240502 01:59:13.898628 10775 log_verifier.cc:126] Checking tablet f7d9d4310df14878a5ae4167c5320e3a
I20240502 01:59:13.929435 10775 log_verifier.cc:177] Verified matching terms for 9 ops in tablet f7d9d4310df14878a5ae4167c5320e3a
I20240502 01:59:13.929499 10775 log_verifier.cc:126] Checking tablet fe3333c0dfe048fda6cfc8b12bf0d5a9
I20240502 01:59:13.961675 10775 log_verifier.cc:177] Verified matching terms for 6 ops in tablet fe3333c0dfe048fda6cfc8b12bf0d5a9
I20240502 01:59:13.962172 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 16841
I20240502 01:59:13.970928 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 16974
I20240502 01:59:13.978932 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 17110
I20240502 01:59:13.986447 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 17243
I20240502 01:59:13.994287 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 18569
I20240502 01:59:14.001119 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 18702
I20240502 01:59:14.007284 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 18835
I20240502 01:59:14.013590 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 18968
I20240502 01:59:14.019814 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 19802
I20240502 01:59:14.026162 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 16748
2024-05-02T01:59:14Z chronyd exiting
[ OK ] TserverAddedDuringRebalancingTest.TserverStarts/1 (34104 ms)
[----------] 1 test from TserverAddedDuringRebalancingTest (34105 ms total)
[----------] 1 test from RebalancerAndSingleReplicaTablets
[ RUN ] RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove/5
I20240502 01:59:14.137404 10775 test_util.cc:268] Using random seed: -214935242
I20240502 01:59:14.138193 10775 ts_itest-base.cc:112] Starting cluster with:
I20240502 01:59:14.138229 10775 ts_itest-base.cc:113] --------------
I20240502 01:59:14.138248 10775 ts_itest-base.cc:114] 4 tablet servers
I20240502 01:59:14.138265 10775 ts_itest-base.cc:115] 1 replicas per TS
I20240502 01:59:14.138293 10775 ts_itest-base.cc:116] --------------
2024-05-02T01:59:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T01:59:14Z Disabled control of system clock
I20240502 01:59:14.146776 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.133.254:41609
--webserver_interface=127.10.133.254
--webserver_port=0
--builtin_ntp_servers=127.10.133.212:40993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.133.254:41609
--raft_prepare_replacement_before_eviction=true
--tserver_unresponsive_timeout_ms=3000
--enable_range_replica_placement=false with env {}
W20240502 01:59:14.252665 24603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:14.252875 24603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:14.252933 24603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:14.255849 24603 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:14.255908 24603 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 01:59:14.255930 24603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:14.255952 24603 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 01:59:14.255975 24603 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 01:59:14.259503 24603 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:40993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
--enable_range_replica_placement=false
--ipki_ca_key_size=768
--master_addresses=127.10.133.254:41609
--tserver_unresponsive_timeout_ms=3000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.133.254:41609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.133.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.24603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:14.260342 24603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:14.261480 24603 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:14.269156 24611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:14.269685 24609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:14.270462 24603 server_base.cc:1034] running on GCE node
W20240502 01:59:14.271037 24608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:14.271795 24603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:14.272907 24603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:14.274048 24603 hybrid_clock.cc:648] HybridClock initialized: now 1714615154274029 us; error 35 us; skew 500 ppm
I20240502 01:59:14.276118 24603 webserver.cc:460] Webserver started at http://127.10.133.254:46457/ using document root <none> and password file <none>
I20240502 01:59:14.276661 24603 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:14.276715 24603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:14.276885 24603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:14.278532 24603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "33424a7cfde840eebfbcb0c7edb140f1"
format_stamp: "Formatted at 2024-05-02 01:59:14 on dist-test-slave-dr9f"
I20240502 01:59:14.278995 24603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "33424a7cfde840eebfbcb0c7edb140f1"
format_stamp: "Formatted at 2024-05-02 01:59:14 on dist-test-slave-dr9f"
I20240502 01:59:14.282289 24603 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 01:59:14.284415 24618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:14.285365 24603 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:14.285485 24603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
uuid: "33424a7cfde840eebfbcb0c7edb140f1"
format_stamp: "Formatted at 2024-05-02 01:59:14 on dist-test-slave-dr9f"
I20240502 01:59:14.285565 24603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:14.300268 24603 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:14.300848 24603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:14.301007 24603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:14.307252 24603 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.254:41609
I20240502 01:59:14.307310 24671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.254:41609 every 8 connection(s)
I20240502 01:59:14.308257 24603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20240502 01:59:14.310768 24672 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:14.311704 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 24603
I20240502 01:59:14.311849 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal/instance
I20240502 01:59:14.316238 24672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1: Bootstrap starting.
I20240502 01:59:14.318306 24672 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:14.319104 24672 log.cc:824] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:14.320731 24672 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1: No bootstrap required, opened a new log
I20240502 01:59:14.323065 24672 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33424a7cfde840eebfbcb0c7edb140f1" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 41609 } }
I20240502 01:59:14.323235 24672 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:14.323297 24672 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33424a7cfde840eebfbcb0c7edb140f1, State: Initialized, Role: FOLLOWER
I20240502 01:59:14.323693 24672 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33424a7cfde840eebfbcb0c7edb140f1" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 41609 } }
I20240502 01:59:14.323807 24672 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:59:14.323872 24672 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:59:14.323972 24672 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:14.324609 24672 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33424a7cfde840eebfbcb0c7edb140f1" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 41609 } }
I20240502 01:59:14.324895 24672 leader_election.cc:302] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33424a7cfde840eebfbcb0c7edb140f1; no voters:
I20240502 01:59:14.325156 24672 leader_election.cc:288] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:59:14.325487 24677 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:14.325673 24677 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1 [term 1 LEADER]: Becoming Leader. State: Replica: 33424a7cfde840eebfbcb0c7edb140f1, State: Running, Role: LEADER
I20240502 01:59:14.325961 24677 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33424a7cfde840eebfbcb0c7edb140f1" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 41609 } }
I20240502 01:59:14.326190 24672 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 01:59:14.327668 24678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33424a7cfde840eebfbcb0c7edb140f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33424a7cfde840eebfbcb0c7edb140f1" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 41609 } } }
I20240502 01:59:14.327862 24678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1 [sys.catalog]: This master's current role is: LEADER
I20240502 01:59:14.328090 24679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33424a7cfde840eebfbcb0c7edb140f1. Latest consensus state: current_term: 1 leader_uuid: "33424a7cfde840eebfbcb0c7edb140f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33424a7cfde840eebfbcb0c7edb140f1" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 41609 } } }
I20240502 01:59:14.328174 24679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1 [sys.catalog]: This master's current role is: LEADER
W20240502 01:59:14.330559 24692 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20240502 01:59:14.330628 24692 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20240502 01:59:14.330698 24689 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 01:59:14.331427 24689 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 01:59:14.335992 24689 catalog_manager.cc:1347] Generated new cluster ID: 97c9407b77ac4f90833700b641792852
I20240502 01:59:14.336061 24689 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 01:59:14.357120 24689 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 01:59:14.358407 24689 catalog_manager.cc:1504] Loading token signing keys...
I20240502 01:59:14.368186 24689 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 33424a7cfde840eebfbcb0c7edb140f1: Generated new TSK 0
I20240502 01:59:14.368976 24689 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 01:59:14.373422 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.193:0
--local_ip_for_outbound_sockets=127.10.133.193
--webserver_interface=127.10.133.193
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41609
--builtin_ntp_servers=127.10.133.212:40993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 01:59:14.477675 24696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:14.477885 24696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:14.477960 24696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:14.480937 24696 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:14.481004 24696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:14.481093 24696 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.193
I20240502 01:59:14.484509 24696 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:40993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.133.193
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41609
--never_fsync=true
--heap_profile_path=/tmp/kudu.24696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.193
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:14.485288 24696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:14.486454 24696 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:14.495533 24701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:14.495965 24702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:14.496519 24704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:14.497300 24696 server_base.cc:1034] running on GCE node
I20240502 01:59:14.497643 24696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:14.498239 24696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:14.499397 24696 hybrid_clock.cc:648] HybridClock initialized: now 1714615154499386 us; error 26 us; skew 500 ppm
I20240502 01:59:14.501103 24696 webserver.cc:460] Webserver started at http://127.10.133.193:46573/ using document root <none> and password file <none>
I20240502 01:59:14.501645 24696 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:14.501705 24696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:14.501870 24696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:14.503381 24696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "3c1733fc9bc942268fb9a95e5b8fa14e"
format_stamp: "Formatted at 2024-05-02 01:59:14 on dist-test-slave-dr9f"
I20240502 01:59:14.503831 24696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "3c1733fc9bc942268fb9a95e5b8fa14e"
format_stamp: "Formatted at 2024-05-02 01:59:14 on dist-test-slave-dr9f"
I20240502 01:59:14.506814 24696 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 01:59:14.509055 24710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:14.509974 24696 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:14.510108 24696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "3c1733fc9bc942268fb9a95e5b8fa14e"
format_stamp: "Formatted at 2024-05-02 01:59:14 on dist-test-slave-dr9f"
I20240502 01:59:14.510183 24696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:14.518824 24696 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:14.519338 24696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:14.519482 24696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:14.519958 24696 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:14.520809 24696 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:14.520860 24696 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:14.520917 24696 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:14.520948 24696 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:14.529031 24696 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.193:41063
I20240502 01:59:14.529053 24826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.193:41063 every 8 connection(s)
I20240502 01:59:14.529891 24696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20240502 01:59:14.530897 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 24696
I20240502 01:59:14.531041 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20240502 01:59:14.533248 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.194:0
--local_ip_for_outbound_sockets=127.10.133.194
--webserver_interface=127.10.133.194
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41609
--builtin_ntp_servers=127.10.133.212:40993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:59:14.539594 24827 heartbeater.cc:347] Connected to a master server at 127.10.133.254:41609
I20240502 01:59:14.539840 24827 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:14.540534 24827 heartbeater.cc:511] Master 127.10.133.254:41609 requested a full tablet report, sending...
I20240502 01:59:14.542021 24635 ts_manager.cc:194] Registered new tserver with Master: 3c1733fc9bc942268fb9a95e5b8fa14e (127.10.133.193:41063)
I20240502 01:59:14.543164 24635 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.193:46569
W20240502 01:59:14.638362 24830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:14.638566 24830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:14.638644 24830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:14.641537 24830 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:14.641603 24830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:14.641706 24830 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.194
I20240502 01:59:14.645097 24830 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:40993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.133.194
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41609
--never_fsync=true
--heap_profile_path=/tmp/kudu.24830
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.194
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:14.645941 24830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:14.646977 24830 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:14.655124 24835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:14.655707 24836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:14.656265 24838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:14.657069 24830 server_base.cc:1034] running on GCE node
I20240502 01:59:14.657433 24830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:14.658028 24830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:14.659181 24830 hybrid_clock.cc:648] HybridClock initialized: now 1714615154659168 us; error 30 us; skew 500 ppm
I20240502 01:59:14.660847 24830 webserver.cc:460] Webserver started at http://127.10.133.194:40029/ using document root <none> and password file <none>
I20240502 01:59:14.661360 24830 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:14.661422 24830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:14.661588 24830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:14.663193 24830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "987e3f475cb44c0ca483787ae7079d76"
format_stamp: "Formatted at 2024-05-02 01:59:14 on dist-test-slave-dr9f"
I20240502 01:59:14.663645 24830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "987e3f475cb44c0ca483787ae7079d76"
format_stamp: "Formatted at 2024-05-02 01:59:14 on dist-test-slave-dr9f"
I20240502 01:59:14.667085 24830 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 01:59:14.669108 24844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:14.670104 24830 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 01:59:14.670214 24830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "987e3f475cb44c0ca483787ae7079d76"
format_stamp: "Formatted at 2024-05-02 01:59:14 on dist-test-slave-dr9f"
I20240502 01:59:14.670292 24830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:14.692333 24830 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:14.692911 24830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:14.693078 24830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:14.693572 24830 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:14.694461 24830 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:14.694509 24830 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:14.694567 24830 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:14.694594 24830 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:14.703245 24830 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.194:42721
I20240502 01:59:14.703269 24958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.194:42721 every 8 connection(s)
I20240502 01:59:14.704125 24830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20240502 01:59:14.709009 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 24830
I20240502 01:59:14.709144 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20240502 01:59:14.711457 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.195:0
--local_ip_for_outbound_sockets=127.10.133.195
--webserver_interface=127.10.133.195
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41609
--builtin_ntp_servers=127.10.133.212:40993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:59:14.712492 24959 heartbeater.cc:347] Connected to a master server at 127.10.133.254:41609
I20240502 01:59:14.712744 24959 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:14.713416 24959 heartbeater.cc:511] Master 127.10.133.254:41609 requested a full tablet report, sending...
I20240502 01:59:14.714457 24635 ts_manager.cc:194] Registered new tserver with Master: 987e3f475cb44c0ca483787ae7079d76 (127.10.133.194:42721)
I20240502 01:59:14.714996 24635 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.194:42701
W20240502 01:59:14.815023 24962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:14.815219 24962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:14.815265 24962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:14.818279 24962 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:14.818334 24962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:14.818425 24962 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.195
I20240502 01:59:14.821887 24962 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:40993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.133.195
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41609
--never_fsync=true
--heap_profile_path=/tmp/kudu.24962
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.195
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:14.822724 24962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:14.823767 24962 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:14.832129 24968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:14.832618 24970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:14.833336 24967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:14.834018 24962 server_base.cc:1034] running on GCE node
I20240502 01:59:14.834333 24962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:14.834836 24962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:14.835979 24962 hybrid_clock.cc:648] HybridClock initialized: now 1714615154835972 us; error 25 us; skew 500 ppm
I20240502 01:59:14.837635 24962 webserver.cc:460] Webserver started at http://127.10.133.195:35197/ using document root <none> and password file <none>
I20240502 01:59:14.838245 24962 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:14.838307 24962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:14.838495 24962 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:14.840075 24962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "8519b82a88b84d4b8aac813615eb1716"
format_stamp: "Formatted at 2024-05-02 01:59:14 on dist-test-slave-dr9f"
I20240502 01:59:14.840533 24962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "8519b82a88b84d4b8aac813615eb1716"
format_stamp: "Formatted at 2024-05-02 01:59:14 on dist-test-slave-dr9f"
I20240502 01:59:14.843611 24962 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 01:59:14.845497 24976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:14.846400 24962 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:14.846501 24962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "8519b82a88b84d4b8aac813615eb1716"
format_stamp: "Formatted at 2024-05-02 01:59:14 on dist-test-slave-dr9f"
I20240502 01:59:14.846576 24962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:14.858412 24962 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:14.858901 24962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:14.859041 24962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:14.859491 24962 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:14.860270 24962 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:14.860317 24962 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:14.860369 24962 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:14.860401 24962 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:14.868341 24962 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.195:43565
I20240502 01:59:14.868405 25091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.195:43565 every 8 connection(s)
I20240502 01:59:14.869189 24962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20240502 01:59:14.877157 25092 heartbeater.cc:347] Connected to a master server at 127.10.133.254:41609
I20240502 01:59:14.877359 25092 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:14.877506 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 24962
I20240502 01:59:14.877619 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20240502 01:59:14.877879 25092 heartbeater.cc:511] Master 127.10.133.254:41609 requested a full tablet report, sending...
I20240502 01:59:14.878809 24634 ts_manager.cc:194] Registered new tserver with Master: 8519b82a88b84d4b8aac813615eb1716 (127.10.133.195:43565)
I20240502 01:59:14.879348 24634 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.195:46233
I20240502 01:59:14.879683 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.196:0
--local_ip_for_outbound_sockets=127.10.133.196
--webserver_interface=127.10.133.196
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41609
--builtin_ntp_servers=127.10.133.212:40993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 01:59:14.982764 25095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:14.982980 25095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:14.983052 25095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:14.986017 25095 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:14.986091 25095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:14.986187 25095 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.196
I20240502 01:59:14.989681 25095 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:40993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.196:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.10.133.196
--webserver_port=0
--tserver_master_addrs=127.10.133.254:41609
--never_fsync=true
--heap_profile_path=/tmp/kudu.25095
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.196
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:14.990550 25095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:14.991658 25095 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:15.000787 25100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:15.001464 25101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:15.002154 25103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:15.002836 25095 server_base.cc:1034] running on GCE node
I20240502 01:59:15.003242 25095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:15.003836 25095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:15.004990 25095 hybrid_clock.cc:648] HybridClock initialized: now 1714615155004975 us; error 33 us; skew 500 ppm
I20240502 01:59:15.006754 25095 webserver.cc:460] Webserver started at http://127.10.133.196:35143/ using document root <none> and password file <none>
I20240502 01:59:15.007305 25095 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:15.007361 25095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:15.007551 25095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:15.009325 25095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "c5790b2af50b4c579e774d012bc0b2ef"
format_stamp: "Formatted at 2024-05-02 01:59:15 on dist-test-slave-dr9f"
I20240502 01:59:15.009791 25095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "c5790b2af50b4c579e774d012bc0b2ef"
format_stamp: "Formatted at 2024-05-02 01:59:15 on dist-test-slave-dr9f"
I20240502 01:59:15.013134 25095 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20240502 01:59:15.015430 25109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:15.016450 25095 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:15.016566 25095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "c5790b2af50b4c579e774d012bc0b2ef"
format_stamp: "Formatted at 2024-05-02 01:59:15 on dist-test-slave-dr9f"
I20240502 01:59:15.016669 25095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:15.034158 25095 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:15.034801 25095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:15.034955 25095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:15.035485 25095 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:15.036372 25095 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:15.036418 25095 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:15.036464 25095 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:15.036496 25095 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:15.044735 25095 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.196:46667
I20240502 01:59:15.044770 25224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.196:46667 every 8 connection(s)
I20240502 01:59:15.045657 25095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20240502 01:59:15.053939 25225 heartbeater.cc:347] Connected to a master server at 127.10.133.254:41609
I20240502 01:59:15.054162 25225 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:15.054651 25225 heartbeater.cc:511] Master 127.10.133.254:41609 requested a full tablet report, sending...
I20240502 01:59:15.055594 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 25095
I20240502 01:59:15.055605 24634 ts_manager.cc:194] Registered new tserver with Master: c5790b2af50b4c579e774d012bc0b2ef (127.10.133.196:46667)
I20240502 01:59:15.055740 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20240502 01:59:15.056427 24634 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.196:43169
I20240502 01:59:15.058043 10775 external_mini_cluster.cc:930] 4 TS(s) registered with all masters
I20240502 01:59:15.066283 24635 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45622:
name: "TestTable"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
owner: "alice"
I20240502 01:59:15.081244 25159 tablet_service.cc:1467] Processing CreateTablet for tablet 2a827761770248d480c49aa7199f48a3 (DEFAULT_TABLE table=TestTable [id=08d10cfc874648c68e842594e692a1f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:15.082132 25159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a827761770248d480c49aa7199f48a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:15.087028 25238 tablet_bootstrap.cc:492] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef: Bootstrap starting.
I20240502 01:59:15.089107 25238 tablet_bootstrap.cc:654] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:15.089774 25238 log.cc:824] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:15.091320 25238 tablet_bootstrap.cc:492] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef: No bootstrap required, opened a new log
I20240502 01:59:15.091513 25238 ts_tablet_manager.cc:1367] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240502 01:59:15.094478 25238 raft_consensus.cc:348] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5790b2af50b4c579e774d012bc0b2ef" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 46667 } }
I20240502 01:59:15.094669 25238 raft_consensus.cc:374] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:15.094735 25238 raft_consensus.cc:729] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5790b2af50b4c579e774d012bc0b2ef, State: Initialized, Role: FOLLOWER
I20240502 01:59:15.095157 25238 consensus_queue.cc:260] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5790b2af50b4c579e774d012bc0b2ef" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 46667 } }
I20240502 01:59:15.095284 25238 raft_consensus.cc:388] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:59:15.095346 25238 raft_consensus.cc:482] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:59:15.095454 25238 raft_consensus.cc:3037] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:15.096269 25238 raft_consensus.cc:504] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5790b2af50b4c579e774d012bc0b2ef" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 46667 } }
I20240502 01:59:15.096606 25238 leader_election.cc:302] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5790b2af50b4c579e774d012bc0b2ef; no voters:
I20240502 01:59:15.096899 25238 leader_election.cc:288] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:59:15.097018 25240 raft_consensus.cc:2781] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:15.097254 25240 raft_consensus.cc:686] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [term 1 LEADER]: Becoming Leader. State: Replica: c5790b2af50b4c579e774d012bc0b2ef, State: Running, Role: LEADER
I20240502 01:59:15.097534 25240 consensus_queue.cc:237] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5790b2af50b4c579e774d012bc0b2ef" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 46667 } }
I20240502 01:59:15.097604 25225 heartbeater.cc:503] Master 127.10.133.254:41609 was elected leader, sending a full tablet report...
I20240502 01:59:15.097765 25238 ts_tablet_manager.cc:1398] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20240502 01:59:15.100651 24635 catalog_manager.cc:5484] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef reported cstate change: term changed from 0 to 1, leader changed from <none> to c5790b2af50b4c579e774d012bc0b2ef (127.10.133.196). New cstate: current_term: 1 leader_uuid: "c5790b2af50b4c579e774d012bc0b2ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5790b2af50b4c579e774d012bc0b2ef" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 46667 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:15.107060 10775 external_mini_cluster.cc:930] 4 TS(s) registered with all masters
I20240502 01:59:15.108194 10775 ts_itest-base.cc:233] Waiting for 0 tablets on tserver 3c1733fc9bc942268fb9a95e5b8fa14e to finish bootstrapping
I20240502 01:59:15.113626 10775 ts_itest-base.cc:233] Waiting for 0 tablets on tserver 987e3f475cb44c0ca483787ae7079d76 to finish bootstrapping
I20240502 01:59:15.119006 10775 ts_itest-base.cc:233] Waiting for 0 tablets on tserver 8519b82a88b84d4b8aac813615eb1716 to finish bootstrapping
I20240502 01:59:15.124248 10775 ts_itest-base.cc:233] Waiting for 1 tablets on tserver c5790b2af50b4c579e774d012bc0b2ef to finish bootstrapping
I20240502 01:59:15.128917 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 24962
I20240502 01:59:15.134996 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 25095
I20240502 01:59:15.545786 24827 heartbeater.cc:503] Master 127.10.133.254:41609 was elected leader, sending a full tablet report...
I20240502 01:59:15.716722 24959 heartbeater.cc:503] Master 127.10.133.254:41609 was elected leader, sending a full tablet report...
I20240502 01:59:18.892020 24635 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45622:
name: "rebalance_test_table_0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 01:59:18.904044 24892 tablet_service.cc:1467] Processing CreateTablet for tablet cd3ec3faa6cc491480960de0b6962eb9 (DEFAULT_TABLE table=rebalance_test_table_0 [id=fca0ad9ea891422badc7dc304a92f71f]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:18.904052 24759 tablet_service.cc:1467] Processing CreateTablet for tablet a06ac859705e421baf335ac7a1066f02 (DEFAULT_TABLE table=rebalance_test_table_0 [id=fca0ad9ea891422badc7dc304a92f71f]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:18.904049 24760 tablet_service.cc:1467] Processing CreateTablet for tablet c751c51bf8154df89ca66cc2b159dbe2 (DEFAULT_TABLE table=rebalance_test_table_0 [id=fca0ad9ea891422badc7dc304a92f71f]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:18.904937 24892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd3ec3faa6cc491480960de0b6962eb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:18.905035 24760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c751c51bf8154df89ca66cc2b159dbe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:18.905366 24759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a06ac859705e421baf335ac7a1066f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:18.910043 25257 tablet_bootstrap.cc:492] T cd3ec3faa6cc491480960de0b6962eb9 P 987e3f475cb44c0ca483787ae7079d76: Bootstrap starting.
I20240502 01:59:18.911051 25258 tablet_bootstrap.cc:492] T a06ac859705e421baf335ac7a1066f02 P 3c1733fc9bc942268fb9a95e5b8fa14e: Bootstrap starting.
I20240502 01:59:18.912246 25257 tablet_bootstrap.cc:654] T cd3ec3faa6cc491480960de0b6962eb9 P 987e3f475cb44c0ca483787ae7079d76: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:18.912926 25258 tablet_bootstrap.cc:654] T a06ac859705e421baf335ac7a1066f02 P 3c1733fc9bc942268fb9a95e5b8fa14e: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:18.913059 25257 log.cc:824] T cd3ec3faa6cc491480960de0b6962eb9 P 987e3f475cb44c0ca483787ae7079d76: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:18.913650 25258 log.cc:824] T a06ac859705e421baf335ac7a1066f02 P 3c1733fc9bc942268fb9a95e5b8fa14e: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:18.915361 25257 tablet_bootstrap.cc:492] T cd3ec3faa6cc491480960de0b6962eb9 P 987e3f475cb44c0ca483787ae7079d76: No bootstrap required, opened a new log
I20240502 01:59:18.915360 25258 tablet_bootstrap.cc:492] T a06ac859705e421baf335ac7a1066f02 P 3c1733fc9bc942268fb9a95e5b8fa14e: No bootstrap required, opened a new log
I20240502 01:59:18.915537 25257 ts_tablet_manager.cc:1367] T cd3ec3faa6cc491480960de0b6962eb9 P 987e3f475cb44c0ca483787ae7079d76: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20240502 01:59:18.915537 25258 ts_tablet_manager.cc:1367] T a06ac859705e421baf335ac7a1066f02 P 3c1733fc9bc942268fb9a95e5b8fa14e: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240502 01:59:18.919376 25257 raft_consensus.cc:348] T cd3ec3faa6cc491480960de0b6962eb9 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:18.919376 25258 raft_consensus.cc:348] T a06ac859705e421baf335ac7a1066f02 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:18.919582 25257 raft_consensus.cc:374] T cd3ec3faa6cc491480960de0b6962eb9 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:18.919582 25258 raft_consensus.cc:374] T a06ac859705e421baf335ac7a1066f02 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:18.919646 25257 raft_consensus.cc:729] T cd3ec3faa6cc491480960de0b6962eb9 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 987e3f475cb44c0ca483787ae7079d76, State: Initialized, Role: FOLLOWER
I20240502 01:59:18.919649 25258 raft_consensus.cc:729] T a06ac859705e421baf335ac7a1066f02 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1733fc9bc942268fb9a95e5b8fa14e, State: Initialized, Role: FOLLOWER
I20240502 01:59:18.920101 25258 consensus_queue.cc:260] T a06ac859705e421baf335ac7a1066f02 P 3c1733fc9bc942268fb9a95e5b8fa14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:18.920101 25257 consensus_queue.cc:260] T cd3ec3faa6cc491480960de0b6962eb9 P 987e3f475cb44c0ca483787ae7079d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:18.920245 25257 raft_consensus.cc:388] T cd3ec3faa6cc491480960de0b6962eb9 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:59:18.920245 25258 raft_consensus.cc:388] T a06ac859705e421baf335ac7a1066f02 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:59:18.920315 25258 raft_consensus.cc:482] T a06ac859705e421baf335ac7a1066f02 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:59:18.920315 25257 raft_consensus.cc:482] T cd3ec3faa6cc491480960de0b6962eb9 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:59:18.920424 25257 raft_consensus.cc:3037] T cd3ec3faa6cc491480960de0b6962eb9 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:18.920424 25258 raft_consensus.cc:3037] T a06ac859705e421baf335ac7a1066f02 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:18.921379 25258 raft_consensus.cc:504] T a06ac859705e421baf335ac7a1066f02 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:18.921379 25257 raft_consensus.cc:504] T cd3ec3faa6cc491480960de0b6962eb9 P 987e3f475cb44c0ca483787ae7079d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:18.921739 25258 leader_election.cc:302] T a06ac859705e421baf335ac7a1066f02 P 3c1733fc9bc942268fb9a95e5b8fa14e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c1733fc9bc942268fb9a95e5b8fa14e; no voters:
I20240502 01:59:18.921739 25257 leader_election.cc:302] T cd3ec3faa6cc491480960de0b6962eb9 P 987e3f475cb44c0ca483787ae7079d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 987e3f475cb44c0ca483787ae7079d76; no voters:
I20240502 01:59:18.922070 25258 leader_election.cc:288] T a06ac859705e421baf335ac7a1066f02 P 3c1733fc9bc942268fb9a95e5b8fa14e [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:59:18.922070 25257 leader_election.cc:288] T cd3ec3faa6cc491480960de0b6962eb9 P 987e3f475cb44c0ca483787ae7079d76 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:59:18.922170 25261 raft_consensus.cc:2781] T a06ac859705e421baf335ac7a1066f02 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:18.922365 25262 raft_consensus.cc:2781] T cd3ec3faa6cc491480960de0b6962eb9 P 987e3f475cb44c0ca483787ae7079d76 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:18.922571 25262 raft_consensus.cc:686] T cd3ec3faa6cc491480960de0b6962eb9 P 987e3f475cb44c0ca483787ae7079d76 [term 1 LEADER]: Becoming Leader. State: Replica: 987e3f475cb44c0ca483787ae7079d76, State: Running, Role: LEADER
I20240502 01:59:18.922825 25261 raft_consensus.cc:686] T a06ac859705e421baf335ac7a1066f02 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 1 LEADER]: Becoming Leader. State: Replica: 3c1733fc9bc942268fb9a95e5b8fa14e, State: Running, Role: LEADER
I20240502 01:59:18.922899 25257 ts_tablet_manager.cc:1398] T cd3ec3faa6cc491480960de0b6962eb9 P 987e3f475cb44c0ca483787ae7079d76: Time spent starting tablet: real 0.007s user 0.000s sys 0.008s
I20240502 01:59:18.923169 25262 consensus_queue.cc:237] T cd3ec3faa6cc491480960de0b6962eb9 P 987e3f475cb44c0ca483787ae7079d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:18.923537 25261 consensus_queue.cc:237] T a06ac859705e421baf335ac7a1066f02 P 3c1733fc9bc942268fb9a95e5b8fa14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:18.922904 25258 ts_tablet_manager.cc:1398] T a06ac859705e421baf335ac7a1066f02 P 3c1733fc9bc942268fb9a95e5b8fa14e: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20240502 01:59:18.924587 25258 tablet_bootstrap.cc:492] T c751c51bf8154df89ca66cc2b159dbe2 P 3c1733fc9bc942268fb9a95e5b8fa14e: Bootstrap starting.
I20240502 01:59:18.925335 25258 tablet_bootstrap.cc:654] T c751c51bf8154df89ca66cc2b159dbe2 P 3c1733fc9bc942268fb9a95e5b8fa14e: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:18.926402 24635 catalog_manager.cc:5484] T a06ac859705e421baf335ac7a1066f02 P 3c1733fc9bc942268fb9a95e5b8fa14e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1733fc9bc942268fb9a95e5b8fa14e (127.10.133.193). New cstate: current_term: 1 leader_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:18.926580 25258 tablet_bootstrap.cc:492] T c751c51bf8154df89ca66cc2b159dbe2 P 3c1733fc9bc942268fb9a95e5b8fa14e: No bootstrap required, opened a new log
I20240502 01:59:18.926712 25258 ts_tablet_manager.cc:1367] T c751c51bf8154df89ca66cc2b159dbe2 P 3c1733fc9bc942268fb9a95e5b8fa14e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:59:18.927316 25258 raft_consensus.cc:348] T c751c51bf8154df89ca66cc2b159dbe2 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:18.927449 25258 raft_consensus.cc:374] T c751c51bf8154df89ca66cc2b159dbe2 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:18.927516 25258 raft_consensus.cc:729] T c751c51bf8154df89ca66cc2b159dbe2 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1733fc9bc942268fb9a95e5b8fa14e, State: Initialized, Role: FOLLOWER
I20240502 01:59:18.927736 25258 consensus_queue.cc:260] T c751c51bf8154df89ca66cc2b159dbe2 P 3c1733fc9bc942268fb9a95e5b8fa14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:18.927861 25258 raft_consensus.cc:388] T c751c51bf8154df89ca66cc2b159dbe2 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:59:18.927929 25258 raft_consensus.cc:482] T c751c51bf8154df89ca66cc2b159dbe2 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:59:18.928005 25258 raft_consensus.cc:3037] T c751c51bf8154df89ca66cc2b159dbe2 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:18.928934 25258 raft_consensus.cc:504] T c751c51bf8154df89ca66cc2b159dbe2 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:18.929092 25258 leader_election.cc:302] T c751c51bf8154df89ca66cc2b159dbe2 P 3c1733fc9bc942268fb9a95e5b8fa14e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c1733fc9bc942268fb9a95e5b8fa14e; no voters:
I20240502 01:59:18.929191 25258 leader_election.cc:288] T c751c51bf8154df89ca66cc2b159dbe2 P 3c1733fc9bc942268fb9a95e5b8fa14e [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:59:18.929266 25261 raft_consensus.cc:2781] T c751c51bf8154df89ca66cc2b159dbe2 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:18.929180 24633 catalog_manager.cc:5484] T cd3ec3faa6cc491480960de0b6962eb9 P 987e3f475cb44c0ca483787ae7079d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 987e3f475cb44c0ca483787ae7079d76 (127.10.133.194). New cstate: current_term: 1 leader_uuid: "987e3f475cb44c0ca483787ae7079d76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:18.929358 25261 raft_consensus.cc:686] T c751c51bf8154df89ca66cc2b159dbe2 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 1 LEADER]: Becoming Leader. State: Replica: 3c1733fc9bc942268fb9a95e5b8fa14e, State: Running, Role: LEADER
I20240502 01:59:18.929430 25258 ts_tablet_manager.cc:1398] T c751c51bf8154df89ca66cc2b159dbe2 P 3c1733fc9bc942268fb9a95e5b8fa14e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 01:59:18.929499 25261 consensus_queue.cc:237] T c751c51bf8154df89ca66cc2b159dbe2 P 3c1733fc9bc942268fb9a95e5b8fa14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:18.931627 24635 catalog_manager.cc:5484] T c751c51bf8154df89ca66cc2b159dbe2 P 3c1733fc9bc942268fb9a95e5b8fa14e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1733fc9bc942268fb9a95e5b8fa14e (127.10.133.193). New cstate: current_term: 1 leader_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:19.093636 24635 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45622:
name: "rebalance_test_table_1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 01:59:19.099177 24892 tablet_service.cc:1467] Processing CreateTablet for tablet 014fc6a75bbd4078996f02d876ce652f (DEFAULT_TABLE table=rebalance_test_table_1 [id=f87819f6f2b141b9aff87fa510bc5223]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:19.099205 24891 tablet_service.cc:1467] Processing CreateTablet for tablet 8075806cbb3a4f4faac517a9761bd2d2 (DEFAULT_TABLE table=rebalance_test_table_1 [id=f87819f6f2b141b9aff87fa510bc5223]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:19.099249 24759 tablet_service.cc:1467] Processing CreateTablet for tablet 9d45c5c342d94c2196c01419e3642df8 (DEFAULT_TABLE table=rebalance_test_table_1 [id=f87819f6f2b141b9aff87fa510bc5223]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:19.099509 24892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 014fc6a75bbd4078996f02d876ce652f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:19.099524 24759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d45c5c342d94c2196c01419e3642df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:19.099769 24891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8075806cbb3a4f4faac517a9761bd2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:19.101276 25257 tablet_bootstrap.cc:492] T 014fc6a75bbd4078996f02d876ce652f P 987e3f475cb44c0ca483787ae7079d76: Bootstrap starting.
I20240502 01:59:19.101794 25258 tablet_bootstrap.cc:492] T 9d45c5c342d94c2196c01419e3642df8 P 3c1733fc9bc942268fb9a95e5b8fa14e: Bootstrap starting.
I20240502 01:59:19.102311 25257 tablet_bootstrap.cc:654] T 014fc6a75bbd4078996f02d876ce652f P 987e3f475cb44c0ca483787ae7079d76: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:19.102751 25258 tablet_bootstrap.cc:654] T 9d45c5c342d94c2196c01419e3642df8 P 3c1733fc9bc942268fb9a95e5b8fa14e: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:19.103545 25257 tablet_bootstrap.cc:492] T 014fc6a75bbd4078996f02d876ce652f P 987e3f475cb44c0ca483787ae7079d76: No bootstrap required, opened a new log
I20240502 01:59:19.103637 25257 ts_tablet_manager.cc:1367] T 014fc6a75bbd4078996f02d876ce652f P 987e3f475cb44c0ca483787ae7079d76: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:19.104039 25258 tablet_bootstrap.cc:492] T 9d45c5c342d94c2196c01419e3642df8 P 3c1733fc9bc942268fb9a95e5b8fa14e: No bootstrap required, opened a new log
I20240502 01:59:19.104110 25258 ts_tablet_manager.cc:1367] T 9d45c5c342d94c2196c01419e3642df8 P 3c1733fc9bc942268fb9a95e5b8fa14e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:19.104190 25257 raft_consensus.cc:348] T 014fc6a75bbd4078996f02d876ce652f P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:19.104286 25257 raft_consensus.cc:374] T 014fc6a75bbd4078996f02d876ce652f P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:19.104328 25257 raft_consensus.cc:729] T 014fc6a75bbd4078996f02d876ce652f P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 987e3f475cb44c0ca483787ae7079d76, State: Initialized, Role: FOLLOWER
I20240502 01:59:19.104460 25257 consensus_queue.cc:260] T 014fc6a75bbd4078996f02d876ce652f P 987e3f475cb44c0ca483787ae7079d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:19.104538 25257 raft_consensus.cc:388] T 014fc6a75bbd4078996f02d876ce652f P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:59:19.104583 25257 raft_consensus.cc:482] T 014fc6a75bbd4078996f02d876ce652f P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:59:19.104533 25258 raft_consensus.cc:348] T 9d45c5c342d94c2196c01419e3642df8 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:19.104635 25257 raft_consensus.cc:3037] T 014fc6a75bbd4078996f02d876ce652f P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:19.104657 25258 raft_consensus.cc:374] T 9d45c5c342d94c2196c01419e3642df8 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:19.104696 25258 raft_consensus.cc:729] T 9d45c5c342d94c2196c01419e3642df8 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1733fc9bc942268fb9a95e5b8fa14e, State: Initialized, Role: FOLLOWER
I20240502 01:59:19.104825 25258 consensus_queue.cc:260] T 9d45c5c342d94c2196c01419e3642df8 P 3c1733fc9bc942268fb9a95e5b8fa14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:19.104910 25258 raft_consensus.cc:388] T 9d45c5c342d94c2196c01419e3642df8 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:59:19.104951 25258 raft_consensus.cc:482] T 9d45c5c342d94c2196c01419e3642df8 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:59:19.105006 25258 raft_consensus.cc:3037] T 9d45c5c342d94c2196c01419e3642df8 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:19.105473 25257 raft_consensus.cc:504] T 014fc6a75bbd4078996f02d876ce652f P 987e3f475cb44c0ca483787ae7079d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:19.105582 25257 leader_election.cc:302] T 014fc6a75bbd4078996f02d876ce652f P 987e3f475cb44c0ca483787ae7079d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 987e3f475cb44c0ca483787ae7079d76; no voters:
I20240502 01:59:19.105700 25257 leader_election.cc:288] T 014fc6a75bbd4078996f02d876ce652f P 987e3f475cb44c0ca483787ae7079d76 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:59:19.105780 25265 raft_consensus.cc:2781] T 014fc6a75bbd4078996f02d876ce652f P 987e3f475cb44c0ca483787ae7079d76 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:19.105804 25258 raft_consensus.cc:504] T 9d45c5c342d94c2196c01419e3642df8 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:19.105899 25265 raft_consensus.cc:686] T 014fc6a75bbd4078996f02d876ce652f P 987e3f475cb44c0ca483787ae7079d76 [term 1 LEADER]: Becoming Leader. State: Replica: 987e3f475cb44c0ca483787ae7079d76, State: Running, Role: LEADER
I20240502 01:59:19.105928 25258 leader_election.cc:302] T 9d45c5c342d94c2196c01419e3642df8 P 3c1733fc9bc942268fb9a95e5b8fa14e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c1733fc9bc942268fb9a95e5b8fa14e; no voters:
I20240502 01:59:19.106043 25258 leader_election.cc:288] T 9d45c5c342d94c2196c01419e3642df8 P 3c1733fc9bc942268fb9a95e5b8fa14e [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:59:19.106037 25265 consensus_queue.cc:237] T 014fc6a75bbd4078996f02d876ce652f P 987e3f475cb44c0ca483787ae7079d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:19.106154 25261 raft_consensus.cc:2781] T 9d45c5c342d94c2196c01419e3642df8 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:19.106252 25258 ts_tablet_manager.cc:1398] T 9d45c5c342d94c2196c01419e3642df8 P 3c1733fc9bc942268fb9a95e5b8fa14e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:19.106257 25261 raft_consensus.cc:686] T 9d45c5c342d94c2196c01419e3642df8 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 1 LEADER]: Becoming Leader. State: Replica: 3c1733fc9bc942268fb9a95e5b8fa14e, State: Running, Role: LEADER
I20240502 01:59:19.106408 25261 consensus_queue.cc:237] T 9d45c5c342d94c2196c01419e3642df8 P 3c1733fc9bc942268fb9a95e5b8fa14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:19.106911 25257 ts_tablet_manager.cc:1398] T 014fc6a75bbd4078996f02d876ce652f P 987e3f475cb44c0ca483787ae7079d76: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 01:59:19.107110 25257 tablet_bootstrap.cc:492] T 8075806cbb3a4f4faac517a9761bd2d2 P 987e3f475cb44c0ca483787ae7079d76: Bootstrap starting.
I20240502 01:59:19.107820 24633 catalog_manager.cc:5484] T 014fc6a75bbd4078996f02d876ce652f P 987e3f475cb44c0ca483787ae7079d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 987e3f475cb44c0ca483787ae7079d76 (127.10.133.194). New cstate: current_term: 1 leader_uuid: "987e3f475cb44c0ca483787ae7079d76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:19.107838 24635 catalog_manager.cc:5484] T 9d45c5c342d94c2196c01419e3642df8 P 3c1733fc9bc942268fb9a95e5b8fa14e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1733fc9bc942268fb9a95e5b8fa14e (127.10.133.193). New cstate: current_term: 1 leader_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:19.107981 25257 tablet_bootstrap.cc:654] T 8075806cbb3a4f4faac517a9761bd2d2 P 987e3f475cb44c0ca483787ae7079d76: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:19.108986 25257 tablet_bootstrap.cc:492] T 8075806cbb3a4f4faac517a9761bd2d2 P 987e3f475cb44c0ca483787ae7079d76: No bootstrap required, opened a new log
I20240502 01:59:19.109066 25257 ts_tablet_manager.cc:1367] T 8075806cbb3a4f4faac517a9761bd2d2 P 987e3f475cb44c0ca483787ae7079d76: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:59:19.109604 25257 raft_consensus.cc:348] T 8075806cbb3a4f4faac517a9761bd2d2 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:19.109676 25257 raft_consensus.cc:374] T 8075806cbb3a4f4faac517a9761bd2d2 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:19.109696 25257 raft_consensus.cc:729] T 8075806cbb3a4f4faac517a9761bd2d2 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 987e3f475cb44c0ca483787ae7079d76, State: Initialized, Role: FOLLOWER
I20240502 01:59:19.109788 25257 consensus_queue.cc:260] T 8075806cbb3a4f4faac517a9761bd2d2 P 987e3f475cb44c0ca483787ae7079d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:19.109853 25257 raft_consensus.cc:388] T 8075806cbb3a4f4faac517a9761bd2d2 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:59:19.109875 25257 raft_consensus.cc:482] T 8075806cbb3a4f4faac517a9761bd2d2 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:59:19.109905 25257 raft_consensus.cc:3037] T 8075806cbb3a4f4faac517a9761bd2d2 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:19.110736 25257 raft_consensus.cc:504] T 8075806cbb3a4f4faac517a9761bd2d2 P 987e3f475cb44c0ca483787ae7079d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:19.110857 25257 leader_election.cc:302] T 8075806cbb3a4f4faac517a9761bd2d2 P 987e3f475cb44c0ca483787ae7079d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 987e3f475cb44c0ca483787ae7079d76; no voters:
I20240502 01:59:19.110946 25257 leader_election.cc:288] T 8075806cbb3a4f4faac517a9761bd2d2 P 987e3f475cb44c0ca483787ae7079d76 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:59:19.111073 25262 raft_consensus.cc:2781] T 8075806cbb3a4f4faac517a9761bd2d2 P 987e3f475cb44c0ca483787ae7079d76 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:19.111150 25257 ts_tablet_manager.cc:1398] T 8075806cbb3a4f4faac517a9761bd2d2 P 987e3f475cb44c0ca483787ae7079d76: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20240502 01:59:19.111171 25262 raft_consensus.cc:686] T 8075806cbb3a4f4faac517a9761bd2d2 P 987e3f475cb44c0ca483787ae7079d76 [term 1 LEADER]: Becoming Leader. State: Replica: 987e3f475cb44c0ca483787ae7079d76, State: Running, Role: LEADER
I20240502 01:59:19.111279 25262 consensus_queue.cc:237] T 8075806cbb3a4f4faac517a9761bd2d2 P 987e3f475cb44c0ca483787ae7079d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:19.112886 24635 catalog_manager.cc:5484] T 8075806cbb3a4f4faac517a9761bd2d2 P 987e3f475cb44c0ca483787ae7079d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 987e3f475cb44c0ca483787ae7079d76 (127.10.133.194). New cstate: current_term: 1 leader_uuid: "987e3f475cb44c0ca483787ae7079d76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:19.275578 24635 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45622:
name: "rebalance_test_table_2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 01:59:19.281162 24891 tablet_service.cc:1467] Processing CreateTablet for tablet 928b8eba2b744c56a9c6e7ee77020f50 (DEFAULT_TABLE table=rebalance_test_table_2 [id=1e19661892494126a6724165a1648e70]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:19.281152 24759 tablet_service.cc:1467] Processing CreateTablet for tablet bc941c18840c46b0be6e29b6e0bdbea7 (DEFAULT_TABLE table=rebalance_test_table_2 [id=1e19661892494126a6724165a1648e70]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:19.281265 24760 tablet_service.cc:1467] Processing CreateTablet for tablet 17c0e4b7b5c24e8fb417583ffc045876 (DEFAULT_TABLE table=rebalance_test_table_2 [id=1e19661892494126a6724165a1648e70]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:19.281466 24759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc941c18840c46b0be6e29b6e0bdbea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:19.281466 24891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 928b8eba2b744c56a9c6e7ee77020f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:19.281626 24760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17c0e4b7b5c24e8fb417583ffc045876. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:19.283416 25257 tablet_bootstrap.cc:492] T 928b8eba2b744c56a9c6e7ee77020f50 P 987e3f475cb44c0ca483787ae7079d76: Bootstrap starting.
I20240502 01:59:19.283602 25258 tablet_bootstrap.cc:492] T bc941c18840c46b0be6e29b6e0bdbea7 P 3c1733fc9bc942268fb9a95e5b8fa14e: Bootstrap starting.
I20240502 01:59:19.284446 25258 tablet_bootstrap.cc:654] T bc941c18840c46b0be6e29b6e0bdbea7 P 3c1733fc9bc942268fb9a95e5b8fa14e: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:19.284461 25257 tablet_bootstrap.cc:654] T 928b8eba2b744c56a9c6e7ee77020f50 P 987e3f475cb44c0ca483787ae7079d76: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:19.285593 25257 tablet_bootstrap.cc:492] T 928b8eba2b744c56a9c6e7ee77020f50 P 987e3f475cb44c0ca483787ae7079d76: No bootstrap required, opened a new log
I20240502 01:59:19.285674 25257 ts_tablet_manager.cc:1367] T 928b8eba2b744c56a9c6e7ee77020f50 P 987e3f475cb44c0ca483787ae7079d76: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240502 01:59:19.285773 25258 tablet_bootstrap.cc:492] T bc941c18840c46b0be6e29b6e0bdbea7 P 3c1733fc9bc942268fb9a95e5b8fa14e: No bootstrap required, opened a new log
I20240502 01:59:19.285845 25258 ts_tablet_manager.cc:1367] T bc941c18840c46b0be6e29b6e0bdbea7 P 3c1733fc9bc942268fb9a95e5b8fa14e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:19.286154 25257 raft_consensus.cc:348] T 928b8eba2b744c56a9c6e7ee77020f50 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:19.286242 25257 raft_consensus.cc:374] T 928b8eba2b744c56a9c6e7ee77020f50 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:19.286235 25258 raft_consensus.cc:348] T bc941c18840c46b0be6e29b6e0bdbea7 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:19.286305 25257 raft_consensus.cc:729] T 928b8eba2b744c56a9c6e7ee77020f50 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 987e3f475cb44c0ca483787ae7079d76, State: Initialized, Role: FOLLOWER
I20240502 01:59:19.286337 25258 raft_consensus.cc:374] T bc941c18840c46b0be6e29b6e0bdbea7 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:19.286372 25258 raft_consensus.cc:729] T bc941c18840c46b0be6e29b6e0bdbea7 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1733fc9bc942268fb9a95e5b8fa14e, State: Initialized, Role: FOLLOWER
I20240502 01:59:19.286425 25257 consensus_queue.cc:260] T 928b8eba2b744c56a9c6e7ee77020f50 P 987e3f475cb44c0ca483787ae7079d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:19.286516 25257 raft_consensus.cc:388] T 928b8eba2b744c56a9c6e7ee77020f50 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:59:19.286510 25258 consensus_queue.cc:260] T bc941c18840c46b0be6e29b6e0bdbea7 P 3c1733fc9bc942268fb9a95e5b8fa14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:19.286558 25257 raft_consensus.cc:482] T 928b8eba2b744c56a9c6e7ee77020f50 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:59:19.286600 25257 raft_consensus.cc:3037] T 928b8eba2b744c56a9c6e7ee77020f50 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:19.286602 25258 raft_consensus.cc:388] T bc941c18840c46b0be6e29b6e0bdbea7 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:59:19.286638 25258 raft_consensus.cc:482] T bc941c18840c46b0be6e29b6e0bdbea7 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:59:19.286686 25258 raft_consensus.cc:3037] T bc941c18840c46b0be6e29b6e0bdbea7 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:19.287406 25258 raft_consensus.cc:504] T bc941c18840c46b0be6e29b6e0bdbea7 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:19.287437 25257 raft_consensus.cc:504] T 928b8eba2b744c56a9c6e7ee77020f50 P 987e3f475cb44c0ca483787ae7079d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:19.287535 25258 leader_election.cc:302] T bc941c18840c46b0be6e29b6e0bdbea7 P 3c1733fc9bc942268fb9a95e5b8fa14e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c1733fc9bc942268fb9a95e5b8fa14e; no voters:
I20240502 01:59:19.287564 25257 leader_election.cc:302] T 928b8eba2b744c56a9c6e7ee77020f50 P 987e3f475cb44c0ca483787ae7079d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 987e3f475cb44c0ca483787ae7079d76; no voters:
I20240502 01:59:19.287683 25261 raft_consensus.cc:2781] T bc941c18840c46b0be6e29b6e0bdbea7 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:19.287714 25257 leader_election.cc:288] T 928b8eba2b744c56a9c6e7ee77020f50 P 987e3f475cb44c0ca483787ae7079d76 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:59:19.287761 25261 raft_consensus.cc:686] T bc941c18840c46b0be6e29b6e0bdbea7 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 1 LEADER]: Becoming Leader. State: Replica: 3c1733fc9bc942268fb9a95e5b8fa14e, State: Running, Role: LEADER
I20240502 01:59:19.287755 25262 raft_consensus.cc:2781] T 928b8eba2b744c56a9c6e7ee77020f50 P 987e3f475cb44c0ca483787ae7079d76 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:19.287829 25262 raft_consensus.cc:686] T 928b8eba2b744c56a9c6e7ee77020f50 P 987e3f475cb44c0ca483787ae7079d76 [term 1 LEADER]: Becoming Leader. State: Replica: 987e3f475cb44c0ca483787ae7079d76, State: Running, Role: LEADER
I20240502 01:59:19.287878 25261 consensus_queue.cc:237] T bc941c18840c46b0be6e29b6e0bdbea7 P 3c1733fc9bc942268fb9a95e5b8fa14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:19.287933 25262 consensus_queue.cc:237] T 928b8eba2b744c56a9c6e7ee77020f50 P 987e3f475cb44c0ca483787ae7079d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:19.288036 25257 ts_tablet_manager.cc:1398] T 928b8eba2b744c56a9c6e7ee77020f50 P 987e3f475cb44c0ca483787ae7079d76: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20240502 01:59:19.288261 25258 leader_election.cc:288] T bc941c18840c46b0be6e29b6e0bdbea7 P 3c1733fc9bc942268fb9a95e5b8fa14e [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:59:19.288666 25258 ts_tablet_manager.cc:1398] T bc941c18840c46b0be6e29b6e0bdbea7 P 3c1733fc9bc942268fb9a95e5b8fa14e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:59:19.289836 25258 tablet_bootstrap.cc:492] T 17c0e4b7b5c24e8fb417583ffc045876 P 3c1733fc9bc942268fb9a95e5b8fa14e: Bootstrap starting.
I20240502 01:59:19.290072 24635 catalog_manager.cc:5484] T 928b8eba2b744c56a9c6e7ee77020f50 P 987e3f475cb44c0ca483787ae7079d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 987e3f475cb44c0ca483787ae7079d76 (127.10.133.194). New cstate: current_term: 1 leader_uuid: "987e3f475cb44c0ca483787ae7079d76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:19.290563 24633 catalog_manager.cc:5484] T bc941c18840c46b0be6e29b6e0bdbea7 P 3c1733fc9bc942268fb9a95e5b8fa14e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1733fc9bc942268fb9a95e5b8fa14e (127.10.133.193). New cstate: current_term: 1 leader_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:19.290761 25258 tablet_bootstrap.cc:654] T 17c0e4b7b5c24e8fb417583ffc045876 P 3c1733fc9bc942268fb9a95e5b8fa14e: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:19.292021 25258 tablet_bootstrap.cc:492] T 17c0e4b7b5c24e8fb417583ffc045876 P 3c1733fc9bc942268fb9a95e5b8fa14e: No bootstrap required, opened a new log
I20240502 01:59:19.292107 25258 ts_tablet_manager.cc:1367] T 17c0e4b7b5c24e8fb417583ffc045876 P 3c1733fc9bc942268fb9a95e5b8fa14e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:19.292500 25258 raft_consensus.cc:348] T 17c0e4b7b5c24e8fb417583ffc045876 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:19.292586 25258 raft_consensus.cc:374] T 17c0e4b7b5c24e8fb417583ffc045876 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:19.292616 25258 raft_consensus.cc:729] T 17c0e4b7b5c24e8fb417583ffc045876 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1733fc9bc942268fb9a95e5b8fa14e, State: Initialized, Role: FOLLOWER
I20240502 01:59:19.292723 25258 consensus_queue.cc:260] T 17c0e4b7b5c24e8fb417583ffc045876 P 3c1733fc9bc942268fb9a95e5b8fa14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:19.292789 25258 raft_consensus.cc:388] T 17c0e4b7b5c24e8fb417583ffc045876 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:59:19.292814 25258 raft_consensus.cc:482] T 17c0e4b7b5c24e8fb417583ffc045876 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:59:19.292841 25258 raft_consensus.cc:3037] T 17c0e4b7b5c24e8fb417583ffc045876 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:19.293500 25258 raft_consensus.cc:504] T 17c0e4b7b5c24e8fb417583ffc045876 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:19.293608 25258 leader_election.cc:302] T 17c0e4b7b5c24e8fb417583ffc045876 P 3c1733fc9bc942268fb9a95e5b8fa14e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c1733fc9bc942268fb9a95e5b8fa14e; no voters:
I20240502 01:59:19.293679 25258 leader_election.cc:288] T 17c0e4b7b5c24e8fb417583ffc045876 P 3c1733fc9bc942268fb9a95e5b8fa14e [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:59:19.293745 25261 raft_consensus.cc:2781] T 17c0e4b7b5c24e8fb417583ffc045876 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:19.293821 25258 ts_tablet_manager.cc:1398] T 17c0e4b7b5c24e8fb417583ffc045876 P 3c1733fc9bc942268fb9a95e5b8fa14e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20240502 01:59:19.293833 25261 raft_consensus.cc:686] T 17c0e4b7b5c24e8fb417583ffc045876 P 3c1733fc9bc942268fb9a95e5b8fa14e [term 1 LEADER]: Becoming Leader. State: Replica: 3c1733fc9bc942268fb9a95e5b8fa14e, State: Running, Role: LEADER
I20240502 01:59:19.293939 25261 consensus_queue.cc:237] T 17c0e4b7b5c24e8fb417583ffc045876 P 3c1733fc9bc942268fb9a95e5b8fa14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:19.295688 24633 catalog_manager.cc:5484] T 17c0e4b7b5c24e8fb417583ffc045876 P 3c1733fc9bc942268fb9a95e5b8fa14e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1733fc9bc942268fb9a95e5b8fa14e (127.10.133.193). New cstate: current_term: 1 leader_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:19.449193 24633 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45622:
name: "rebalance_test_table_3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
I20240502 01:59:19.454351 24891 tablet_service.cc:1467] Processing CreateTablet for tablet 6f324f4f66d34721ab763250f04a352a (DEFAULT_TABLE table=rebalance_test_table_3 [id=55295ee1393049c1b56704f6c4f0eb7f]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:19.454416 24892 tablet_service.cc:1467] Processing CreateTablet for tablet 705838824da348b286275dc21c15f3d3 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55295ee1393049c1b56704f6c4f0eb7f]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:19.454416 24760 tablet_service.cc:1467] Processing CreateTablet for tablet c923accbe49f41d79979dec1b285286f (DEFAULT_TABLE table=rebalance_test_table_3 [id=55295ee1393049c1b56704f6c4f0eb7f]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:19.454702 24760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c923accbe49f41d79979dec1b285286f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:19.454702 24891 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f324f4f66d34721ab763250f04a352a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:19.454814 24892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 705838824da348b286275dc21c15f3d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:19.456347 25257 tablet_bootstrap.cc:492] T 6f324f4f66d34721ab763250f04a352a P 987e3f475cb44c0ca483787ae7079d76: Bootstrap starting.
I20240502 01:59:19.456657 25258 tablet_bootstrap.cc:492] T c923accbe49f41d79979dec1b285286f P 3c1733fc9bc942268fb9a95e5b8fa14e: Bootstrap starting.
I20240502 01:59:19.457293 25257 tablet_bootstrap.cc:654] T 6f324f4f66d34721ab763250f04a352a P 987e3f475cb44c0ca483787ae7079d76: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:19.457592 25258 tablet_bootstrap.cc:654] T c923accbe49f41d79979dec1b285286f P 3c1733fc9bc942268fb9a95e5b8fa14e: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:19.458432 25257 tablet_bootstrap.cc:492] T 6f324f4f66d34721ab763250f04a352a P 987e3f475cb44c0ca483787ae7079d76: No bootstrap required, opened a new log
I20240502 01:59:19.458521 25257 ts_tablet_manager.cc:1367] T 6f324f4f66d34721ab763250f04a352a P 987e3f475cb44c0ca483787ae7079d76: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:19.458851 25258 tablet_bootstrap.cc:492] T c923accbe49f41d79979dec1b285286f P 3c1733fc9bc942268fb9a95e5b8fa14e: No bootstrap required, opened a new log
I20240502 01:59:19.458948 25258 ts_tablet_manager.cc:1367] T c923accbe49f41d79979dec1b285286f P 3c1733fc9bc942268fb9a95e5b8fa14e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:19.459044 25257 raft_consensus.cc:348] T 6f324f4f66d34721ab763250f04a352a P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:19.459151 25257 raft_consensus.cc:374] T 6f324f4f66d34721ab763250f04a352a P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:19.459188 25257 raft_consensus.cc:729] T 6f324f4f66d34721ab763250f04a352a P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 987e3f475cb44c0ca483787ae7079d76, State: Initialized, Role: FOLLOWER
I20240502 01:59:19.459311 25257 consensus_queue.cc:260] T 6f324f4f66d34721ab763250f04a352a P 987e3f475cb44c0ca483787ae7079d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:19.459394 25257 raft_consensus.cc:388] T 6f324f4f66d34721ab763250f04a352a P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:59:19.459440 25257 raft_consensus.cc:482] T 6f324f4f66d34721ab763250f04a352a P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:59:19.459439 25258 raft_consensus.cc:348] T c923accbe49f41d79979dec1b285286f P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:19.459491 25257 raft_consensus.cc:3037] T 6f324f4f66d34721ab763250f04a352a P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:19.459532 25258 raft_consensus.cc:374] T c923accbe49f41d79979dec1b285286f P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:19.459574 25258 raft_consensus.cc:729] T c923accbe49f41d79979dec1b285286f P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c1733fc9bc942268fb9a95e5b8fa14e, State: Initialized, Role: FOLLOWER
I20240502 01:59:19.459703 25258 consensus_queue.cc:260] T c923accbe49f41d79979dec1b285286f P 3c1733fc9bc942268fb9a95e5b8fa14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:19.459786 25258 raft_consensus.cc:388] T c923accbe49f41d79979dec1b285286f P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:59:19.459836 25258 raft_consensus.cc:482] T c923accbe49f41d79979dec1b285286f P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:59:19.459897 25258 raft_consensus.cc:3037] T c923accbe49f41d79979dec1b285286f P 3c1733fc9bc942268fb9a95e5b8fa14e [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:19.460577 25257 raft_consensus.cc:504] T 6f324f4f66d34721ab763250f04a352a P 987e3f475cb44c0ca483787ae7079d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:19.460721 25258 raft_consensus.cc:504] T c923accbe49f41d79979dec1b285286f P 3c1733fc9bc942268fb9a95e5b8fa14e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:19.460743 25257 leader_election.cc:302] T 6f324f4f66d34721ab763250f04a352a P 987e3f475cb44c0ca483787ae7079d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 987e3f475cb44c0ca483787ae7079d76; no voters:
I20240502 01:59:19.460840 25258 leader_election.cc:302] T c923accbe49f41d79979dec1b285286f P 3c1733fc9bc942268fb9a95e5b8fa14e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c1733fc9bc942268fb9a95e5b8fa14e; no voters:
I20240502 01:59:19.460842 25257 leader_election.cc:288] T 6f324f4f66d34721ab763250f04a352a P 987e3f475cb44c0ca483787ae7079d76 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:59:19.460901 25262 raft_consensus.cc:2781] T 6f324f4f66d34721ab763250f04a352a P 987e3f475cb44c0ca483787ae7079d76 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:19.460933 25258 leader_election.cc:288] T c923accbe49f41d79979dec1b285286f P 3c1733fc9bc942268fb9a95e5b8fa14e [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:59:19.460994 25262 raft_consensus.cc:686] T 6f324f4f66d34721ab763250f04a352a P 987e3f475cb44c0ca483787ae7079d76 [term 1 LEADER]: Becoming Leader. State: Replica: 987e3f475cb44c0ca483787ae7079d76, State: Running, Role: LEADER
I20240502 01:59:19.461058 25263 raft_consensus.cc:2781] T c923accbe49f41d79979dec1b285286f P 3c1733fc9bc942268fb9a95e5b8fa14e [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:19.461128 25263 raft_consensus.cc:686] T c923accbe49f41d79979dec1b285286f P 3c1733fc9bc942268fb9a95e5b8fa14e [term 1 LEADER]: Becoming Leader. State: Replica: 3c1733fc9bc942268fb9a95e5b8fa14e, State: Running, Role: LEADER
I20240502 01:59:19.461112 25262 consensus_queue.cc:237] T 6f324f4f66d34721ab763250f04a352a P 987e3f475cb44c0ca483787ae7079d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:19.461170 25257 ts_tablet_manager.cc:1398] T 6f324f4f66d34721ab763250f04a352a P 987e3f475cb44c0ca483787ae7079d76: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20240502 01:59:19.461232 25263 consensus_queue.cc:237] T c923accbe49f41d79979dec1b285286f P 3c1733fc9bc942268fb9a95e5b8fa14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } }
I20240502 01:59:19.461310 25257 tablet_bootstrap.cc:492] T 705838824da348b286275dc21c15f3d3 P 987e3f475cb44c0ca483787ae7079d76: Bootstrap starting.
I20240502 01:59:19.462242 25257 tablet_bootstrap.cc:654] T 705838824da348b286275dc21c15f3d3 P 987e3f475cb44c0ca483787ae7079d76: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:19.462493 24633 catalog_manager.cc:5484] T 6f324f4f66d34721ab763250f04a352a P 987e3f475cb44c0ca483787ae7079d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 987e3f475cb44c0ca483787ae7079d76 (127.10.133.194). New cstate: current_term: 1 leader_uuid: "987e3f475cb44c0ca483787ae7079d76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:19.462806 24634 catalog_manager.cc:5484] T c923accbe49f41d79979dec1b285286f P 3c1733fc9bc942268fb9a95e5b8fa14e reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c1733fc9bc942268fb9a95e5b8fa14e (127.10.133.193). New cstate: current_term: 1 leader_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c1733fc9bc942268fb9a95e5b8fa14e" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 41063 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:19.463482 25258 ts_tablet_manager.cc:1398] T c923accbe49f41d79979dec1b285286f P 3c1733fc9bc942268fb9a95e5b8fa14e: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20240502 01:59:19.464344 25257 tablet_bootstrap.cc:492] T 705838824da348b286275dc21c15f3d3 P 987e3f475cb44c0ca483787ae7079d76: No bootstrap required, opened a new log
I20240502 01:59:19.464424 25257 ts_tablet_manager.cc:1367] T 705838824da348b286275dc21c15f3d3 P 987e3f475cb44c0ca483787ae7079d76: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:59:19.465035 25257 raft_consensus.cc:348] T 705838824da348b286275dc21c15f3d3 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:19.465116 25257 raft_consensus.cc:374] T 705838824da348b286275dc21c15f3d3 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:19.465152 25257 raft_consensus.cc:729] T 705838824da348b286275dc21c15f3d3 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 987e3f475cb44c0ca483787ae7079d76, State: Initialized, Role: FOLLOWER
I20240502 01:59:19.465273 25257 consensus_queue.cc:260] T 705838824da348b286275dc21c15f3d3 P 987e3f475cb44c0ca483787ae7079d76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:19.465360 25257 raft_consensus.cc:388] T 705838824da348b286275dc21c15f3d3 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:59:19.465404 25257 raft_consensus.cc:482] T 705838824da348b286275dc21c15f3d3 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:59:19.465442 25257 raft_consensus.cc:3037] T 705838824da348b286275dc21c15f3d3 P 987e3f475cb44c0ca483787ae7079d76 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:19.466362 25257 raft_consensus.cc:504] T 705838824da348b286275dc21c15f3d3 P 987e3f475cb44c0ca483787ae7079d76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:19.466485 25257 leader_election.cc:302] T 705838824da348b286275dc21c15f3d3 P 987e3f475cb44c0ca483787ae7079d76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 987e3f475cb44c0ca483787ae7079d76; no voters:
I20240502 01:59:19.466595 25257 leader_election.cc:288] T 705838824da348b286275dc21c15f3d3 P 987e3f475cb44c0ca483787ae7079d76 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:59:19.466825 25257 ts_tablet_manager.cc:1398] T 705838824da348b286275dc21c15f3d3 P 987e3f475cb44c0ca483787ae7079d76: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:19.466956 25262 raft_consensus.cc:2781] T 705838824da348b286275dc21c15f3d3 P 987e3f475cb44c0ca483787ae7079d76 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:19.467020 25262 raft_consensus.cc:686] T 705838824da348b286275dc21c15f3d3 P 987e3f475cb44c0ca483787ae7079d76 [term 1 LEADER]: Becoming Leader. State: Replica: 987e3f475cb44c0ca483787ae7079d76, State: Running, Role: LEADER
I20240502 01:59:19.467110 25262 consensus_queue.cc:237] T 705838824da348b286275dc21c15f3d3 P 987e3f475cb44c0ca483787ae7079d76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } }
I20240502 01:59:19.468410 24633 catalog_manager.cc:5484] T 705838824da348b286275dc21c15f3d3 P 987e3f475cb44c0ca483787ae7079d76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 987e3f475cb44c0ca483787ae7079d76 (127.10.133.194). New cstate: current_term: 1 leader_uuid: "987e3f475cb44c0ca483787ae7079d76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "987e3f475cb44c0ca483787ae7079d76" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 42721 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:19.623966 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.195:43565
--local_ip_for_outbound_sockets=127.10.133.195
--tserver_master_addrs=127.10.133.254:41609
--webserver_port=35197
--webserver_interface=127.10.133.195
--builtin_ntp_servers=127.10.133.212:40993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 01:59:19.735875 25365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:19.736064 25365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:19.736107 25365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:19.739153 25365 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:19.739212 25365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:19.739274 25365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.195
I20240502 01:59:19.742725 25365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:40993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.195:43565
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.133.195
--webserver_port=35197
--tserver_master_addrs=127.10.133.254:41609
--never_fsync=true
--heap_profile_path=/tmp/kudu.25365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.195
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:19.743459 25365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:19.744449 25365 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:19.752440 25370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:19.753037 25373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:19.753592 25371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:19.754384 25365 server_base.cc:1034] running on GCE node
I20240502 01:59:19.754753 25365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:19.755339 25365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:19.756505 25365 hybrid_clock.cc:648] HybridClock initialized: now 1714615159756484 us; error 38 us; skew 500 ppm
I20240502 01:59:19.758213 25365 webserver.cc:460] Webserver started at http://127.10.133.195:35197/ using document root <none> and password file <none>
I20240502 01:59:19.758739 25365 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:19.758817 25365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:19.762077 25365 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20240502 01:59:19.764230 25379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:19.765154 25365 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:19.765267 25365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "8519b82a88b84d4b8aac813615eb1716"
format_stamp: "Formatted at 2024-05-02 01:59:14 on dist-test-slave-dr9f"
I20240502 01:59:19.765658 25365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:19.797672 25365 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:19.798316 25365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:19.798475 25365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:19.799000 25365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:19.799846 25365 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:19.799896 25365 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:19.799958 25365 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:19.799985 25365 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:19.808046 25365 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.195:43565
I20240502 01:59:19.808087 25495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.195:43565 every 8 connection(s)
I20240502 01:59:19.809070 25365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20240502 01:59:19.809830 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 25365
I20240502 01:59:19.810271 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.196:46667
--local_ip_for_outbound_sockets=127.10.133.196
--tserver_master_addrs=127.10.133.254:41609
--webserver_port=35143
--webserver_interface=127.10.133.196
--builtin_ntp_servers=127.10.133.212:40993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:59:19.819321 25496 heartbeater.cc:347] Connected to a master server at 127.10.133.254:41609
I20240502 01:59:19.819537 25496 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:19.820048 25496 heartbeater.cc:511] Master 127.10.133.254:41609 requested a full tablet report, sending...
I20240502 01:59:19.821141 24633 ts_manager.cc:194] Re-registered known tserver with Master: 8519b82a88b84d4b8aac813615eb1716 (127.10.133.195:43565)
I20240502 01:59:19.821691 24633 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.195:40543
W20240502 01:59:19.918749 25498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:19.918960 25498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:19.919008 25498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:19.922188 25498 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:19.922255 25498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:19.922359 25498 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.196
I20240502 01:59:19.925884 25498 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:40993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.196:46667
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.10.133.196
--webserver_port=35143
--tserver_master_addrs=127.10.133.254:41609
--never_fsync=true
--heap_profile_path=/tmp/kudu.25498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.196
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:19.926841 25498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:19.927978 25498 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:19.936136 25504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:19.936794 25505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:19.937373 25507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:19.938068 25498 server_base.cc:1034] running on GCE node
I20240502 01:59:19.938513 25498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:19.939096 25498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:19.940243 25498 hybrid_clock.cc:648] HybridClock initialized: now 1714615159940220 us; error 39 us; skew 500 ppm
I20240502 01:59:19.941939 25498 webserver.cc:460] Webserver started at http://127.10.133.196:35143/ using document root <none> and password file <none>
I20240502 01:59:19.942483 25498 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:19.942555 25498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:19.945812 25498 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20240502 01:59:19.947722 25513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:19.948675 25498 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20240502 01:59:19.948781 25498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "c5790b2af50b4c579e774d012bc0b2ef"
format_stamp: "Formatted at 2024-05-02 01:59:15 on dist-test-slave-dr9f"
I20240502 01:59:19.949182 25498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:19.961860 25498 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:19.962368 25498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:19.962540 25498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:19.963023 25498 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:19.964051 25520 ts_tablet_manager.cc:516] Loading tablet metadata (0/1 complete)
I20240502 01:59:19.967025 25498 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240502 01:59:19.967077 25498 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.003s user 0.000s sys 0.000s
I20240502 01:59:19.967142 25498 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240502 01:59:19.968577 25498 ts_tablet_manager.cc:590] Registered 1 tablets
I20240502 01:59:19.968622 25498 ts_tablet_manager.cc:569] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:19.968878 25520 tablet_bootstrap.cc:492] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef: Bootstrap starting.
I20240502 01:59:19.976768 25498 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.196:46667
I20240502 01:59:19.977021 25630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.196:46667 every 8 connection(s)
I20240502 01:59:19.977771 25498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20240502 01:59:19.984078 25520 log.cc:824] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:19.986109 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 25498
I20240502 01:59:19.986729 25520 tablet_bootstrap.cc:492] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:19.987080 25520 tablet_bootstrap.cc:492] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef: Bootstrap complete.
I20240502 01:59:19.987246 25631 heartbeater.cc:347] Connected to a master server at 127.10.133.254:41609
I20240502 01:59:19.987442 25631 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:19.988047 25631 heartbeater.cc:511] Master 127.10.133.254:41609 requested a full tablet report, sending...
I20240502 01:59:19.988386 25520 ts_tablet_manager.cc:1367] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef: Time spent bootstrapping tablet: real 0.020s user 0.012s sys 0.008s
I20240502 01:59:19.990219 24633 ts_manager.cc:194] Re-registered known tserver with Master: c5790b2af50b4c579e774d012bc0b2ef (127.10.133.196:46667)
I20240502 01:59:19.991181 24633 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.196:46279
I20240502 01:59:19.991498 25520 raft_consensus.cc:348] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5790b2af50b4c579e774d012bc0b2ef" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 46667 } }
I20240502 01:59:19.991901 25520 raft_consensus.cc:729] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5790b2af50b4c579e774d012bc0b2ef, State: Initialized, Role: FOLLOWER
I20240502 01:59:19.992357 25520 consensus_queue.cc:260] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5790b2af50b4c579e774d012bc0b2ef" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 46667 } }
I20240502 01:59:19.992496 25520 raft_consensus.cc:388] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:59:19.992564 25520 raft_consensus.cc:482] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:59:19.992677 25520 raft_consensus.cc:3037] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:59:19.994266 25520 raft_consensus.cc:504] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5790b2af50b4c579e774d012bc0b2ef" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 46667 } }
I20240502 01:59:19.994560 25520 leader_election.cc:302] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5790b2af50b4c579e774d012bc0b2ef; no voters:
I20240502 01:59:19.994803 25520 leader_election.cc:288] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 01:59:19.994925 25636 raft_consensus.cc:2781] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:59:19.995131 25636 raft_consensus.cc:686] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [term 2 LEADER]: Becoming Leader. State: Replica: c5790b2af50b4c579e774d012bc0b2ef, State: Running, Role: LEADER
I20240502 01:59:19.995410 25631 heartbeater.cc:503] Master 127.10.133.254:41609 was elected leader, sending a full tablet report...
I20240502 01:59:19.995466 25636 consensus_queue.cc:237] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5790b2af50b4c579e774d012bc0b2ef" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 46667 } }
I20240502 01:59:19.995574 25520 ts_tablet_manager.cc:1398] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20240502 01:59:19.997938 24633 catalog_manager.cc:5484] T 2a827761770248d480c49aa7199f48a3 P c5790b2af50b4c579e774d012bc0b2ef reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "c5790b2af50b4c579e774d012bc0b2ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5790b2af50b4c579e774d012bc0b2ef" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 46667 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:20.173744 24760 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:20.173934 24892 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:20.175896 25429 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:20.176060 25563 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:20.284096 25429 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:20.285159 24760 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:20.288070 25563 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:20.288903 24892 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:20.386844 24892 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:20.387143 24760 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:20.387151 25563 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:20.394868 25429 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
33424a7cfde840eebfbcb0c7edb140f1 | 127.10.133.254:41609 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
raft_prepare_replacement_before_eviction | true | experimental,advanced | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.133.212:40993 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
3c1733fc9bc942268fb9a95e5b8fa14e | 127.10.133.193:41063 | HEALTHY | <none> | 6 | 0
8519b82a88b84d4b8aac813615eb1716 | 127.10.133.195:43565 | HEALTHY | <none> | 0 | 0
987e3f475cb44c0ca483787ae7079d76 | 127.10.133.194:42721 | HEALTHY | <none> | 6 | 0
c5790b2af50b4c579e774d012bc0b2ef | 127.10.133.196:46667 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 4
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------------+-------------------------
ipki_server_key_size | 768 | experimental | all 4 server(s) checked
local_ip_for_outbound_sockets | 127.10.133.193 | experimental | 127.10.133.193:41063
local_ip_for_outbound_sockets | 127.10.133.194 | experimental | 127.10.133.194:42721
local_ip_for_outbound_sockets | 127.10.133.195 | experimental | 127.10.133.195:43565
local_ip_for_outbound_sockets | 127.10.133.196 | experimental | 127.10.133.196:46667
never_fsync | true | unsafe,advanced | all 4 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 4 server(s) checked
raft_prepare_replacement_before_eviction | true | experimental,advanced | all 4 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 4 server(s) checked
server_dump_info_format | pb | hidden | all 4 server(s) checked
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb | hidden | 127.10.133.193:41063
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb | hidden | 127.10.133.194:42721
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb | hidden | 127.10.133.195:43565
server_dump_info_path | /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove_5.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb | hidden | 127.10.133.196:46667
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.10.133.212:40993 | all 4 server(s) checked
time_source | builtin | all 4 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 5 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
------------------------+----+---------+---------------+---------+------------+------------------+-------------
TestTable | 1 | HEALTHY | 1 | 1 | 0 | 0 | 0
rebalance_test_table_0 | 1 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_1 | 1 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_2 | 1 | HEALTHY | 3 | 3 | 0 | 0 | 0
rebalance_test_table_3 | 1 | HEALTHY | 3 | 3 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 0
First Quartile | 1
Median | 6
Third Quartile | 6
Maximum | 6
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 4
Tables | 5
Tablets | 13
Replicas | 13
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20240502 01:59:20.415690 10775 log_verifier.cc:126] Checking tablet 014fc6a75bbd4078996f02d876ce652f
I20240502 01:59:20.423414 10775 log_verifier.cc:177] Verified matching terms for 2 ops in tablet 014fc6a75bbd4078996f02d876ce652f
I20240502 01:59:20.423470 10775 log_verifier.cc:126] Checking tablet 17c0e4b7b5c24e8fb417583ffc045876
I20240502 01:59:20.431140 10775 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 17c0e4b7b5c24e8fb417583ffc045876
I20240502 01:59:20.431196 10775 log_verifier.cc:126] Checking tablet 2a827761770248d480c49aa7199f48a3
I20240502 01:59:20.438597 10775 log_verifier.cc:177] Verified matching terms for 2 ops in tablet 2a827761770248d480c49aa7199f48a3
I20240502 01:59:20.438685 10775 log_verifier.cc:126] Checking tablet 6f324f4f66d34721ab763250f04a352a
I20240502 01:59:20.446244 10775 log_verifier.cc:177] Verified matching terms for 2 ops in tablet 6f324f4f66d34721ab763250f04a352a
I20240502 01:59:20.446301 10775 log_verifier.cc:126] Checking tablet 705838824da348b286275dc21c15f3d3
I20240502 01:59:20.453713 10775 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 705838824da348b286275dc21c15f3d3
I20240502 01:59:20.453771 10775 log_verifier.cc:126] Checking tablet 8075806cbb3a4f4faac517a9761bd2d2
I20240502 01:59:20.461262 10775 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 8075806cbb3a4f4faac517a9761bd2d2
I20240502 01:59:20.461313 10775 log_verifier.cc:126] Checking tablet 928b8eba2b744c56a9c6e7ee77020f50
I20240502 01:59:20.468640 10775 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 928b8eba2b744c56a9c6e7ee77020f50
I20240502 01:59:20.468705 10775 log_verifier.cc:126] Checking tablet 9d45c5c342d94c2196c01419e3642df8
I20240502 01:59:20.477008 10775 log_verifier.cc:177] Verified matching terms for 1 ops in tablet 9d45c5c342d94c2196c01419e3642df8
I20240502 01:59:20.477062 10775 log_verifier.cc:126] Checking tablet a06ac859705e421baf335ac7a1066f02
I20240502 01:59:20.484382 10775 log_verifier.cc:177] Verified matching terms for 1 ops in tablet a06ac859705e421baf335ac7a1066f02
I20240502 01:59:20.484439 10775 log_verifier.cc:126] Checking tablet bc941c18840c46b0be6e29b6e0bdbea7
I20240502 01:59:20.492049 10775 log_verifier.cc:177] Verified matching terms for 2 ops in tablet bc941c18840c46b0be6e29b6e0bdbea7
I20240502 01:59:20.492106 10775 log_verifier.cc:126] Checking tablet c751c51bf8154df89ca66cc2b159dbe2
I20240502 01:59:20.499584 10775 log_verifier.cc:177] Verified matching terms for 2 ops in tablet c751c51bf8154df89ca66cc2b159dbe2
I20240502 01:59:20.499663 10775 log_verifier.cc:126] Checking tablet c923accbe49f41d79979dec1b285286f
I20240502 01:59:20.506734 10775 log_verifier.cc:177] Verified matching terms for 1 ops in tablet c923accbe49f41d79979dec1b285286f
I20240502 01:59:20.506786 10775 log_verifier.cc:126] Checking tablet cd3ec3faa6cc491480960de0b6962eb9
I20240502 01:59:20.513820 10775 log_verifier.cc:177] Verified matching terms for 1 ops in tablet cd3ec3faa6cc491480960de0b6962eb9
I20240502 01:59:20.514256 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 24696
I20240502 01:59:20.520961 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 24830
I20240502 01:59:20.527042 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 25365
I20240502 01:59:20.532296 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 25498
I20240502 01:59:20.538038 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 24603
2024-05-02T01:59:20Z chronyd exiting
[ OK ] RebalancerAndSingleReplicaTablets.SingleReplicasStayOrMove/5 (6434 ms)
[----------] 1 test from RebalancerAndSingleReplicaTablets (6434 ms total)
[----------] 2 tests from LocationAwareRebalancingParamTest
[ RUN ] LocationAwareRebalancingParamTest.Rebalance/idx7_rf2_t3_l_1_2_1
I20240502 01:59:20.571826 10775 test_util.cc:268] Using random seed: -208500819
I20240502 01:59:20.572588 10775 ts_itest-base.cc:112] Starting cluster with:
I20240502 01:59:20.572633 10775 ts_itest-base.cc:113] --------------
I20240502 01:59:20.572645 10775 ts_itest-base.cc:114] 4 tablet servers
I20240502 01:59:20.572655 10775 ts_itest-base.cc:115] 2 replicas per TS
I20240502 01:59:20.572665 10775 ts_itest-base.cc:116] --------------
2024-05-02T01:59:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T01:59:20Z Disabled control of system clock
I20240502 01:59:20.581068 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.133.254:40621
--webserver_interface=127.10.133.254
--webserver_port=0
--builtin_ntp_servers=127.10.133.212:41979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.133.254:40621
--location_mapping_cmd=/tmp/dist-test-taskVdqkLT/build/debug/bin/testdata/assign-location.py --state_store=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/location-assignment.state --map /A:1 --map /B:2 --map /C:1
--tserver_unresponsive_timeout_ms=3000
--enable_range_replica_placement=false
--raft_prepare_replacement_before_eviction=true
--enable_range_replica_placement=false
--master_client_location_assignment_enabled=false
--allow_unsafe_replication_factor with env {}
W20240502 01:59:20.684221 25750 flags.cc:425] Enabled unsafe flag: --allow_unsafe_replication_factor=true
W20240502 01:59:20.684474 25750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:20.684500 25750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:20.684537 25750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:20.687471 25750 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:20.687534 25750 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 01:59:20.687559 25750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:20.687577 25750 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 01:59:20.687592 25750 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 01:59:20.691005 25750 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:41979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
--allow_unsafe_replication_factor=true
--enable_range_replica_placement=false
--location_mapping_cmd=/tmp/dist-test-taskVdqkLT/build/debug/bin/testdata/assign-location.py --state_store=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/location-assignment.state --map /A:1 --map /B:2 --map /C:1
--ipki_ca_key_size=768
--master_addresses=127.10.133.254:40621
--tserver_unresponsive_timeout_ms=3000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.133.254:40621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.133.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.25750
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:20.691833 25750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:20.692847 25750 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:20.699961 25758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:20.700517 25756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:20.701246 25755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:20.701901 25750 server_base.cc:1034] running on GCE node
I20240502 01:59:20.702401 25750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:20.703229 25750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:20.704362 25750 hybrid_clock.cc:648] HybridClock initialized: now 1714615160704346 us; error 32 us; skew 500 ppm
I20240502 01:59:20.706254 25750 webserver.cc:460] Webserver started at http://127.10.133.254:45309/ using document root <none> and password file <none>
I20240502 01:59:20.706782 25750 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:20.706851 25750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:20.707024 25750 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:20.708544 25750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "78c3b7bff4944f48bda2062edcd9e868"
format_stamp: "Formatted at 2024-05-02 01:59:20 on dist-test-slave-dr9f"
I20240502 01:59:20.708995 25750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "78c3b7bff4944f48bda2062edcd9e868"
format_stamp: "Formatted at 2024-05-02 01:59:20 on dist-test-slave-dr9f"
I20240502 01:59:20.712190 25750 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20240502 01:59:20.714195 25764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:20.715104 25750 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:20.715210 25750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
uuid: "78c3b7bff4944f48bda2062edcd9e868"
format_stamp: "Formatted at 2024-05-02 01:59:20 on dist-test-slave-dr9f"
I20240502 01:59:20.715298 25750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:20.728055 25750 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:20.728567 25750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:20.728698 25750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:20.735170 25750 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.254:40621
I20240502 01:59:20.735188 25817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.254:40621 every 8 connection(s)
I20240502 01:59:20.736099 25750 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20240502 01:59:20.738538 25818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:20.743340 25818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868: Bootstrap starting.
I20240502 01:59:20.745419 25818 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:20.745916 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 25750
I20240502 01:59:20.746075 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal/instance
I20240502 01:59:20.746201 25818 log.cc:824] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:20.747887 25818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868: No bootstrap required, opened a new log
I20240502 01:59:20.750413 25818 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78c3b7bff4944f48bda2062edcd9e868" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 40621 } }
I20240502 01:59:20.750574 25818 raft_consensus.cc:374] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:20.750628 25818 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78c3b7bff4944f48bda2062edcd9e868, State: Initialized, Role: FOLLOWER
I20240502 01:59:20.751040 25818 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78c3b7bff4944f48bda2062edcd9e868" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 40621 } }
I20240502 01:59:20.751166 25818 raft_consensus.cc:388] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:59:20.751226 25818 raft_consensus.cc:482] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:59:20.751332 25818 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:20.752032 25818 raft_consensus.cc:504] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78c3b7bff4944f48bda2062edcd9e868" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 40621 } }
I20240502 01:59:20.752328 25818 leader_election.cc:302] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78c3b7bff4944f48bda2062edcd9e868; no voters:
I20240502 01:59:20.752593 25818 leader_election.cc:288] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:59:20.753043 25823 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:20.753222 25823 raft_consensus.cc:686] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868 [term 1 LEADER]: Becoming Leader. State: Replica: 78c3b7bff4944f48bda2062edcd9e868, State: Running, Role: LEADER
I20240502 01:59:20.753494 25823 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78c3b7bff4944f48bda2062edcd9e868" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 40621 } }
I20240502 01:59:20.753649 25818 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 01:59:20.754909 25824 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "78c3b7bff4944f48bda2062edcd9e868" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78c3b7bff4944f48bda2062edcd9e868" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 40621 } } }
I20240502 01:59:20.755008 25824 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868 [sys.catalog]: This master's current role is: LEADER
I20240502 01:59:20.755286 25825 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78c3b7bff4944f48bda2062edcd9e868. Latest consensus state: current_term: 1 leader_uuid: "78c3b7bff4944f48bda2062edcd9e868" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78c3b7bff4944f48bda2062edcd9e868" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 40621 } } }
I20240502 01:59:20.755373 25825 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868 [sys.catalog]: This master's current role is: LEADER
I20240502 01:59:20.755451 25834 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 01:59:20.757906 25834 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 01:59:20.762547 25834 catalog_manager.cc:1347] Generated new cluster ID: 6474f4ad2dc74540a5a24133259c4f8c
I20240502 01:59:20.762612 25834 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 01:59:20.790282 25834 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 01:59:20.791481 25834 catalog_manager.cc:1504] Loading token signing keys...
I20240502 01:59:20.798492 25834 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 78c3b7bff4944f48bda2062edcd9e868: Generated new TSK 0
I20240502 01:59:20.799166 25834 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 01:59:20.810168 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.193:0
--local_ip_for_outbound_sockets=127.10.133.193
--webserver_interface=127.10.133.193
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40621
--builtin_ntp_servers=127.10.133.212:41979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 01:59:20.915233 25843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:20.915454 25843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:20.915498 25843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:20.918493 25843 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:20.918555 25843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:20.918625 25843 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.193
I20240502 01:59:20.922166 25843 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:41979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.133.193
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40621
--never_fsync=true
--heap_profile_path=/tmp/kudu.25843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.193
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:20.922962 25843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:20.924010 25843 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:20.932252 25851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:20.932644 25848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:20.933348 25849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:20.934026 25843 server_base.cc:1034] running on GCE node
I20240502 01:59:20.934347 25843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:20.934828 25843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:20.935971 25843 hybrid_clock.cc:648] HybridClock initialized: now 1714615160935947 us; error 39 us; skew 500 ppm
I20240502 01:59:20.941538 25843 webserver.cc:460] Webserver started at http://127.10.133.193:37619/ using document root <none> and password file <none>
I20240502 01:59:20.942129 25843 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:20.942188 25843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:20.942365 25843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:20.943934 25843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "05e040a7804046ac81822a0ec26a69ed"
format_stamp: "Formatted at 2024-05-02 01:59:20 on dist-test-slave-dr9f"
I20240502 01:59:20.944343 25843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "05e040a7804046ac81822a0ec26a69ed"
format_stamp: "Formatted at 2024-05-02 01:59:20 on dist-test-slave-dr9f"
I20240502 01:59:20.947623 25843 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 01:59:20.949585 25857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:20.950628 25843 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:20.950732 25843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "05e040a7804046ac81822a0ec26a69ed"
format_stamp: "Formatted at 2024-05-02 01:59:20 on dist-test-slave-dr9f"
I20240502 01:59:20.950809 25843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:20.976151 25843 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:20.976708 25843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:20.976867 25843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:20.977356 25843 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:20.978196 25843 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:20.978245 25843 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:20.978304 25843 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:20.978329 25843 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:20.986605 25843 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.193:38177
I20240502 01:59:20.986636 25972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.193:38177 every 8 connection(s)
I20240502 01:59:20.987473 25843 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20240502 01:59:20.995595 25973 heartbeater.cc:347] Connected to a master server at 127.10.133.254:40621
I20240502 01:59:20.995790 25973 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:20.996191 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 25843
I20240502 01:59:20.996239 25973 heartbeater.cc:511] Master 127.10.133.254:40621 requested a full tablet report, sending...
I20240502 01:59:20.996313 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20240502 01:59:21.000319 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.194:0
--local_ip_for_outbound_sockets=127.10.133.194
--webserver_interface=127.10.133.194
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40621
--builtin_ntp_servers=127.10.133.212:41979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:59:21.048638 25781 ts_manager.cc:194] Registered new tserver with Master: 05e040a7804046ac81822a0ec26a69ed (127.10.133.193:38177)
I20240502 01:59:21.050804 25781 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.193:57453
W20240502 01:59:21.121477 25977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:21.121706 25977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:21.121764 25977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:21.124712 25977 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:21.124768 25977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:21.124828 25977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.194
I20240502 01:59:21.128163 25977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:41979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.133.194
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40621
--never_fsync=true
--heap_profile_path=/tmp/kudu.25977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.194
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:21.128926 25977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:21.129942 25977 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:21.137823 25983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:21.138322 25982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:21.139022 25985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:21.139650 25977 server_base.cc:1034] running on GCE node
I20240502 01:59:21.140038 25977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:21.140537 25977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:21.141706 25977 hybrid_clock.cc:648] HybridClock initialized: now 1714615161141683 us; error 34 us; skew 500 ppm
I20240502 01:59:21.143494 25977 webserver.cc:460] Webserver started at http://127.10.133.194:35593/ using document root <none> and password file <none>
I20240502 01:59:21.144013 25977 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:21.144073 25977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:21.144237 25977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:21.145766 25977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6"
format_stamp: "Formatted at 2024-05-02 01:59:21 on dist-test-slave-dr9f"
I20240502 01:59:21.146248 25977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6"
format_stamp: "Formatted at 2024-05-02 01:59:21 on dist-test-slave-dr9f"
I20240502 01:59:21.149277 25977 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s
I20240502 01:59:21.151362 25991 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:21.152299 25977 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:21.152401 25977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6"
format_stamp: "Formatted at 2024-05-02 01:59:21 on dist-test-slave-dr9f"
I20240502 01:59:21.152482 25977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:21.168880 25977 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:21.169395 25977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:21.169561 25977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:21.170089 25977 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:21.170892 25977 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:21.170939 25977 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:21.170996 25977 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:21.171025 25977 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:21.179340 25977 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.194:46463
I20240502 01:59:21.179368 26104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.194:46463 every 8 connection(s)
I20240502 01:59:21.180202 25977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20240502 01:59:21.186776 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 25977
I20240502 01:59:21.186928 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20240502 01:59:21.188472 26105 heartbeater.cc:347] Connected to a master server at 127.10.133.254:40621
I20240502 01:59:21.188714 26105 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:21.189153 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.195:0
--local_ip_for_outbound_sockets=127.10.133.195
--webserver_interface=127.10.133.195
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40621
--builtin_ntp_servers=127.10.133.212:41979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:59:21.189327 26105 heartbeater.cc:511] Master 127.10.133.254:40621 requested a full tablet report, sending...
I20240502 01:59:21.222533 25781 ts_manager.cc:194] Registered new tserver with Master: cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194:46463)
I20240502 01:59:21.223271 25781 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.194:47845
W20240502 01:59:21.291702 26108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:21.291913 26108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:21.291989 26108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:21.294989 26108 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:21.295055 26108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:21.295181 26108 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.195
I20240502 01:59:21.298790 26108 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:41979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.133.195
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40621
--never_fsync=true
--heap_profile_path=/tmp/kudu.26108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.195
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:21.299523 26108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:21.300540 26108 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:21.308465 26114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:21.309196 26115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:21.309695 26117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:21.310353 26108 server_base.cc:1034] running on GCE node
I20240502 01:59:21.310675 26108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:21.311211 26108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:21.312358 26108 hybrid_clock.cc:648] HybridClock initialized: now 1714615161312338 us; error 34 us; skew 500 ppm
I20240502 01:59:21.314122 26108 webserver.cc:460] Webserver started at http://127.10.133.195:34417/ using document root <none> and password file <none>
I20240502 01:59:21.314615 26108 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:21.314673 26108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:21.314877 26108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:21.316375 26108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "d7706cd297b24c5e9919098d0fd279f8"
format_stamp: "Formatted at 2024-05-02 01:59:21 on dist-test-slave-dr9f"
I20240502 01:59:21.316802 26108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "d7706cd297b24c5e9919098d0fd279f8"
format_stamp: "Formatted at 2024-05-02 01:59:21 on dist-test-slave-dr9f"
I20240502 01:59:21.319978 26108 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20240502 01:59:21.321892 26123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:21.322836 26108 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20240502 01:59:21.322928 26108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "d7706cd297b24c5e9919098d0fd279f8"
format_stamp: "Formatted at 2024-05-02 01:59:21 on dist-test-slave-dr9f"
I20240502 01:59:21.322995 26108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:21.343732 26108 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:21.344195 26108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:21.344312 26108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:21.344765 26108 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:21.345552 26108 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:21.345595 26108 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:21.345638 26108 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:21.345667 26108 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:21.353569 26108 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.195:36453
I20240502 01:59:21.353618 26240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.195:36453 every 8 connection(s)
I20240502 01:59:21.354450 26108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20240502 01:59:21.354638 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 26108
I20240502 01:59:21.354760 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20240502 01:59:21.357125 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.196:0
--local_ip_for_outbound_sockets=127.10.133.196
--webserver_interface=127.10.133.196
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40621
--builtin_ntp_servers=127.10.133.212:41979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:59:21.363041 26241 heartbeater.cc:347] Connected to a master server at 127.10.133.254:40621
I20240502 01:59:21.363231 26241 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:21.363692 26241 heartbeater.cc:511] Master 127.10.133.254:40621 requested a full tablet report, sending...
I20240502 01:59:21.399760 25781 ts_manager.cc:194] Registered new tserver with Master: d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195:36453)
I20240502 01:59:21.400741 25781 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.195:32997
W20240502 01:59:21.464668 26244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:21.464888 26244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:21.464937 26244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:21.467963 26244 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:21.468025 26244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:21.468091 26244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.196
I20240502 01:59:21.471740 26244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:41979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.196:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.10.133.196
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40621
--never_fsync=true
--heap_profile_path=/tmp/kudu.26244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.196
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:21.472512 26244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:21.473588 26244 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:21.481878 26251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:21.482434 26252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:21.483012 26254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:21.483846 26244 server_base.cc:1034] running on GCE node
I20240502 01:59:21.484232 26244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:21.484766 26244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:21.485960 26244 hybrid_clock.cc:648] HybridClock initialized: now 1714615161485935 us; error 42 us; skew 500 ppm
I20240502 01:59:21.487823 26244 webserver.cc:460] Webserver started at http://127.10.133.196:41785/ using document root <none> and password file <none>
I20240502 01:59:21.488387 26244 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:21.488458 26244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:21.488613 26244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:21.490186 26244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "766ec478e3fd41d19e1fcad9881b721d"
format_stamp: "Formatted at 2024-05-02 01:59:21 on dist-test-slave-dr9f"
I20240502 01:59:21.490600 26244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "766ec478e3fd41d19e1fcad9881b721d"
format_stamp: "Formatted at 2024-05-02 01:59:21 on dist-test-slave-dr9f"
I20240502 01:59:21.493800 26244 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20240502 01:59:21.495827 26260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:21.496768 26244 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20240502 01:59:21.496861 26244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "766ec478e3fd41d19e1fcad9881b721d"
format_stamp: "Formatted at 2024-05-02 01:59:21 on dist-test-slave-dr9f"
I20240502 01:59:21.496933 26244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:21.516881 26244 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:21.517553 26244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:21.517684 26244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:21.518199 26244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:21.519335 26244 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:21.519395 26244 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:21.519461 26244 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:21.519490 26244 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:21.527451 26377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.196:45865 every 8 connection(s)
I20240502 01:59:21.527433 26244 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.196:45865
I20240502 01:59:21.528375 26244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20240502 01:59:21.533111 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 26244
I20240502 01:59:21.533247 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20240502 01:59:21.536921 26378 heartbeater.cc:347] Connected to a master server at 127.10.133.254:40621
I20240502 01:59:21.537094 26378 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:21.537544 26378 heartbeater.cc:511] Master 127.10.133.254:40621 requested a full tablet report, sending...
I20240502 01:59:21.571381 25781 ts_manager.cc:194] Registered new tserver with Master: 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196:45865)
I20240502 01:59:21.572134 25781 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.196:36883
I20240502 01:59:21.582551 10775 external_mini_cluster.cc:930] 4 TS(s) registered with all masters
I20240502 01:59:21.591683 10775 external_mini_cluster.cc:930] 4 TS(s) registered with all masters
I20240502 01:59:21.591760 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 25977
I20240502 01:59:21.598039 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 26108
I20240502 01:59:22.053946 25973 heartbeater.cc:503] Master 127.10.133.254:40621 was elected leader, sending a full tablet report...
I20240502 01:59:22.574390 26378 heartbeater.cc:503] Master 127.10.133.254:40621 was elected leader, sending a full tablet report...
I20240502 01:59:25.355476 25781 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38544:
name: "rebalance_test_table_0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20240502 01:59:25.358597 25781 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_0 in case of a server failure: 3 tablet servers would be needed, 2 are available. Consider bringing up more tablet servers.
I20240502 01:59:25.373852 25905 tablet_service.cc:1467] Processing CreateTablet for tablet adc6a6b402bf488c9f8ff21ecbaf3385 (DEFAULT_TABLE table=rebalance_test_table_0 [id=bad97e39292c4a02a01b4d1cd61076fb]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:25.373849 26308 tablet_service.cc:1467] Processing CreateTablet for tablet 4c474cfa879341b7b0957ee409376bab (DEFAULT_TABLE table=rebalance_test_table_0 [id=bad97e39292c4a02a01b4d1cd61076fb]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:25.374531 25903 tablet_service.cc:1467] Processing CreateTablet for tablet bcde951dca1f4523bda405738474b88f (DEFAULT_TABLE table=rebalance_test_table_0 [id=bad97e39292c4a02a01b4d1cd61076fb]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:25.374161 25904 tablet_service.cc:1467] Processing CreateTablet for tablet 4c474cfa879341b7b0957ee409376bab (DEFAULT_TABLE table=rebalance_test_table_0 [id=bad97e39292c4a02a01b4d1cd61076fb]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:25.374861 26308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c474cfa879341b7b0957ee409376bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:25.374861 25905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adc6a6b402bf488c9f8ff21ecbaf3385. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:25.373849 26307 tablet_service.cc:1467] Processing CreateTablet for tablet bcde951dca1f4523bda405738474b88f (DEFAULT_TABLE table=rebalance_test_table_0 [id=bad97e39292c4a02a01b4d1cd61076fb]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:25.373849 26309 tablet_service.cc:1467] Processing CreateTablet for tablet adc6a6b402bf488c9f8ff21ecbaf3385 (DEFAULT_TABLE table=rebalance_test_table_0 [id=bad97e39292c4a02a01b4d1cd61076fb]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:25.375180 26307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcde951dca1f4523bda405738474b88f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:25.375468 25903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcde951dca1f4523bda405738474b88f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:25.376034 25904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c474cfa879341b7b0957ee409376bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:25.376530 26309 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adc6a6b402bf488c9f8ff21ecbaf3385. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:25.381222 26396 tablet_bootstrap.cc:492] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed: Bootstrap starting.
I20240502 01:59:25.383277 26396 tablet_bootstrap.cc:654] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:25.384088 26396 log.cc:824] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:25.384485 26395 tablet_bootstrap.cc:492] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d: Bootstrap starting.
I20240502 01:59:25.385622 26396 tablet_bootstrap.cc:492] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed: No bootstrap required, opened a new log
I20240502 01:59:25.385778 26396 ts_tablet_manager.cc:1367] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20240502 01:59:25.386206 26395 tablet_bootstrap.cc:654] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:25.387112 26395 log.cc:824] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:25.388525 26395 tablet_bootstrap.cc:492] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d: No bootstrap required, opened a new log
I20240502 01:59:25.388695 26395 ts_tablet_manager.cc:1367] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 01:59:25.388631 26396 raft_consensus.cc:348] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:25.388823 26396 raft_consensus.cc:374] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:25.388896 26396 raft_consensus.cc:729] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05e040a7804046ac81822a0ec26a69ed, State: Initialized, Role: FOLLOWER
I20240502 01:59:25.389351 26396 consensus_queue.cc:260] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:25.390143 26396 ts_tablet_manager.cc:1398] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20240502 01:59:25.390364 26396 tablet_bootstrap.cc:492] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed: Bootstrap starting.
I20240502 01:59:25.391189 26396 tablet_bootstrap.cc:654] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:25.391599 26395 raft_consensus.cc:348] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.391762 26395 raft_consensus.cc:374] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:25.391834 26395 raft_consensus.cc:729] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 766ec478e3fd41d19e1fcad9881b721d, State: Initialized, Role: FOLLOWER
I20240502 01:59:25.392228 26395 consensus_queue.cc:260] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.392522 26396 tablet_bootstrap.cc:492] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed: No bootstrap required, opened a new log
I20240502 01:59:25.392633 26396 ts_tablet_manager.cc:1367] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:25.393081 26395 ts_tablet_manager.cc:1398] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20240502 01:59:25.393412 26395 tablet_bootstrap.cc:492] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d: Bootstrap starting.
I20240502 01:59:25.394060 26396 raft_consensus.cc:348] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.394163 26396 raft_consensus.cc:374] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:25.394201 26396 raft_consensus.cc:729] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05e040a7804046ac81822a0ec26a69ed, State: Initialized, Role: FOLLOWER
I20240502 01:59:25.394354 26395 tablet_bootstrap.cc:654] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:25.394311 26396 consensus_queue.cc:260] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.394695 26396 ts_tablet_manager.cc:1398] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:25.394884 26396 tablet_bootstrap.cc:492] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed: Bootstrap starting.
I20240502 01:59:25.395531 26395 tablet_bootstrap.cc:492] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d: No bootstrap required, opened a new log
I20240502 01:59:25.395612 26395 ts_tablet_manager.cc:1367] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:25.395751 26396 tablet_bootstrap.cc:654] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:25.396214 26395 raft_consensus.cc:348] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.396322 26395 raft_consensus.cc:374] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:25.396363 26395 raft_consensus.cc:729] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 766ec478e3fd41d19e1fcad9881b721d, State: Initialized, Role: FOLLOWER
I20240502 01:59:25.396503 26395 consensus_queue.cc:260] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.396889 26395 ts_tablet_manager.cc:1398] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:25.397053 26395 tablet_bootstrap.cc:492] T bcde951dca1f4523bda405738474b88f P 766ec478e3fd41d19e1fcad9881b721d: Bootstrap starting.
I20240502 01:59:25.397804 26395 tablet_bootstrap.cc:654] T bcde951dca1f4523bda405738474b88f P 766ec478e3fd41d19e1fcad9881b721d: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:25.397836 26396 tablet_bootstrap.cc:492] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed: No bootstrap required, opened a new log
I20240502 01:59:25.397930 26396 ts_tablet_manager.cc:1367] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:59:25.398425 26396 raft_consensus.cc:348] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.398557 26396 raft_consensus.cc:374] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:25.398602 26396 raft_consensus.cc:729] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05e040a7804046ac81822a0ec26a69ed, State: Initialized, Role: FOLLOWER
I20240502 01:59:25.398725 26396 consensus_queue.cc:260] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.398906 26395 tablet_bootstrap.cc:492] T bcde951dca1f4523bda405738474b88f P 766ec478e3fd41d19e1fcad9881b721d: No bootstrap required, opened a new log
I20240502 01:59:25.398977 26396 ts_tablet_manager.cc:1398] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:25.398993 26395 ts_tablet_manager.cc:1367] T bcde951dca1f4523bda405738474b88f P 766ec478e3fd41d19e1fcad9881b721d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240502 01:59:25.399411 26395 raft_consensus.cc:348] T bcde951dca1f4523bda405738474b88f P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:25.399516 26395 raft_consensus.cc:374] T bcde951dca1f4523bda405738474b88f P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:25.399551 26395 raft_consensus.cc:729] T bcde951dca1f4523bda405738474b88f P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 766ec478e3fd41d19e1fcad9881b721d, State: Initialized, Role: FOLLOWER
I20240502 01:59:25.399696 26395 consensus_queue.cc:260] T bcde951dca1f4523bda405738474b88f P 766ec478e3fd41d19e1fcad9881b721d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:25.399948 26395 ts_tablet_manager.cc:1398] T bcde951dca1f4523bda405738474b88f P 766ec478e3fd41d19e1fcad9881b721d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:25.465423 26399 raft_consensus.cc:482] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:25.465638 26399 raft_consensus.cc:504] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.466661 26399 leader_election.cc:288] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196:45865)
I20240502 01:59:25.470750 26329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc6a6b402bf488c9f8ff21ecbaf3385" candidate_uuid: "05e040a7804046ac81822a0ec26a69ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766ec478e3fd41d19e1fcad9881b721d" is_pre_election: true
I20240502 01:59:25.471012 26329 raft_consensus.cc:2454] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05e040a7804046ac81822a0ec26a69ed in term 0.
I20240502 01:59:25.471424 25858 leader_election.cc:302] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 05e040a7804046ac81822a0ec26a69ed, 766ec478e3fd41d19e1fcad9881b721d; no voters:
I20240502 01:59:25.471690 26399 raft_consensus.cc:2781] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:25.471769 26399 raft_consensus.cc:482] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:25.471800 26399 raft_consensus.cc:3037] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:25.472748 26399 raft_consensus.cc:504] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.473042 26399 leader_election.cc:288] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 election: Requested vote from peers 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196:45865)
I20240502 01:59:25.473421 26329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc6a6b402bf488c9f8ff21ecbaf3385" candidate_uuid: "05e040a7804046ac81822a0ec26a69ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766ec478e3fd41d19e1fcad9881b721d"
I20240502 01:59:25.473543 26329 raft_consensus.cc:3037] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:25.474433 26329 raft_consensus.cc:2454] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05e040a7804046ac81822a0ec26a69ed in term 1.
I20240502 01:59:25.474742 25858 leader_election.cc:302] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 05e040a7804046ac81822a0ec26a69ed, 766ec478e3fd41d19e1fcad9881b721d; no voters:
I20240502 01:59:25.474939 26399 raft_consensus.cc:2781] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:25.475168 26399 raft_consensus.cc:686] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Becoming Leader. State: Replica: 05e040a7804046ac81822a0ec26a69ed, State: Running, Role: LEADER
I20240502 01:59:25.475456 26399 consensus_queue.cc:237] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.478410 25779 catalog_manager.cc:5484] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 05e040a7804046ac81822a0ec26a69ed (127.10.133.193). New cstate: current_term: 1 leader_uuid: "05e040a7804046ac81822a0ec26a69ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } health_report { overall_health: UNKNOWN } } }
W20240502 01:59:25.491915 25974 tablet.cc:2369] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 01:59:25.532572 26379 tablet.cc:2369] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 01:59:25.580577 26399 raft_consensus.cc:482] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:25.580736 26399 raft_consensus.cc:504] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:25.581143 26399 leader_election.cc:288] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196:45865)
I20240502 01:59:25.581673 26329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcde951dca1f4523bda405738474b88f" candidate_uuid: "05e040a7804046ac81822a0ec26a69ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766ec478e3fd41d19e1fcad9881b721d" is_pre_election: true
I20240502 01:59:25.581818 26329 raft_consensus.cc:2454] T bcde951dca1f4523bda405738474b88f P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05e040a7804046ac81822a0ec26a69ed in term 0.
I20240502 01:59:25.582149 25858 leader_election.cc:302] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 05e040a7804046ac81822a0ec26a69ed, 766ec478e3fd41d19e1fcad9881b721d; no voters:
I20240502 01:59:25.582345 26399 raft_consensus.cc:2781] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:25.582402 26399 raft_consensus.cc:482] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:25.582432 26399 raft_consensus.cc:3037] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:25.583254 26399 raft_consensus.cc:504] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:25.583511 26399 leader_election.cc:288] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 election: Requested vote from peers 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196:45865)
I20240502 01:59:25.583897 26329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcde951dca1f4523bda405738474b88f" candidate_uuid: "05e040a7804046ac81822a0ec26a69ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766ec478e3fd41d19e1fcad9881b721d"
I20240502 01:59:25.584007 26329 raft_consensus.cc:3037] T bcde951dca1f4523bda405738474b88f P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:25.584816 26329 raft_consensus.cc:2454] T bcde951dca1f4523bda405738474b88f P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05e040a7804046ac81822a0ec26a69ed in term 1.
I20240502 01:59:25.585116 25858 leader_election.cc:302] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 05e040a7804046ac81822a0ec26a69ed, 766ec478e3fd41d19e1fcad9881b721d; no voters:
I20240502 01:59:25.585292 26399 raft_consensus.cc:2781] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:25.585397 26399 raft_consensus.cc:686] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Becoming Leader. State: Replica: 05e040a7804046ac81822a0ec26a69ed, State: Running, Role: LEADER
I20240502 01:59:25.585546 26399 consensus_queue.cc:237] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:25.587167 25779 catalog_manager.cc:5484] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 05e040a7804046ac81822a0ec26a69ed (127.10.133.193). New cstate: current_term: 1 leader_uuid: "05e040a7804046ac81822a0ec26a69ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:25.602658 26399 raft_consensus.cc:482] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:25.602771 26399 raft_consensus.cc:504] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.603097 26399 leader_election.cc:288] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196:45865)
I20240502 01:59:25.603554 26329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c474cfa879341b7b0957ee409376bab" candidate_uuid: "05e040a7804046ac81822a0ec26a69ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766ec478e3fd41d19e1fcad9881b721d" is_pre_election: true
I20240502 01:59:25.603706 26329 raft_consensus.cc:2454] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05e040a7804046ac81822a0ec26a69ed in term 0.
I20240502 01:59:25.603971 25858 leader_election.cc:302] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 05e040a7804046ac81822a0ec26a69ed, 766ec478e3fd41d19e1fcad9881b721d; no voters:
I20240502 01:59:25.604151 26399 raft_consensus.cc:2781] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:25.604207 26399 raft_consensus.cc:482] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:25.604233 26399 raft_consensus.cc:3037] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:25.605017 26399 raft_consensus.cc:504] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.605276 26399 leader_election.cc:288] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 election: Requested vote from peers 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196:45865)
I20240502 01:59:25.605674 26329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c474cfa879341b7b0957ee409376bab" candidate_uuid: "05e040a7804046ac81822a0ec26a69ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766ec478e3fd41d19e1fcad9881b721d"
I20240502 01:59:25.605782 26329 raft_consensus.cc:3037] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:25.606523 26329 raft_consensus.cc:2454] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05e040a7804046ac81822a0ec26a69ed in term 1.
I20240502 01:59:25.606801 25858 leader_election.cc:302] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 05e040a7804046ac81822a0ec26a69ed, 766ec478e3fd41d19e1fcad9881b721d; no voters:
I20240502 01:59:25.606973 26399 raft_consensus.cc:2781] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:25.607079 26399 raft_consensus.cc:686] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Becoming Leader. State: Replica: 05e040a7804046ac81822a0ec26a69ed, State: Running, Role: LEADER
I20240502 01:59:25.607215 26399 consensus_queue.cc:237] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.608686 25779 catalog_manager.cc:5484] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 05e040a7804046ac81822a0ec26a69ed (127.10.133.193). New cstate: current_term: 1 leader_uuid: "05e040a7804046ac81822a0ec26a69ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } health_report { overall_health: UNKNOWN } } }
W20240502 01:59:25.764925 26410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:25.765158 26410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:25.768100 26410 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_0'
I20240502 01:59:25.859169 26329 raft_consensus.cc:1261] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Refusing update from remote peer 05e040a7804046ac81822a0ec26a69ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:25.860322 26328 raft_consensus.cc:1261] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Refusing update from remote peer 05e040a7804046ac81822a0ec26a69ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:25.860821 26406 consensus_queue.cc:1035] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:25.861017 26399 consensus_queue.cc:1035] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:25.861196 26329 raft_consensus.cc:1261] T bcde951dca1f4523bda405738474b88f P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Refusing update from remote peer 05e040a7804046ac81822a0ec26a69ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:25.861748 26399 consensus_queue.cc:1035] T bcde951dca1f4523bda405738474b88f P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:25.870582 26441 mvcc.cc:205] Tried to move back new op lower bound from 7023063719354527744 to 7023063718239440896. Current Snapshot: MvccSnapshot[applied={T|T < 7023063719354527744}]
INSERT report
rows total: 2000
time total: 98.8608 ms
time per row: 0.0494304 ms
I20240502 01:59:25.914333 25772 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38544:
name: "rebalance_test_table_1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20240502 01:59:25.914868 25772 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_1 in case of a server failure: 3 tablet servers would be needed, 2 are available. Consider bringing up more tablet servers.
I20240502 01:59:25.919834 26307 tablet_service.cc:1467] Processing CreateTablet for tablet 0f80de9d9d7e4004833b8fdb71754d33 (DEFAULT_TABLE table=rebalance_test_table_1 [id=1d36356d81ef4557afb95f702e37c3fa]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:25.920022 25903 tablet_service.cc:1467] Processing CreateTablet for tablet 0f80de9d9d7e4004833b8fdb71754d33 (DEFAULT_TABLE table=rebalance_test_table_1 [id=1d36356d81ef4557afb95f702e37c3fa]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:25.920082 26308 tablet_service.cc:1467] Processing CreateTablet for tablet ff626736f609423d8aba65e3d57f8f01 (DEFAULT_TABLE table=rebalance_test_table_1 [id=1d36356d81ef4557afb95f702e37c3fa]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:25.920156 26307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f80de9d9d7e4004833b8fdb71754d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:25.920202 26309 tablet_service.cc:1467] Processing CreateTablet for tablet 845975499fb04e9fbe2b20a161acb94f (DEFAULT_TABLE table=rebalance_test_table_1 [id=1d36356d81ef4557afb95f702e37c3fa]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:25.920298 25903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f80de9d9d7e4004833b8fdb71754d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:25.920298 26308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff626736f609423d8aba65e3d57f8f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:25.920646 26309 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 845975499fb04e9fbe2b20a161acb94f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:25.922495 26458 tablet_bootstrap.cc:492] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d: Bootstrap starting.
I20240502 01:59:25.922632 25905 tablet_service.cc:1467] Processing CreateTablet for tablet ff626736f609423d8aba65e3d57f8f01 (DEFAULT_TABLE table=rebalance_test_table_1 [id=1d36356d81ef4557afb95f702e37c3fa]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:25.922863 25905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff626736f609423d8aba65e3d57f8f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:25.923352 26458 tablet_bootstrap.cc:654] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:25.923909 26459 tablet_bootstrap.cc:492] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed: Bootstrap starting.
I20240502 01:59:25.924350 26458 tablet_bootstrap.cc:492] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d: No bootstrap required, opened a new log
I20240502 01:59:25.924443 26458 ts_tablet_manager.cc:1367] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:25.924698 26459 tablet_bootstrap.cc:654] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:25.924963 26458 raft_consensus.cc:348] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.925072 26458 raft_consensus.cc:374] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:25.925109 26458 raft_consensus.cc:729] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 766ec478e3fd41d19e1fcad9881b721d, State: Initialized, Role: FOLLOWER
I20240502 01:59:25.925168 25905 tablet_service.cc:1467] Processing CreateTablet for tablet 845975499fb04e9fbe2b20a161acb94f (DEFAULT_TABLE table=rebalance_test_table_1 [id=1d36356d81ef4557afb95f702e37c3fa]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:25.925238 26458 consensus_queue.cc:260] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.925380 25905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 845975499fb04e9fbe2b20a161acb94f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:25.925503 26458 ts_tablet_manager.cc:1398] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:25.925690 26458 tablet_bootstrap.cc:492] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d: Bootstrap starting.
I20240502 01:59:25.925889 26459 tablet_bootstrap.cc:492] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed: No bootstrap required, opened a new log
I20240502 01:59:25.925976 26459 ts_tablet_manager.cc:1367] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:25.926330 26459 raft_consensus.cc:348] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:25.926415 26459 raft_consensus.cc:374] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:25.926450 26459 raft_consensus.cc:729] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05e040a7804046ac81822a0ec26a69ed, State: Initialized, Role: FOLLOWER
I20240502 01:59:25.926584 26458 tablet_bootstrap.cc:654] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:25.926584 26459 consensus_queue.cc:260] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:25.926826 26459 ts_tablet_manager.cc:1398] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:25.926987 26459 tablet_bootstrap.cc:492] T ff626736f609423d8aba65e3d57f8f01 P 05e040a7804046ac81822a0ec26a69ed: Bootstrap starting.
I20240502 01:59:25.927814 26459 tablet_bootstrap.cc:654] T ff626736f609423d8aba65e3d57f8f01 P 05e040a7804046ac81822a0ec26a69ed: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:25.928938 26459 tablet_bootstrap.cc:492] T ff626736f609423d8aba65e3d57f8f01 P 05e040a7804046ac81822a0ec26a69ed: No bootstrap required, opened a new log
I20240502 01:59:25.929028 26459 ts_tablet_manager.cc:1367] T ff626736f609423d8aba65e3d57f8f01 P 05e040a7804046ac81822a0ec26a69ed: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240502 01:59:25.929054 26458 tablet_bootstrap.cc:492] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d: No bootstrap required, opened a new log
I20240502 01:59:25.929122 26458 ts_tablet_manager.cc:1367] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20240502 01:59:25.929438 26459 raft_consensus.cc:348] T ff626736f609423d8aba65e3d57f8f01 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.929535 26459 raft_consensus.cc:374] T ff626736f609423d8aba65e3d57f8f01 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:25.929569 26459 raft_consensus.cc:729] T ff626736f609423d8aba65e3d57f8f01 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05e040a7804046ac81822a0ec26a69ed, State: Initialized, Role: FOLLOWER
I20240502 01:59:25.929531 26458 raft_consensus.cc:348] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:25.929617 26458 raft_consensus.cc:374] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:25.929692 26458 raft_consensus.cc:729] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 766ec478e3fd41d19e1fcad9881b721d, State: Initialized, Role: FOLLOWER
I20240502 01:59:25.929697 26459 consensus_queue.cc:260] T ff626736f609423d8aba65e3d57f8f01 P 05e040a7804046ac81822a0ec26a69ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.929811 26458 consensus_queue.cc:260] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:25.929955 26459 ts_tablet_manager.cc:1398] T ff626736f609423d8aba65e3d57f8f01 P 05e040a7804046ac81822a0ec26a69ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:25.930133 26459 tablet_bootstrap.cc:492] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed: Bootstrap starting.
I20240502 01:59:25.930178 26458 ts_tablet_manager.cc:1398] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:25.930342 26458 tablet_bootstrap.cc:492] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d: Bootstrap starting.
I20240502 01:59:25.931023 26459 tablet_bootstrap.cc:654] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:25.931488 26458 tablet_bootstrap.cc:654] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:25.932101 26459 tablet_bootstrap.cc:492] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed: No bootstrap required, opened a new log
I20240502 01:59:25.932168 26459 ts_tablet_manager.cc:1367] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:59:25.932528 26459 raft_consensus.cc:348] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:25.932612 26459 raft_consensus.cc:374] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:25.932633 26459 raft_consensus.cc:729] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05e040a7804046ac81822a0ec26a69ed, State: Initialized, Role: FOLLOWER
I20240502 01:59:25.932744 26459 consensus_queue.cc:260] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:25.932965 26459 ts_tablet_manager.cc:1398] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:25.933531 26458 tablet_bootstrap.cc:492] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d: No bootstrap required, opened a new log
I20240502 01:59:25.933614 26458 ts_tablet_manager.cc:1367] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240502 01:59:25.934129 26458 raft_consensus.cc:348] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:25.934230 26458 raft_consensus.cc:374] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:25.934262 26458 raft_consensus.cc:729] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 766ec478e3fd41d19e1fcad9881b721d, State: Initialized, Role: FOLLOWER
I20240502 01:59:25.934399 26458 consensus_queue.cc:260] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:25.934648 26458 ts_tablet_manager.cc:1398] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:25.956667 26401 raft_consensus.cc:482] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:25.956779 26401 raft_consensus.cc:504] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.957651 26401 leader_election.cc:288] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05e040a7804046ac81822a0ec26a69ed (127.10.133.193:38177)
I20240502 01:59:25.961246 25925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff626736f609423d8aba65e3d57f8f01" candidate_uuid: "766ec478e3fd41d19e1fcad9881b721d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05e040a7804046ac81822a0ec26a69ed" is_pre_election: true
I20240502 01:59:25.961438 25925 raft_consensus.cc:2454] T ff626736f609423d8aba65e3d57f8f01 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 766ec478e3fd41d19e1fcad9881b721d in term 0.
I20240502 01:59:25.961872 26263 leader_election.cc:302] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 05e040a7804046ac81822a0ec26a69ed, 766ec478e3fd41d19e1fcad9881b721d; no voters:
I20240502 01:59:25.962126 26401 raft_consensus.cc:2781] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:25.962181 26401 raft_consensus.cc:482] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:25.962208 26401 raft_consensus.cc:3037] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:25.963068 26401 raft_consensus.cc:504] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.963320 26401 leader_election.cc:288] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d [CANDIDATE]: Term 1 election: Requested vote from peers 05e040a7804046ac81822a0ec26a69ed (127.10.133.193:38177)
I20240502 01:59:25.963662 25925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff626736f609423d8aba65e3d57f8f01" candidate_uuid: "766ec478e3fd41d19e1fcad9881b721d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05e040a7804046ac81822a0ec26a69ed"
I20240502 01:59:25.963752 25925 raft_consensus.cc:3037] T ff626736f609423d8aba65e3d57f8f01 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:25.964491 25925 raft_consensus.cc:2454] T ff626736f609423d8aba65e3d57f8f01 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 766ec478e3fd41d19e1fcad9881b721d in term 1.
I20240502 01:59:25.964752 26263 leader_election.cc:302] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 05e040a7804046ac81822a0ec26a69ed, 766ec478e3fd41d19e1fcad9881b721d; no voters:
I20240502 01:59:25.964919 26401 raft_consensus.cc:2781] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:25.965004 26401 raft_consensus.cc:686] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d [term 1 LEADER]: Becoming Leader. State: Replica: 766ec478e3fd41d19e1fcad9881b721d, State: Running, Role: LEADER
I20240502 01:59:25.965289 26401 consensus_queue.cc:237] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:25.967213 25772 catalog_manager.cc:5484] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d reported cstate change: term changed from 0 to 1, leader changed from <none> to 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196). New cstate: current_term: 1 leader_uuid: "766ec478e3fd41d19e1fcad9881b721d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:26.050083 26401 raft_consensus.cc:482] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:26.050209 26401 raft_consensus.cc:504] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:26.050511 26401 leader_election.cc:288] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05e040a7804046ac81822a0ec26a69ed (127.10.133.193:38177)
I20240502 01:59:26.050959 25925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f80de9d9d7e4004833b8fdb71754d33" candidate_uuid: "766ec478e3fd41d19e1fcad9881b721d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05e040a7804046ac81822a0ec26a69ed" is_pre_election: true
I20240502 01:59:26.051108 25925 raft_consensus.cc:2454] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 766ec478e3fd41d19e1fcad9881b721d in term 0.
I20240502 01:59:26.051398 26263 leader_election.cc:302] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 05e040a7804046ac81822a0ec26a69ed, 766ec478e3fd41d19e1fcad9881b721d; no voters:
I20240502 01:59:26.051604 26401 raft_consensus.cc:2781] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:26.051671 26401 raft_consensus.cc:482] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:26.051721 26401 raft_consensus.cc:3037] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:26.052529 26401 raft_consensus.cc:504] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:26.052798 26401 leader_election.cc:288] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [CANDIDATE]: Term 1 election: Requested vote from peers 05e040a7804046ac81822a0ec26a69ed (127.10.133.193:38177)
I20240502 01:59:26.053200 25925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f80de9d9d7e4004833b8fdb71754d33" candidate_uuid: "766ec478e3fd41d19e1fcad9881b721d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05e040a7804046ac81822a0ec26a69ed"
I20240502 01:59:26.053489 25925 raft_consensus.cc:3037] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:26.054486 25925 raft_consensus.cc:2454] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 766ec478e3fd41d19e1fcad9881b721d in term 1.
I20240502 01:59:26.054832 26263 leader_election.cc:302] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 05e040a7804046ac81822a0ec26a69ed, 766ec478e3fd41d19e1fcad9881b721d; no voters:
I20240502 01:59:26.054988 26401 raft_consensus.cc:2781] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:26.055075 26401 raft_consensus.cc:686] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [term 1 LEADER]: Becoming Leader. State: Replica: 766ec478e3fd41d19e1fcad9881b721d, State: Running, Role: LEADER
I20240502 01:59:26.055209 26401 consensus_queue.cc:237] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:26.056726 25772 catalog_manager.cc:5484] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d reported cstate change: term changed from 0 to 1, leader changed from <none> to 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196). New cstate: current_term: 1 leader_uuid: "766ec478e3fd41d19e1fcad9881b721d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:26.074087 26451 raft_consensus.cc:482] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:26.074218 26451 raft_consensus.cc:504] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:26.074597 26451 leader_election.cc:288] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196:45865)
I20240502 01:59:26.075138 26329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "845975499fb04e9fbe2b20a161acb94f" candidate_uuid: "05e040a7804046ac81822a0ec26a69ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766ec478e3fd41d19e1fcad9881b721d" is_pre_election: true
I20240502 01:59:26.075270 26329 raft_consensus.cc:2454] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05e040a7804046ac81822a0ec26a69ed in term 0.
I20240502 01:59:26.075531 25858 leader_election.cc:302] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 05e040a7804046ac81822a0ec26a69ed, 766ec478e3fd41d19e1fcad9881b721d; no voters:
I20240502 01:59:26.075703 26451 raft_consensus.cc:2781] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:26.075764 26451 raft_consensus.cc:482] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:26.075805 26451 raft_consensus.cc:3037] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:26.076943 26451 raft_consensus.cc:504] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:26.077214 26451 leader_election.cc:288] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 election: Requested vote from peers 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196:45865)
I20240502 01:59:26.077589 26329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "845975499fb04e9fbe2b20a161acb94f" candidate_uuid: "05e040a7804046ac81822a0ec26a69ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766ec478e3fd41d19e1fcad9881b721d"
I20240502 01:59:26.077737 26329 raft_consensus.cc:3037] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:26.078526 26329 raft_consensus.cc:2454] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05e040a7804046ac81822a0ec26a69ed in term 1.
I20240502 01:59:26.078819 25858 leader_election.cc:302] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 05e040a7804046ac81822a0ec26a69ed, 766ec478e3fd41d19e1fcad9881b721d; no voters:
I20240502 01:59:26.079017 26451 raft_consensus.cc:2781] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:26.079099 26451 raft_consensus.cc:686] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Becoming Leader. State: Replica: 05e040a7804046ac81822a0ec26a69ed, State: Running, Role: LEADER
I20240502 01:59:26.079242 26451 consensus_queue.cc:237] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:26.081223 25772 catalog_manager.cc:5484] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 05e040a7804046ac81822a0ec26a69ed (127.10.133.193). New cstate: current_term: 1 leader_uuid: "05e040a7804046ac81822a0ec26a69ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } health_report { overall_health: HEALTHY } } }
W20240502 01:59:26.219907 26470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:26.220141 26470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:26.223083 26470 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_1'
I20240502 01:59:26.300603 25924 raft_consensus.cc:1261] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Refusing update from remote peer 766ec478e3fd41d19e1fcad9881b721d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:26.301203 26401 consensus_queue.cc:1035] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [LEADER]: Connected to new peer: Peer: permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:26.300585 25925 raft_consensus.cc:1261] T ff626736f609423d8aba65e3d57f8f01 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Refusing update from remote peer 766ec478e3fd41d19e1fcad9881b721d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:26.302371 26401 consensus_queue.cc:1035] T ff626736f609423d8aba65e3d57f8f01 P 766ec478e3fd41d19e1fcad9881b721d [LEADER]: Connected to new peer: Peer: permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:26.307184 26329 raft_consensus.cc:1261] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Refusing update from remote peer 05e040a7804046ac81822a0ec26a69ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:26.307569 26451 consensus_queue.cc:1035] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:26.310407 26437 mvcc.cc:205] Tried to move back new op lower bound from 7023063721161793536 to 7023063720162983936. Current Snapshot: MvccSnapshot[applied={T|T < 7023063721161793536}]
INSERT report
rows total: 2000
time total: 86.245 ms
time per row: 0.0431225 ms
I20240502 01:59:26.348753 25779 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38544:
name: "rebalance_test_table_2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 2
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20240502 01:59:26.349278 25779 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_2 in case of a server failure: 3 tablet servers would be needed, 2 are available. Consider bringing up more tablet servers.
I20240502 01:59:26.354146 26307 tablet_service.cc:1467] Processing CreateTablet for tablet 7bd526d64ec24706bc02cb4a87b1840f (DEFAULT_TABLE table=rebalance_test_table_2 [id=fc3228ae04954ae2b302b822d881ac3e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:26.354265 25905 tablet_service.cc:1467] Processing CreateTablet for tablet 7bd526d64ec24706bc02cb4a87b1840f (DEFAULT_TABLE table=rebalance_test_table_2 [id=fc3228ae04954ae2b302b822d881ac3e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:26.354475 26307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bd526d64ec24706bc02cb4a87b1840f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:26.354574 25905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bd526d64ec24706bc02cb4a87b1840f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:26.355188 25904 tablet_service.cc:1467] Processing CreateTablet for tablet f28b2fe6110743bb815c23e2f139cf9d (DEFAULT_TABLE table=rebalance_test_table_2 [id=fc3228ae04954ae2b302b822d881ac3e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:26.355403 25904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f28b2fe6110743bb815c23e2f139cf9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:26.356362 26459 tablet_bootstrap.cc:492] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed: Bootstrap starting.
I20240502 01:59:26.356600 26458 tablet_bootstrap.cc:492] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d: Bootstrap starting.
I20240502 01:59:26.356796 25903 tablet_service.cc:1467] Processing CreateTablet for tablet 25234fd535834012b836adcfcfe6aa78 (DEFAULT_TABLE table=rebalance_test_table_2 [id=fc3228ae04954ae2b302b822d881ac3e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:26.357007 25903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25234fd535834012b836adcfcfe6aa78. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:26.357287 26459 tablet_bootstrap.cc:654] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:26.357493 26458 tablet_bootstrap.cc:654] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:26.358063 26308 tablet_service.cc:1467] Processing CreateTablet for tablet f28b2fe6110743bb815c23e2f139cf9d (DEFAULT_TABLE table=rebalance_test_table_2 [id=fc3228ae04954ae2b302b822d881ac3e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:26.358256 26308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f28b2fe6110743bb815c23e2f139cf9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:26.358268 26307 tablet_service.cc:1467] Processing CreateTablet for tablet 25234fd535834012b836adcfcfe6aa78 (DEFAULT_TABLE table=rebalance_test_table_2 [id=fc3228ae04954ae2b302b822d881ac3e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:26.358491 26307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25234fd535834012b836adcfcfe6aa78. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:26.359474 26458 tablet_bootstrap.cc:492] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d: No bootstrap required, opened a new log
I20240502 01:59:26.359546 26458 ts_tablet_manager.cc:1367] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240502 01:59:26.359750 26459 tablet_bootstrap.cc:492] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed: No bootstrap required, opened a new log
I20240502 01:59:26.359822 26459 ts_tablet_manager.cc:1367] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20240502 01:59:26.359999 26458 raft_consensus.cc:348] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:26.360095 26458 raft_consensus.cc:374] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:26.360119 26458 raft_consensus.cc:729] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 766ec478e3fd41d19e1fcad9881b721d, State: Initialized, Role: FOLLOWER
I20240502 01:59:26.360222 26458 consensus_queue.cc:260] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:26.360248 26459 raft_consensus.cc:348] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:26.360352 26459 raft_consensus.cc:374] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:26.360391 26459 raft_consensus.cc:729] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05e040a7804046ac81822a0ec26a69ed, State: Initialized, Role: FOLLOWER
I20240502 01:59:26.360497 26458 ts_tablet_manager.cc:1398] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:26.360510 26459 consensus_queue.cc:260] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:26.360677 26458 tablet_bootstrap.cc:492] T f28b2fe6110743bb815c23e2f139cf9d P 766ec478e3fd41d19e1fcad9881b721d: Bootstrap starting.
I20240502 01:59:26.360772 26459 ts_tablet_manager.cc:1398] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:26.360989 26459 tablet_bootstrap.cc:492] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed: Bootstrap starting.
I20240502 01:59:26.361483 26458 tablet_bootstrap.cc:654] T f28b2fe6110743bb815c23e2f139cf9d P 766ec478e3fd41d19e1fcad9881b721d: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:26.361871 26459 tablet_bootstrap.cc:654] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:26.362565 26458 tablet_bootstrap.cc:492] T f28b2fe6110743bb815c23e2f139cf9d P 766ec478e3fd41d19e1fcad9881b721d: No bootstrap required, opened a new log
I20240502 01:59:26.362664 26458 ts_tablet_manager.cc:1367] T f28b2fe6110743bb815c23e2f139cf9d P 766ec478e3fd41d19e1fcad9881b721d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240502 01:59:26.363094 26458 raft_consensus.cc:348] T f28b2fe6110743bb815c23e2f139cf9d P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:26.363188 26458 raft_consensus.cc:374] T f28b2fe6110743bb815c23e2f139cf9d P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:26.363227 26458 raft_consensus.cc:729] T f28b2fe6110743bb815c23e2f139cf9d P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 766ec478e3fd41d19e1fcad9881b721d, State: Initialized, Role: FOLLOWER
I20240502 01:59:26.363356 26458 consensus_queue.cc:260] T f28b2fe6110743bb815c23e2f139cf9d P 766ec478e3fd41d19e1fcad9881b721d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:26.363579 26458 ts_tablet_manager.cc:1398] T f28b2fe6110743bb815c23e2f139cf9d P 766ec478e3fd41d19e1fcad9881b721d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:26.363620 26459 tablet_bootstrap.cc:492] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed: No bootstrap required, opened a new log
I20240502 01:59:26.363708 26459 ts_tablet_manager.cc:1367] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:59:26.363732 26458 tablet_bootstrap.cc:492] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d: Bootstrap starting.
I20240502 01:59:26.364116 26459 raft_consensus.cc:348] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:26.364216 26459 raft_consensus.cc:374] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:26.364250 26459 raft_consensus.cc:729] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05e040a7804046ac81822a0ec26a69ed, State: Initialized, Role: FOLLOWER
I20240502 01:59:26.364374 26459 consensus_queue.cc:260] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:26.364640 26459 ts_tablet_manager.cc:1398] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:26.364744 26458 tablet_bootstrap.cc:654] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:26.364815 26459 tablet_bootstrap.cc:492] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed: Bootstrap starting.
I20240502 01:59:26.365885 26459 tablet_bootstrap.cc:654] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:26.365960 26458 tablet_bootstrap.cc:492] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d: No bootstrap required, opened a new log
I20240502 01:59:26.366061 26458 ts_tablet_manager.cc:1367] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240502 01:59:26.366457 26458 raft_consensus.cc:348] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:26.366545 26458 raft_consensus.cc:374] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:26.366580 26458 raft_consensus.cc:729] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 766ec478e3fd41d19e1fcad9881b721d, State: Initialized, Role: FOLLOWER
I20240502 01:59:26.366714 26458 consensus_queue.cc:260] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:26.366946 26458 ts_tablet_manager.cc:1398] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:26.367141 26459 tablet_bootstrap.cc:492] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed: No bootstrap required, opened a new log
I20240502 01:59:26.367223 26459 ts_tablet_manager.cc:1367] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:26.367638 26459 raft_consensus.cc:348] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:26.367717 26459 raft_consensus.cc:374] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:26.367749 26459 raft_consensus.cc:729] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05e040a7804046ac81822a0ec26a69ed, State: Initialized, Role: FOLLOWER
I20240502 01:59:26.367866 26459 consensus_queue.cc:260] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:26.368124 26459 ts_tablet_manager.cc:1398] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:26.377594 26399 raft_consensus.cc:482] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:26.377682 26399 raft_consensus.cc:504] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:26.377969 26399 leader_election.cc:288] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196:45865)
I20240502 01:59:26.378350 26329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f28b2fe6110743bb815c23e2f139cf9d" candidate_uuid: "05e040a7804046ac81822a0ec26a69ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766ec478e3fd41d19e1fcad9881b721d" is_pre_election: true
I20240502 01:59:26.378449 26329 raft_consensus.cc:2454] T f28b2fe6110743bb815c23e2f139cf9d P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05e040a7804046ac81822a0ec26a69ed in term 0.
I20240502 01:59:26.378692 25858 leader_election.cc:302] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 05e040a7804046ac81822a0ec26a69ed, 766ec478e3fd41d19e1fcad9881b721d; no voters:
I20240502 01:59:26.379005 26399 raft_consensus.cc:2781] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:26.379106 26399 raft_consensus.cc:482] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:26.379179 26399 raft_consensus.cc:3037] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:26.380744 26399 raft_consensus.cc:504] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:26.381132 26399 leader_election.cc:288] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 election: Requested vote from peers 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196:45865)
I20240502 01:59:26.381688 26329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f28b2fe6110743bb815c23e2f139cf9d" candidate_uuid: "05e040a7804046ac81822a0ec26a69ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766ec478e3fd41d19e1fcad9881b721d"
I20240502 01:59:26.381886 26329 raft_consensus.cc:3037] T f28b2fe6110743bb815c23e2f139cf9d P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:26.382623 26329 raft_consensus.cc:2454] T f28b2fe6110743bb815c23e2f139cf9d P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05e040a7804046ac81822a0ec26a69ed in term 1.
I20240502 01:59:26.382886 25858 leader_election.cc:302] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 05e040a7804046ac81822a0ec26a69ed, 766ec478e3fd41d19e1fcad9881b721d; no voters:
I20240502 01:59:26.383066 26399 raft_consensus.cc:2781] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:26.383152 26399 raft_consensus.cc:686] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Becoming Leader. State: Replica: 05e040a7804046ac81822a0ec26a69ed, State: Running, Role: LEADER
I20240502 01:59:26.383275 26399 consensus_queue.cc:237] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } }
I20240502 01:59:26.384510 25779 catalog_manager.cc:5484] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 05e040a7804046ac81822a0ec26a69ed (127.10.133.193). New cstate: current_term: 1 leader_uuid: "05e040a7804046ac81822a0ec26a69ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:26.574277 26399 raft_consensus.cc:482] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:26.574429 26399 raft_consensus.cc:504] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:26.574805 26399 leader_election.cc:288] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196:45865)
I20240502 01:59:26.575259 26329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bd526d64ec24706bc02cb4a87b1840f" candidate_uuid: "05e040a7804046ac81822a0ec26a69ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766ec478e3fd41d19e1fcad9881b721d" is_pre_election: true
I20240502 01:59:26.575426 26329 raft_consensus.cc:2454] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05e040a7804046ac81822a0ec26a69ed in term 0.
I20240502 01:59:26.575755 25858 leader_election.cc:302] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 05e040a7804046ac81822a0ec26a69ed, 766ec478e3fd41d19e1fcad9881b721d; no voters:
I20240502 01:59:26.575929 26399 raft_consensus.cc:2781] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:26.575999 26399 raft_consensus.cc:482] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:26.576026 26399 raft_consensus.cc:3037] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:26.577922 26399 raft_consensus.cc:504] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:26.578207 26399 leader_election.cc:288] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 election: Requested vote from peers 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196:45865)
I20240502 01:59:26.578583 26329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bd526d64ec24706bc02cb4a87b1840f" candidate_uuid: "05e040a7804046ac81822a0ec26a69ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766ec478e3fd41d19e1fcad9881b721d"
I20240502 01:59:26.578706 26329 raft_consensus.cc:3037] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:26.579422 26329 raft_consensus.cc:2454] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05e040a7804046ac81822a0ec26a69ed in term 1.
I20240502 01:59:26.579735 25858 leader_election.cc:302] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 05e040a7804046ac81822a0ec26a69ed, 766ec478e3fd41d19e1fcad9881b721d; no voters:
I20240502 01:59:26.579905 26399 raft_consensus.cc:2781] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:26.579988 26399 raft_consensus.cc:686] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Becoming Leader. State: Replica: 05e040a7804046ac81822a0ec26a69ed, State: Running, Role: LEADER
I20240502 01:59:26.580094 26399 consensus_queue.cc:237] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:26.581640 25779 catalog_manager.cc:5484] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed reported cstate change: term changed from 0 to 1, leader changed from <none> to 05e040a7804046ac81822a0ec26a69ed (127.10.133.193). New cstate: current_term: 1 leader_uuid: "05e040a7804046ac81822a0ec26a69ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:26.653731 26440 raft_consensus.cc:482] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:26.653900 26440 raft_consensus.cc:504] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:26.654318 26440 leader_election.cc:288] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 05e040a7804046ac81822a0ec26a69ed (127.10.133.193:38177)
I20240502 01:59:26.654762 25925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25234fd535834012b836adcfcfe6aa78" candidate_uuid: "766ec478e3fd41d19e1fcad9881b721d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05e040a7804046ac81822a0ec26a69ed" is_pre_election: true
I20240502 01:59:26.654909 25925 raft_consensus.cc:2454] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 766ec478e3fd41d19e1fcad9881b721d in term 0.
I20240502 01:59:26.655210 26263 leader_election.cc:302] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 05e040a7804046ac81822a0ec26a69ed, 766ec478e3fd41d19e1fcad9881b721d; no voters:
I20240502 01:59:26.655387 26440 raft_consensus.cc:2781] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:26.655449 26440 raft_consensus.cc:482] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:26.655478 26440 raft_consensus.cc:3037] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:26.656275 26440 raft_consensus.cc:504] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:26.656538 26440 leader_election.cc:288] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [CANDIDATE]: Term 1 election: Requested vote from peers 05e040a7804046ac81822a0ec26a69ed (127.10.133.193:38177)
I20240502 01:59:26.656885 25925 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25234fd535834012b836adcfcfe6aa78" candidate_uuid: "766ec478e3fd41d19e1fcad9881b721d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05e040a7804046ac81822a0ec26a69ed"
I20240502 01:59:26.657018 25925 raft_consensus.cc:3037] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:26.657766 25925 raft_consensus.cc:2454] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 766ec478e3fd41d19e1fcad9881b721d in term 1.
I20240502 01:59:26.658066 26263 leader_election.cc:302] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 05e040a7804046ac81822a0ec26a69ed, 766ec478e3fd41d19e1fcad9881b721d; no voters:
I20240502 01:59:26.658216 26440 raft_consensus.cc:2781] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:26.658308 26440 raft_consensus.cc:686] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [term 1 LEADER]: Becoming Leader. State: Replica: 766ec478e3fd41d19e1fcad9881b721d, State: Running, Role: LEADER
I20240502 01:59:26.658442 26440 consensus_queue.cc:237] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } }
I20240502 01:59:26.660219 25779 catalog_manager.cc:5484] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d reported cstate change: term changed from 0 to 1, leader changed from <none> to 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196). New cstate: current_term: 1 leader_uuid: "766ec478e3fd41d19e1fcad9881b721d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:26.811931 26406 consensus_queue.cc:1035] T f28b2fe6110743bb815c23e2f139cf9d P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20240502 01:59:26.832129 26510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:26.832376 26510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:26.835383 26510 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_2'
I20240502 01:59:26.920601 25925 raft_consensus.cc:1261] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Refusing update from remote peer 766ec478e3fd41d19e1fcad9881b721d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:26.921105 26440 consensus_queue.cc:1035] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [LEADER]: Connected to new peer: Peer: permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:26.923982 26329 raft_consensus.cc:1261] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Refusing update from remote peer 05e040a7804046ac81822a0ec26a69ed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:26.924594 26406 consensus_queue.cc:1035] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 89.76 ms
time per row: 0.04488 ms
I20240502 01:59:26.965382 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.194:46463
--local_ip_for_outbound_sockets=127.10.133.194
--tserver_master_addrs=127.10.133.254:40621
--webserver_port=35593
--webserver_interface=127.10.133.194
--builtin_ntp_servers=127.10.133.212:41979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 01:59:27.076231 26556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:27.076438 26556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:27.076493 26556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:27.079526 26556 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:27.079609 26556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:27.079715 26556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.194
I20240502 01:59:27.083356 26556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:41979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.194:46463
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.133.194
--webserver_port=35593
--tserver_master_addrs=127.10.133.254:40621
--never_fsync=true
--heap_profile_path=/tmp/kudu.26556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.194
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:27.084197 26556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:27.085289 26556 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:27.093812 26564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:27.094426 26562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:27.095118 26561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:27.095841 26556 server_base.cc:1034] running on GCE node
I20240502 01:59:27.096216 26556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:27.096915 26556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:27.098049 26556 hybrid_clock.cc:648] HybridClock initialized: now 1714615167098037 us; error 25 us; skew 500 ppm
I20240502 01:59:27.099978 26556 webserver.cc:460] Webserver started at http://127.10.133.194:35593/ using document root <none> and password file <none>
I20240502 01:59:27.100556 26556 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:27.100642 26556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:27.103889 26556 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20240502 01:59:27.105819 26570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:27.106917 26556 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:27.107020 26556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6"
format_stamp: "Formatted at 2024-05-02 01:59:21 on dist-test-slave-dr9f"
I20240502 01:59:27.107417 26556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:27.117301 26556 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:27.117808 26556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:27.117957 26556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:27.118471 26556 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:27.119290 26556 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:27.119338 26556 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:27.119395 26556 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:27.119421 26556 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:27.127388 26556 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.194:46463
I20240502 01:59:27.127426 26685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.194:46463 every 8 connection(s)
I20240502 01:59:27.128369 26556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20240502 01:59:27.130967 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 26556
I20240502 01:59:27.131390 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.195:36453
--local_ip_for_outbound_sockets=127.10.133.195
--tserver_master_addrs=127.10.133.254:40621
--webserver_port=34417
--webserver_interface=127.10.133.195
--builtin_ntp_servers=127.10.133.212:41979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:59:27.138216 26686 heartbeater.cc:347] Connected to a master server at 127.10.133.254:40621
I20240502 01:59:27.138427 26686 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:27.138947 26686 heartbeater.cc:511] Master 127.10.133.254:40621 requested a full tablet report, sending...
I20240502 01:59:27.140158 25780 ts_manager.cc:194] Re-registered known tserver with Master: cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194:46463)
I20240502 01:59:27.141016 25780 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.194:56561
W20240502 01:59:27.238469 26689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:27.238703 26689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:27.238761 26689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:27.241582 26689 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:27.241665 26689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:27.241729 26689 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.195
I20240502 01:59:27.245172 26689 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:41979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.195:36453
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.133.195
--webserver_port=34417
--tserver_master_addrs=127.10.133.254:40621
--never_fsync=true
--heap_profile_path=/tmp/kudu.26689
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.195
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:27.246100 26689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:27.247160 26689 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:27.255373 26697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:27.255728 26695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:27.256523 26694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:27.257150 26689 server_base.cc:1034] running on GCE node
I20240502 01:59:27.257512 26689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:27.258081 26689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:27.259232 26689 hybrid_clock.cc:648] HybridClock initialized: now 1714615167259218 us; error 28 us; skew 500 ppm
I20240502 01:59:27.261090 26689 webserver.cc:460] Webserver started at http://127.10.133.195:34417/ using document root <none> and password file <none>
I20240502 01:59:27.261619 26689 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:27.261703 26689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:27.264986 26689 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.001s
I20240502 01:59:27.266993 26703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:27.267964 26689 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:27.268070 26689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "d7706cd297b24c5e9919098d0fd279f8"
format_stamp: "Formatted at 2024-05-02 01:59:21 on dist-test-slave-dr9f"
I20240502 01:59:27.268483 26689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:27.291780 26689 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:27.292340 26689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:27.292488 26689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:27.293000 26689 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:27.293829 26689 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:27.293877 26689 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:27.293927 26689 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:27.293957 26689 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:27.302047 26689 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.195:36453
I20240502 01:59:27.302079 26818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.195:36453 every 8 connection(s)
I20240502 01:59:27.303037 26689 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20240502 01:59:27.307456 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 26689
I20240502 01:59:27.312592 26819 heartbeater.cc:347] Connected to a master server at 127.10.133.254:40621
I20240502 01:59:27.312817 26819 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:27.313293 26819 heartbeater.cc:511] Master 127.10.133.254:40621 requested a full tablet report, sending...
I20240502 01:59:27.314292 25780 ts_manager.cc:194] Re-registered known tserver with Master: d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195:36453)
I20240502 01:59:27.314828 25780 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.195:47067
I20240502 01:59:27.488330 25903 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:27.488330 26307 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:59:27.489670 26620 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:27.497960 26752 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:27.584389 26620 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:27.584508 26307 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:59:27.584712 26752 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:27.585618 25903 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:27.687022 26752 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:27.687347 25903 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:27.687361 26620 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:27.687361 26307 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:59:27.767454 26752 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:27.768147 26620 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:27.768247 25903 tablet_service.cc:1429] Tablet server has 6 leaders and 0 scanners
I20240502 01:59:27.768862 26307 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:59:27.805471 26328 consensus_queue.cc:237] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: true } }
I20240502 01:59:27.806949 25925 raft_consensus.cc:1261] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Refusing update from remote peer 766ec478e3fd41d19e1fcad9881b721d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:27.807361 26963 consensus_queue.cc:1035] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [LEADER]: Connected to new peer: Peer: permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:27.809291 26401 raft_consensus.cc:2932] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: true } } }
I20240502 01:59:27.811534 25925 raft_consensus.cc:2932] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: true } } }
W20240502 01:59:27.812227 26262 consensus_peers.cc:485] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d -> Peer cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194:46463): Couldn't send request to peer cf1bc781aacc4b5cb3d98af660b7b6a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f80de9d9d7e4004833b8fdb71754d33. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:27.813140 25779 catalog_manager.cc:5484] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d reported cstate change: config changed from index -1 to 4, NON_VOTER cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) added. New cstate: current_term: 1 leader_uuid: "766ec478e3fd41d19e1fcad9881b721d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:27.819375 25925 consensus_queue.cc:237] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: NON_VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: true } }
I20240502 01:59:27.820799 26328 raft_consensus.cc:1261] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Refusing update from remote peer 05e040a7804046ac81822a0ec26a69ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:27.821213 26975 consensus_queue.cc:1035] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:27.822793 26406 raft_consensus.cc:2932] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: NON_VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: true } } }
I20240502 01:59:27.823480 26328 raft_consensus.cc:2932] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: NON_VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: true } } }
W20240502 01:59:27.824636 25858 consensus_peers.cc:485] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed -> Peer d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195:36453): Couldn't send request to peer d7706cd297b24c5e9919098d0fd279f8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7bd526d64ec24706bc02cb4a87b1840f. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:27.825222 25776 catalog_manager.cc:5484] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed reported cstate change: config changed from index -1 to 4, NON_VOTER d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) added. New cstate: current_term: 1 leader_uuid: "05e040a7804046ac81822a0ec26a69ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: NON_VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:27.832181 26328 consensus_queue.cc:237] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: true } }
I20240502 01:59:27.833177 25925 raft_consensus.cc:1261] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Refusing update from remote peer 766ec478e3fd41d19e1fcad9881b721d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20240502 01:59:27.833395 26262 consensus_peers.cc:485] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d -> Peer cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194:46463): Couldn't send request to peer cf1bc781aacc4b5cb3d98af660b7b6a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 25234fd535834012b836adcfcfe6aa78. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:27.833526 26963 consensus_queue.cc:1035] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [LEADER]: Connected to new peer: Peer: permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:27.834918 26401 raft_consensus.cc:2932] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: true } } }
I20240502 01:59:27.835325 25925 raft_consensus.cc:2932] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: true } } }
I20240502 01:59:27.836966 25779 catalog_manager.cc:5484] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d reported cstate change: config changed from index -1 to 4, NON_VOTER cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) added. New cstate: current_term: 1 leader_uuid: "766ec478e3fd41d19e1fcad9881b721d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:27.843799 25925 consensus_queue.cc:237] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: NON_VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: true } }
I20240502 01:59:27.844892 26328 raft_consensus.cc:1261] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Refusing update from remote peer 05e040a7804046ac81822a0ec26a69ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:27.845229 26406 consensus_queue.cc:1035] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20240502 01:59:27.845402 25858 consensus_peers.cc:485] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed -> Peer d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195:36453): Couldn't send request to peer d7706cd297b24c5e9919098d0fd279f8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 845975499fb04e9fbe2b20a161acb94f. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:27.846822 26975 raft_consensus.cc:2932] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: NON_VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: true } } }
I20240502 01:59:27.847266 26328 raft_consensus.cc:2932] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: NON_VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: true } } }
I20240502 01:59:27.849264 25776 catalog_manager.cc:5484] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed reported cstate change: config changed from index -1 to 4, NON_VOTER d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) added. New cstate: current_term: 1 leader_uuid: "05e040a7804046ac81822a0ec26a69ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: NON_VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:27.856040 25925 consensus_queue.cc:237] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: NON_VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: true } }
I20240502 01:59:27.857117 26328 raft_consensus.cc:1261] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Refusing update from remote peer 05e040a7804046ac81822a0ec26a69ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:27.857414 26406 consensus_queue.cc:1035] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20240502 01:59:27.857609 25858 consensus_peers.cc:485] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed -> Peer d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195:36453): Couldn't send request to peer d7706cd297b24c5e9919098d0fd279f8. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: adc6a6b402bf488c9f8ff21ecbaf3385. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:27.859014 26975 raft_consensus.cc:2932] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: NON_VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: true } } }
I20240502 01:59:27.859438 26328 raft_consensus.cc:2932] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: NON_VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: true } } }
I20240502 01:59:27.861181 25779 catalog_manager.cc:5484] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed reported cstate change: config changed from index -1 to 4, NON_VOTER d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) added. New cstate: current_term: 1 leader_uuid: "05e040a7804046ac81822a0ec26a69ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: NON_VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:27.868016 25925 consensus_queue.cc:237] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: true } }
I20240502 01:59:27.869439 26328 raft_consensus.cc:1261] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Refusing update from remote peer 05e040a7804046ac81822a0ec26a69ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:27.869843 26975 consensus_queue.cc:1035] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:27.871706 26406 raft_consensus.cc:2932] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: true } } }
I20240502 01:59:27.872108 26328 raft_consensus.cc:2932] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4, NON_VOTER cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: true } } }
W20240502 01:59:27.872864 25859 consensus_peers.cc:485] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed -> Peer cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194:46463): Couldn't send request to peer cf1bc781aacc4b5cb3d98af660b7b6a6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c474cfa879341b7b0957ee409376bab. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:27.874507 25779 catalog_manager.cc:5484] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d reported cstate change: config changed from index -1 to 4, NON_VOTER cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) added. New cstate: current_term: 1 leader_uuid: "05e040a7804046ac81822a0ec26a69ed" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: true } } }
I20240502 01:59:28.142923 26686 heartbeater.cc:503] Master 127.10.133.254:40621 was elected leader, sending a full tablet report...
I20240502 01:59:28.208245 27067 ts_tablet_manager.cc:902] T 0f80de9d9d7e4004833b8fdb71754d33 P cf1bc781aacc4b5cb3d98af660b7b6a6: Initiating tablet copy from peer 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196:45865)
I20240502 01:59:28.208974 27067 tablet_copy_client.cc:308] T 0f80de9d9d7e4004833b8fdb71754d33 P cf1bc781aacc4b5cb3d98af660b7b6a6: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.196:45865
I20240502 01:59:28.212625 26350 tablet_copy_service.cc:140] P 766ec478e3fd41d19e1fcad9881b721d: Received BeginTabletCopySession request for tablet 0f80de9d9d7e4004833b8fdb71754d33 from peer cf1bc781aacc4b5cb3d98af660b7b6a6 ({username='slave'} at 127.10.133.194:41011)
I20240502 01:59:28.212759 26350 tablet_copy_service.cc:161] P 766ec478e3fd41d19e1fcad9881b721d: Beginning new tablet copy session on tablet 0f80de9d9d7e4004833b8fdb71754d33 from peer cf1bc781aacc4b5cb3d98af660b7b6a6 at {username='slave'} at 127.10.133.194:41011: session id = cf1bc781aacc4b5cb3d98af660b7b6a6-0f80de9d9d7e4004833b8fdb71754d33
I20240502 01:59:28.214172 26350 tablet_copy_source_session.cc:205] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:28.217250 27067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f80de9d9d7e4004833b8fdb71754d33. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:28.222807 27067 tablet_copy_client.cc:783] T 0f80de9d9d7e4004833b8fdb71754d33 P cf1bc781aacc4b5cb3d98af660b7b6a6: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:28.222990 27067 tablet_copy_client.cc:647] T 0f80de9d9d7e4004833b8fdb71754d33 P cf1bc781aacc4b5cb3d98af660b7b6a6: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:28.224601 27067 tablet_copy_client.cc:523] T 0f80de9d9d7e4004833b8fdb71754d33 P cf1bc781aacc4b5cb3d98af660b7b6a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:28.225970 27067 tablet_bootstrap.cc:492] T 0f80de9d9d7e4004833b8fdb71754d33 P cf1bc781aacc4b5cb3d98af660b7b6a6: Bootstrap starting.
I20240502 01:59:28.227388 27073 ts_tablet_manager.cc:902] T 7bd526d64ec24706bc02cb4a87b1840f P d7706cd297b24c5e9919098d0fd279f8: Initiating tablet copy from peer 05e040a7804046ac81822a0ec26a69ed (127.10.133.193:38177)
I20240502 01:59:28.228145 27073 tablet_copy_client.cc:308] T 7bd526d64ec24706bc02cb4a87b1840f P d7706cd297b24c5e9919098d0fd279f8: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:38177
I20240502 01:59:28.232230 27067 log.cc:824] T 0f80de9d9d7e4004833b8fdb71754d33 P cf1bc781aacc4b5cb3d98af660b7b6a6: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:28.232568 25945 tablet_copy_service.cc:140] P 05e040a7804046ac81822a0ec26a69ed: Received BeginTabletCopySession request for tablet 7bd526d64ec24706bc02cb4a87b1840f from peer d7706cd297b24c5e9919098d0fd279f8 ({username='slave'} at 127.10.133.195:55595)
I20240502 01:59:28.232692 25945 tablet_copy_service.cc:161] P 05e040a7804046ac81822a0ec26a69ed: Beginning new tablet copy session on tablet 7bd526d64ec24706bc02cb4a87b1840f from peer d7706cd297b24c5e9919098d0fd279f8 at {username='slave'} at 127.10.133.195:55595: session id = d7706cd297b24c5e9919098d0fd279f8-7bd526d64ec24706bc02cb4a87b1840f
I20240502 01:59:28.234076 25945 tablet_copy_source_session.cc:205] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:28.237524 27073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bd526d64ec24706bc02cb4a87b1840f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:28.243899 27073 tablet_copy_client.cc:783] T 7bd526d64ec24706bc02cb4a87b1840f P d7706cd297b24c5e9919098d0fd279f8: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:28.244083 27073 tablet_copy_client.cc:647] T 7bd526d64ec24706bc02cb4a87b1840f P d7706cd297b24c5e9919098d0fd279f8: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:28.245857 27073 tablet_copy_client.cc:523] T 7bd526d64ec24706bc02cb4a87b1840f P d7706cd297b24c5e9919098d0fd279f8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:28.247655 27073 tablet_bootstrap.cc:492] T 7bd526d64ec24706bc02cb4a87b1840f P d7706cd297b24c5e9919098d0fd279f8: Bootstrap starting.
I20240502 01:59:28.252518 27080 ts_tablet_manager.cc:902] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8: Initiating tablet copy from peer 05e040a7804046ac81822a0ec26a69ed (127.10.133.193:38177)
I20240502 01:59:28.253073 27080 tablet_copy_client.cc:308] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:38177
I20240502 01:59:28.253540 25945 tablet_copy_service.cc:140] P 05e040a7804046ac81822a0ec26a69ed: Received BeginTabletCopySession request for tablet adc6a6b402bf488c9f8ff21ecbaf3385 from peer d7706cd297b24c5e9919098d0fd279f8 ({username='slave'} at 127.10.133.195:55595)
I20240502 01:59:28.253660 25945 tablet_copy_service.cc:161] P 05e040a7804046ac81822a0ec26a69ed: Beginning new tablet copy session on tablet adc6a6b402bf488c9f8ff21ecbaf3385 from peer d7706cd297b24c5e9919098d0fd279f8 at {username='slave'} at 127.10.133.195:55595: session id = d7706cd297b24c5e9919098d0fd279f8-adc6a6b402bf488c9f8ff21ecbaf3385
I20240502 01:59:28.254623 25945 tablet_copy_source_session.cc:205] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:28.254750 27073 log.cc:824] T 7bd526d64ec24706bc02cb4a87b1840f P d7706cd297b24c5e9919098d0fd279f8: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:28.255487 27080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adc6a6b402bf488c9f8ff21ecbaf3385. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:28.258383 27080 tablet_copy_client.cc:783] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:28.258528 27080 tablet_copy_client.cc:647] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:28.259595 27080 tablet_copy_client.cc:523] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:28.260099 27067 tablet_bootstrap.cc:492] T 0f80de9d9d7e4004833b8fdb71754d33 P cf1bc781aacc4b5cb3d98af660b7b6a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:28.260454 27067 tablet_bootstrap.cc:492] T 0f80de9d9d7e4004833b8fdb71754d33 P cf1bc781aacc4b5cb3d98af660b7b6a6: Bootstrap complete.
I20240502 01:59:28.260749 27080 tablet_bootstrap.cc:492] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8: Bootstrap starting.
I20240502 01:59:28.260766 27067 ts_tablet_manager.cc:1367] T 0f80de9d9d7e4004833b8fdb71754d33 P cf1bc781aacc4b5cb3d98af660b7b6a6: Time spent bootstrapping tablet: real 0.035s user 0.026s sys 0.007s
I20240502 01:59:28.263317 27067 raft_consensus.cc:348] T 0f80de9d9d7e4004833b8fdb71754d33 P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: true } }
I20240502 01:59:28.263587 27067 raft_consensus.cc:729] T 0f80de9d9d7e4004833b8fdb71754d33 P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf1bc781aacc4b5cb3d98af660b7b6a6, State: Initialized, Role: LEARNER
I20240502 01:59:28.263929 27067 consensus_queue.cc:260] T 0f80de9d9d7e4004833b8fdb71754d33 P cf1bc781aacc4b5cb3d98af660b7b6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: true } }
I20240502 01:59:28.264824 27067 ts_tablet_manager.cc:1398] T 0f80de9d9d7e4004833b8fdb71754d33 P cf1bc781aacc4b5cb3d98af660b7b6a6: Time spent starting tablet: real 0.004s user 0.006s sys 0.001s
I20240502 01:59:28.265697 26350 tablet_copy_service.cc:342] P 766ec478e3fd41d19e1fcad9881b721d: Request end of tablet copy session cf1bc781aacc4b5cb3d98af660b7b6a6-0f80de9d9d7e4004833b8fdb71754d33 received from {username='slave'} at 127.10.133.194:41011
I20240502 01:59:28.265800 26350 tablet_copy_service.cc:433] P 766ec478e3fd41d19e1fcad9881b721d: ending tablet copy session cf1bc781aacc4b5cb3d98af660b7b6a6-0f80de9d9d7e4004833b8fdb71754d33 on tablet 0f80de9d9d7e4004833b8fdb71754d33 with peer cf1bc781aacc4b5cb3d98af660b7b6a6
I20240502 01:59:28.279430 27073 tablet_bootstrap.cc:492] T 7bd526d64ec24706bc02cb4a87b1840f P d7706cd297b24c5e9919098d0fd279f8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:28.279731 27073 tablet_bootstrap.cc:492] T 7bd526d64ec24706bc02cb4a87b1840f P d7706cd297b24c5e9919098d0fd279f8: Bootstrap complete.
I20240502 01:59:28.280005 27073 ts_tablet_manager.cc:1367] T 7bd526d64ec24706bc02cb4a87b1840f P d7706cd297b24c5e9919098d0fd279f8: Time spent bootstrapping tablet: real 0.033s user 0.025s sys 0.006s
I20240502 01:59:28.281836 27073 raft_consensus.cc:348] T 7bd526d64ec24706bc02cb4a87b1840f P d7706cd297b24c5e9919098d0fd279f8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: NON_VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: true } }
I20240502 01:59:28.282089 27073 raft_consensus.cc:729] T 7bd526d64ec24706bc02cb4a87b1840f P d7706cd297b24c5e9919098d0fd279f8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d7706cd297b24c5e9919098d0fd279f8, State: Initialized, Role: LEARNER
I20240502 01:59:28.282397 27073 consensus_queue.cc:260] T 7bd526d64ec24706bc02cb4a87b1840f P d7706cd297b24c5e9919098d0fd279f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: NON_VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: true } }
I20240502 01:59:28.283061 26819 heartbeater.cc:503] Master 127.10.133.254:40621 was elected leader, sending a full tablet report...
I20240502 01:59:28.283232 27073 ts_tablet_manager.cc:1398] T 7bd526d64ec24706bc02cb4a87b1840f P d7706cd297b24c5e9919098d0fd279f8: Time spent starting tablet: real 0.003s user 0.005s sys 0.000s
I20240502 01:59:28.283900 25945 tablet_copy_service.cc:342] P 05e040a7804046ac81822a0ec26a69ed: Request end of tablet copy session d7706cd297b24c5e9919098d0fd279f8-7bd526d64ec24706bc02cb4a87b1840f received from {username='slave'} at 127.10.133.195:55595
I20240502 01:59:28.283994 25945 tablet_copy_service.cc:433] P 05e040a7804046ac81822a0ec26a69ed: ending tablet copy session d7706cd297b24c5e9919098d0fd279f8-7bd526d64ec24706bc02cb4a87b1840f on tablet 7bd526d64ec24706bc02cb4a87b1840f with peer d7706cd297b24c5e9919098d0fd279f8
I20240502 01:59:28.284104 27080 tablet_bootstrap.cc:492] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:28.284332 27080 tablet_bootstrap.cc:492] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8: Bootstrap complete.
I20240502 01:59:28.284492 27080 ts_tablet_manager.cc:1367] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8: Time spent bootstrapping tablet: real 0.024s user 0.021s sys 0.000s
I20240502 01:59:28.285037 27080 raft_consensus.cc:348] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: NON_VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: true } }
I20240502 01:59:28.285131 27080 raft_consensus.cc:729] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d7706cd297b24c5e9919098d0fd279f8, State: Initialized, Role: LEARNER
I20240502 01:59:28.285224 27080 consensus_queue.cc:260] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: NON_VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: true } }
I20240502 01:59:28.285457 27080 ts_tablet_manager.cc:1398] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:28.286235 25945 tablet_copy_service.cc:342] P 05e040a7804046ac81822a0ec26a69ed: Request end of tablet copy session d7706cd297b24c5e9919098d0fd279f8-adc6a6b402bf488c9f8ff21ecbaf3385 received from {username='slave'} at 127.10.133.195:55595
I20240502 01:59:28.286312 25945 tablet_copy_service.cc:433] P 05e040a7804046ac81822a0ec26a69ed: ending tablet copy session d7706cd297b24c5e9919098d0fd279f8-adc6a6b402bf488c9f8ff21ecbaf3385 on tablet adc6a6b402bf488c9f8ff21ecbaf3385 with peer d7706cd297b24c5e9919098d0fd279f8
I20240502 01:59:28.333151 27067 ts_tablet_manager.cc:902] T 4c474cfa879341b7b0957ee409376bab P cf1bc781aacc4b5cb3d98af660b7b6a6: Initiating tablet copy from peer 05e040a7804046ac81822a0ec26a69ed (127.10.133.193:38177)
I20240502 01:59:28.333673 27067 tablet_copy_client.cc:308] T 4c474cfa879341b7b0957ee409376bab P cf1bc781aacc4b5cb3d98af660b7b6a6: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:38177
I20240502 01:59:28.336757 25945 tablet_copy_service.cc:140] P 05e040a7804046ac81822a0ec26a69ed: Received BeginTabletCopySession request for tablet 4c474cfa879341b7b0957ee409376bab from peer cf1bc781aacc4b5cb3d98af660b7b6a6 ({username='slave'} at 127.10.133.194:55207)
I20240502 01:59:28.336861 25945 tablet_copy_service.cc:161] P 05e040a7804046ac81822a0ec26a69ed: Beginning new tablet copy session on tablet 4c474cfa879341b7b0957ee409376bab from peer cf1bc781aacc4b5cb3d98af660b7b6a6 at {username='slave'} at 127.10.133.194:55207: session id = cf1bc781aacc4b5cb3d98af660b7b6a6-4c474cfa879341b7b0957ee409376bab
I20240502 01:59:28.337566 25945 tablet_copy_source_session.cc:205] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:28.338380 27067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c474cfa879341b7b0957ee409376bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:28.340375 27067 tablet_copy_client.cc:783] T 4c474cfa879341b7b0957ee409376bab P cf1bc781aacc4b5cb3d98af660b7b6a6: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:28.340535 27067 tablet_copy_client.cc:647] T 4c474cfa879341b7b0957ee409376bab P cf1bc781aacc4b5cb3d98af660b7b6a6: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:28.341600 27067 tablet_copy_client.cc:523] T 4c474cfa879341b7b0957ee409376bab P cf1bc781aacc4b5cb3d98af660b7b6a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:28.342927 27067 tablet_bootstrap.cc:492] T 4c474cfa879341b7b0957ee409376bab P cf1bc781aacc4b5cb3d98af660b7b6a6: Bootstrap starting.
I20240502 01:59:28.362695 27067 tablet_bootstrap.cc:492] T 4c474cfa879341b7b0957ee409376bab P cf1bc781aacc4b5cb3d98af660b7b6a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:28.363014 27067 tablet_bootstrap.cc:492] T 4c474cfa879341b7b0957ee409376bab P cf1bc781aacc4b5cb3d98af660b7b6a6: Bootstrap complete.
I20240502 01:59:28.363194 27067 ts_tablet_manager.cc:1367] T 4c474cfa879341b7b0957ee409376bab P cf1bc781aacc4b5cb3d98af660b7b6a6: Time spent bootstrapping tablet: real 0.020s user 0.016s sys 0.004s
I20240502 01:59:28.363655 27067 raft_consensus.cc:348] T 4c474cfa879341b7b0957ee409376bab P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: true } }
I20240502 01:59:28.363780 27067 raft_consensus.cc:729] T 4c474cfa879341b7b0957ee409376bab P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf1bc781aacc4b5cb3d98af660b7b6a6, State: Initialized, Role: LEARNER
I20240502 01:59:28.363881 27067 consensus_queue.cc:260] T 4c474cfa879341b7b0957ee409376bab P cf1bc781aacc4b5cb3d98af660b7b6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: true } }
I20240502 01:59:28.364223 27067 ts_tablet_manager.cc:1398] T 4c474cfa879341b7b0957ee409376bab P cf1bc781aacc4b5cb3d98af660b7b6a6: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240502 01:59:28.365043 25945 tablet_copy_service.cc:342] P 05e040a7804046ac81822a0ec26a69ed: Request end of tablet copy session cf1bc781aacc4b5cb3d98af660b7b6a6-4c474cfa879341b7b0957ee409376bab received from {username='slave'} at 127.10.133.194:55207
I20240502 01:59:28.365123 25945 tablet_copy_service.cc:433] P 05e040a7804046ac81822a0ec26a69ed: ending tablet copy session cf1bc781aacc4b5cb3d98af660b7b6a6-4c474cfa879341b7b0957ee409376bab on tablet 4c474cfa879341b7b0957ee409376bab with peer cf1bc781aacc4b5cb3d98af660b7b6a6
I20240502 01:59:28.436777 27080 ts_tablet_manager.cc:902] T 845975499fb04e9fbe2b20a161acb94f P d7706cd297b24c5e9919098d0fd279f8: Initiating tablet copy from peer 05e040a7804046ac81822a0ec26a69ed (127.10.133.193:38177)
I20240502 01:59:28.437283 27080 tablet_copy_client.cc:308] T 845975499fb04e9fbe2b20a161acb94f P d7706cd297b24c5e9919098d0fd279f8: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:38177
I20240502 01:59:28.437820 25945 tablet_copy_service.cc:140] P 05e040a7804046ac81822a0ec26a69ed: Received BeginTabletCopySession request for tablet 845975499fb04e9fbe2b20a161acb94f from peer d7706cd297b24c5e9919098d0fd279f8 ({username='slave'} at 127.10.133.195:55595)
I20240502 01:59:28.437932 25945 tablet_copy_service.cc:161] P 05e040a7804046ac81822a0ec26a69ed: Beginning new tablet copy session on tablet 845975499fb04e9fbe2b20a161acb94f from peer d7706cd297b24c5e9919098d0fd279f8 at {username='slave'} at 127.10.133.195:55595: session id = d7706cd297b24c5e9919098d0fd279f8-845975499fb04e9fbe2b20a161acb94f
I20240502 01:59:28.438707 25945 tablet_copy_source_session.cc:205] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:28.439551 27080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 845975499fb04e9fbe2b20a161acb94f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:28.441275 27080 tablet_copy_client.cc:783] T 845975499fb04e9fbe2b20a161acb94f P d7706cd297b24c5e9919098d0fd279f8: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:28.441422 27080 tablet_copy_client.cc:647] T 845975499fb04e9fbe2b20a161acb94f P d7706cd297b24c5e9919098d0fd279f8: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:28.442559 27080 tablet_copy_client.cc:523] T 845975499fb04e9fbe2b20a161acb94f P d7706cd297b24c5e9919098d0fd279f8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:28.443521 27080 tablet_bootstrap.cc:492] T 845975499fb04e9fbe2b20a161acb94f P d7706cd297b24c5e9919098d0fd279f8: Bootstrap starting.
I20240502 01:59:28.457852 27067 ts_tablet_manager.cc:902] T 25234fd535834012b836adcfcfe6aa78 P cf1bc781aacc4b5cb3d98af660b7b6a6: Initiating tablet copy from peer 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196:45865)
I20240502 01:59:28.458333 27067 tablet_copy_client.cc:308] T 25234fd535834012b836adcfcfe6aa78 P cf1bc781aacc4b5cb3d98af660b7b6a6: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.196:45865
I20240502 01:59:28.458873 26350 tablet_copy_service.cc:140] P 766ec478e3fd41d19e1fcad9881b721d: Received BeginTabletCopySession request for tablet 25234fd535834012b836adcfcfe6aa78 from peer cf1bc781aacc4b5cb3d98af660b7b6a6 ({username='slave'} at 127.10.133.194:41011)
I20240502 01:59:28.458997 26350 tablet_copy_service.cc:161] P 766ec478e3fd41d19e1fcad9881b721d: Beginning new tablet copy session on tablet 25234fd535834012b836adcfcfe6aa78 from peer cf1bc781aacc4b5cb3d98af660b7b6a6 at {username='slave'} at 127.10.133.194:41011: session id = cf1bc781aacc4b5cb3d98af660b7b6a6-25234fd535834012b836adcfcfe6aa78
I20240502 01:59:28.459916 26350 tablet_copy_source_session.cc:205] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:28.460738 27067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25234fd535834012b836adcfcfe6aa78. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:28.461764 27080 tablet_bootstrap.cc:492] T 845975499fb04e9fbe2b20a161acb94f P d7706cd297b24c5e9919098d0fd279f8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:28.462071 27080 tablet_bootstrap.cc:492] T 845975499fb04e9fbe2b20a161acb94f P d7706cd297b24c5e9919098d0fd279f8: Bootstrap complete.
I20240502 01:59:28.462273 27080 ts_tablet_manager.cc:1367] T 845975499fb04e9fbe2b20a161acb94f P d7706cd297b24c5e9919098d0fd279f8: Time spent bootstrapping tablet: real 0.019s user 0.019s sys 0.000s
I20240502 01:59:28.462620 27067 tablet_copy_client.cc:783] T 25234fd535834012b836adcfcfe6aa78 P cf1bc781aacc4b5cb3d98af660b7b6a6: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:28.462776 27067 tablet_copy_client.cc:647] T 25234fd535834012b836adcfcfe6aa78 P cf1bc781aacc4b5cb3d98af660b7b6a6: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:28.462705 27080 raft_consensus.cc:348] T 845975499fb04e9fbe2b20a161acb94f P d7706cd297b24c5e9919098d0fd279f8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: NON_VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: true } }
I20240502 01:59:28.462831 27080 raft_consensus.cc:729] T 845975499fb04e9fbe2b20a161acb94f P d7706cd297b24c5e9919098d0fd279f8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d7706cd297b24c5e9919098d0fd279f8, State: Initialized, Role: LEARNER
I20240502 01:59:28.462949 27080 consensus_queue.cc:260] T 845975499fb04e9fbe2b20a161acb94f P d7706cd297b24c5e9919098d0fd279f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: NON_VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: true } }
I20240502 01:59:28.463244 27080 ts_tablet_manager.cc:1398] T 845975499fb04e9fbe2b20a161acb94f P d7706cd297b24c5e9919098d0fd279f8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:28.463886 25945 tablet_copy_service.cc:342] P 05e040a7804046ac81822a0ec26a69ed: Request end of tablet copy session d7706cd297b24c5e9919098d0fd279f8-845975499fb04e9fbe2b20a161acb94f received from {username='slave'} at 127.10.133.195:55595
I20240502 01:59:28.463963 25945 tablet_copy_service.cc:433] P 05e040a7804046ac81822a0ec26a69ed: ending tablet copy session d7706cd297b24c5e9919098d0fd279f8-845975499fb04e9fbe2b20a161acb94f on tablet 845975499fb04e9fbe2b20a161acb94f with peer d7706cd297b24c5e9919098d0fd279f8
I20240502 01:59:28.464170 27067 tablet_copy_client.cc:523] T 25234fd535834012b836adcfcfe6aa78 P cf1bc781aacc4b5cb3d98af660b7b6a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:28.465407 27067 tablet_bootstrap.cc:492] T 25234fd535834012b836adcfcfe6aa78 P cf1bc781aacc4b5cb3d98af660b7b6a6: Bootstrap starting.
I20240502 01:59:28.481453 27067 tablet_bootstrap.cc:492] T 25234fd535834012b836adcfcfe6aa78 P cf1bc781aacc4b5cb3d98af660b7b6a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:28.481688 27067 tablet_bootstrap.cc:492] T 25234fd535834012b836adcfcfe6aa78 P cf1bc781aacc4b5cb3d98af660b7b6a6: Bootstrap complete.
I20240502 01:59:28.481818 27067 ts_tablet_manager.cc:1367] T 25234fd535834012b836adcfcfe6aa78 P cf1bc781aacc4b5cb3d98af660b7b6a6: Time spent bootstrapping tablet: real 0.016s user 0.014s sys 0.000s
I20240502 01:59:28.482353 27067 raft_consensus.cc:348] T 25234fd535834012b836adcfcfe6aa78 P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: true } }
I20240502 01:59:28.482455 27067 raft_consensus.cc:729] T 25234fd535834012b836adcfcfe6aa78 P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: cf1bc781aacc4b5cb3d98af660b7b6a6, State: Initialized, Role: LEARNER
I20240502 01:59:28.482532 27067 consensus_queue.cc:260] T 25234fd535834012b836adcfcfe6aa78 P cf1bc781aacc4b5cb3d98af660b7b6a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: NON_VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: true } }
I20240502 01:59:28.482769 27067 ts_tablet_manager.cc:1398] T 25234fd535834012b836adcfcfe6aa78 P cf1bc781aacc4b5cb3d98af660b7b6a6: Time spent starting tablet: real 0.001s user 0.002s sys 0.002s
I20240502 01:59:28.483285 26350 tablet_copy_service.cc:342] P 766ec478e3fd41d19e1fcad9881b721d: Request end of tablet copy session cf1bc781aacc4b5cb3d98af660b7b6a6-25234fd535834012b836adcfcfe6aa78 received from {username='slave'} at 127.10.133.194:41011
I20240502 01:59:28.483366 26350 tablet_copy_service.cc:433] P 766ec478e3fd41d19e1fcad9881b721d: ending tablet copy session cf1bc781aacc4b5cb3d98af660b7b6a6-25234fd535834012b836adcfcfe6aa78 on tablet 25234fd535834012b836adcfcfe6aa78 with peer cf1bc781aacc4b5cb3d98af660b7b6a6
I20240502 01:59:28.610715 26640 raft_consensus.cc:1203] T 0f80de9d9d7e4004833b8fdb71754d33 P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:59:28.675540 26773 raft_consensus.cc:1203] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:59:28.828755 26773 raft_consensus.cc:1203] T 7bd526d64ec24706bc02cb4a87b1840f P d7706cd297b24c5e9919098d0fd279f8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:59:28.884747 26640 raft_consensus.cc:1203] T 4c474cfa879341b7b0957ee409376bab P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:59:28.907833 26773 raft_consensus.cc:1203] T 845975499fb04e9fbe2b20a161acb94f P d7706cd297b24c5e9919098d0fd279f8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:59:29.003221 26640 raft_consensus.cc:1203] T 25234fd535834012b836adcfcfe6aa78 P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.3->[1.4-1.4] Dedup: 1.4->[]
I20240502 01:59:29.037290 26963 raft_consensus.cc:1050] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d: attempting to promote NON_VOTER cf1bc781aacc4b5cb3d98af660b7b6a6 to VOTER
I20240502 01:59:29.037791 26963 consensus_queue.cc:237] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } }
I20240502 01:59:29.039167 25925 raft_consensus.cc:1261] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Refusing update from remote peer 766ec478e3fd41d19e1fcad9881b721d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:29.039171 26640 raft_consensus.cc:1261] T 0f80de9d9d7e4004833b8fdb71754d33 P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 LEARNER]: Refusing update from remote peer 766ec478e3fd41d19e1fcad9881b721d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:29.039690 27166 consensus_queue.cc:1035] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [LEADER]: Connected to new peer: Peer: permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:29.039919 27167 consensus_queue.cc:1035] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:29.042280 26963 raft_consensus.cc:2932] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } } }
I20240502 01:59:29.042829 25925 raft_consensus.cc:2932] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } } }
I20240502 01:59:29.044145 26640 raft_consensus.cc:2932] T 0f80de9d9d7e4004833b8fdb71754d33 P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } } }
I20240502 01:59:29.045400 25776 catalog_manager.cc:5484] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d reported cstate change: config changed from index 4 to 5, cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "766ec478e3fd41d19e1fcad9881b721d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:29.049479 26328 consensus_queue.cc:237] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } }
I20240502 01:59:29.050489 26640 raft_consensus.cc:1261] T 0f80de9d9d7e4004833b8fdb71754d33 P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 FOLLOWER]: Refusing update from remote peer 766ec478e3fd41d19e1fcad9881b721d: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:29.050957 27166 consensus_queue.cc:1035] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:29.052531 27167 raft_consensus.cc:2932] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 05e040a7804046ac81822a0ec26a69ed (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } } }
I20240502 01:59:29.052999 26640 raft_consensus.cc:2932] T 0f80de9d9d7e4004833b8fdb71754d33 P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 05e040a7804046ac81822a0ec26a69ed (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } } }
I20240502 01:59:29.053987 25765 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 0f80de9d9d7e4004833b8fdb71754d33 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:29.054948 25780 catalog_manager.cc:5484] T 0f80de9d9d7e4004833b8fdb71754d33 P 766ec478e3fd41d19e1fcad9881b721d reported cstate change: config changed from index 5 to 6, VOTER 05e040a7804046ac81822a0ec26a69ed (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "766ec478e3fd41d19e1fcad9881b721d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:29.057636 25903 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f80de9d9d7e4004833b8fdb71754d33 with delete_type TABLET_DATA_TOMBSTONED (TS 05e040a7804046ac81822a0ec26a69ed not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:53118
I20240502 01:59:29.058141 27218 tablet_replica.cc:330] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed: stopping tablet replica
I20240502 01:59:29.058535 27218 raft_consensus.cc:2229] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:29.058769 27218 raft_consensus.cc:2258] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:29.060170 27218 ts_tablet_manager.cc:1875] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:29.062489 27218 ts_tablet_manager.cc:1888] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:59:29.062640 27218 log.cc:1196] T 0f80de9d9d7e4004833b8fdb71754d33 P 05e040a7804046ac81822a0ec26a69ed: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/0f80de9d9d7e4004833b8fdb71754d33
I20240502 01:59:29.063295 25767 catalog_manager.cc:4830] TS 05e040a7804046ac81822a0ec26a69ed (127.10.133.193:38177): tablet 0f80de9d9d7e4004833b8fdb71754d33 (table rebalance_test_table_1 [id=1d36356d81ef4557afb95f702e37c3fa]) successfully deleted
I20240502 01:59:29.295049 26996 raft_consensus.cc:1050] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed: attempting to promote NON_VOTER d7706cd297b24c5e9919098d0fd279f8 to VOTER
I20240502 01:59:29.295466 26996 consensus_queue.cc:237] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } }
I20240502 01:59:29.296737 26773 raft_consensus.cc:1261] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 [term 1 LEARNER]: Refusing update from remote peer 05e040a7804046ac81822a0ec26a69ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:29.296732 26328 raft_consensus.cc:1261] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Refusing update from remote peer 05e040a7804046ac81822a0ec26a69ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:29.297168 27169 consensus_queue.cc:1035] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:29.297384 27168 consensus_queue.cc:1035] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:29.299189 27169 raft_consensus.cc:2932] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } } }
I20240502 01:59:29.299620 26328 raft_consensus.cc:2932] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } } }
I20240502 01:59:29.300693 26773 raft_consensus.cc:2932] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } } }
I20240502 01:59:29.302170 25780 catalog_manager.cc:5484] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed reported cstate change: config changed from index 4 to 5, d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "05e040a7804046ac81822a0ec26a69ed" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:29.306417 26996 raft_consensus.cc:1050] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed: attempting to promote NON_VOTER d7706cd297b24c5e9919098d0fd279f8 to VOTER
I20240502 01:59:29.306771 26996 consensus_queue.cc:237] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } }
I20240502 01:59:29.309376 26773 raft_consensus.cc:1261] T 7bd526d64ec24706bc02cb4a87b1840f P d7706cd297b24c5e9919098d0fd279f8 [term 1 LEARNER]: Refusing update from remote peer 05e040a7804046ac81822a0ec26a69ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:29.309650 26328 raft_consensus.cc:1261] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Refusing update from remote peer 05e040a7804046ac81822a0ec26a69ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:29.310071 27169 consensus_queue.cc:1035] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:29.310210 27168 consensus_queue.cc:1035] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:29.312304 27168 raft_consensus.cc:2932] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } } }
I20240502 01:59:29.314306 26773 raft_consensus.cc:2932] T 7bd526d64ec24706bc02cb4a87b1840f P d7706cd297b24c5e9919098d0fd279f8 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } } }
I20240502 01:59:29.314390 26328 raft_consensus.cc:2932] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } } }
I20240502 01:59:29.316516 25779 catalog_manager.cc:5484] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d reported cstate change: config changed from index 4 to 5, d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "05e040a7804046ac81822a0ec26a69ed" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } } }
I20240502 01:59:29.319859 25925 consensus_queue.cc:237] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } }
I20240502 01:59:29.320798 26773 raft_consensus.cc:1261] T 7bd526d64ec24706bc02cb4a87b1840f P d7706cd297b24c5e9919098d0fd279f8 [term 1 FOLLOWER]: Refusing update from remote peer 05e040a7804046ac81822a0ec26a69ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:29.321195 27169 consensus_queue.cc:1035] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:29.322767 27168 raft_consensus.cc:2932] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } } }
I20240502 01:59:29.323164 26773 raft_consensus.cc:2932] T 7bd526d64ec24706bc02cb4a87b1840f P d7706cd297b24c5e9919098d0fd279f8 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } } }
I20240502 01:59:29.324537 25767 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 7bd526d64ec24706bc02cb4a87b1840f with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:29.325106 25776 catalog_manager.cc:5484] T 7bd526d64ec24706bc02cb4a87b1840f P 05e040a7804046ac81822a0ec26a69ed reported cstate change: config changed from index 5 to 6, VOTER 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "05e040a7804046ac81822a0ec26a69ed" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:29.327453 26307 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bd526d64ec24706bc02cb4a87b1840f with delete_type TABLET_DATA_TOMBSTONED (TS 766ec478e3fd41d19e1fcad9881b721d not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:41932
I20240502 01:59:29.327946 27287 tablet_replica.cc:330] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d: stopping tablet replica
I20240502 01:59:29.328215 27287 raft_consensus.cc:2229] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:29.328385 27287 raft_consensus.cc:2258] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:29.329656 27287 ts_tablet_manager.cc:1875] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:29.331809 27287 ts_tablet_manager.cc:1888] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:59:29.331903 27287 log.cc:1196] T 7bd526d64ec24706bc02cb4a87b1840f P 766ec478e3fd41d19e1fcad9881b721d: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/7bd526d64ec24706bc02cb4a87b1840f
I20240502 01:59:29.332438 25765 catalog_manager.cc:4830] TS 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196:45865): tablet 7bd526d64ec24706bc02cb4a87b1840f (table rebalance_test_table_2 [id=fc3228ae04954ae2b302b822d881ac3e]) successfully deleted
I20240502 01:59:29.338104 25924 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "adc6a6b402bf488c9f8ff21ecbaf3385"
dest_uuid: "05e040a7804046ac81822a0ec26a69ed"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:53588
I20240502 01:59:29.338240 25924 raft_consensus.cc:595] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Received request to transfer leadership
I20240502 01:59:29.366360 25924 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "adc6a6b402bf488c9f8ff21ecbaf3385"
dest_uuid: "05e040a7804046ac81822a0ec26a69ed"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:53634
I20240502 01:59:29.366488 25924 raft_consensus.cc:595] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Received request to transfer leadership
I20240502 01:59:29.430032 26996 raft_consensus.cc:1050] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed: attempting to promote NON_VOTER d7706cd297b24c5e9919098d0fd279f8 to VOTER
I20240502 01:59:29.430392 26996 consensus_queue.cc:237] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } }
I20240502 01:59:29.431615 26328 raft_consensus.cc:1261] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Refusing update from remote peer 05e040a7804046ac81822a0ec26a69ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:29.431632 26773 raft_consensus.cc:1261] T 845975499fb04e9fbe2b20a161acb94f P d7706cd297b24c5e9919098d0fd279f8 [term 1 LEARNER]: Refusing update from remote peer 05e040a7804046ac81822a0ec26a69ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:29.432030 26996 consensus_queue.cc:1035] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:29.432232 27168 consensus_queue.cc:1035] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:29.434077 27169 raft_consensus.cc:2932] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } } }
I20240502 01:59:29.434492 26773 raft_consensus.cc:2932] T 845975499fb04e9fbe2b20a161acb94f P d7706cd297b24c5e9919098d0fd279f8 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } } }
I20240502 01:59:29.434530 26328 raft_consensus.cc:2932] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } } }
I20240502 01:59:29.436744 25776 catalog_manager.cc:5484] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed reported cstate change: config changed from index 4 to 5, d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "05e040a7804046ac81822a0ec26a69ed" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:29.439467 25924 consensus_queue.cc:237] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } }
I20240502 01:59:29.440340 26773 raft_consensus.cc:1261] T 845975499fb04e9fbe2b20a161acb94f P d7706cd297b24c5e9919098d0fd279f8 [term 1 FOLLOWER]: Refusing update from remote peer 05e040a7804046ac81822a0ec26a69ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:29.440666 26996 consensus_queue.cc:1035] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:29.441937 27168 raft_consensus.cc:2932] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } } }
I20240502 01:59:29.442386 26773 raft_consensus.cc:2932] T 845975499fb04e9fbe2b20a161acb94f P d7706cd297b24c5e9919098d0fd279f8 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } } }
I20240502 01:59:29.443187 25767 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 845975499fb04e9fbe2b20a161acb94f with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:29.444025 25780 catalog_manager.cc:5484] T 845975499fb04e9fbe2b20a161acb94f P 05e040a7804046ac81822a0ec26a69ed reported cstate change: config changed from index 5 to 6, VOTER 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "05e040a7804046ac81822a0ec26a69ed" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:29.446089 26307 tablet_service.cc:1514] Processing DeleteTablet for tablet 845975499fb04e9fbe2b20a161acb94f with delete_type TABLET_DATA_TOMBSTONED (TS 766ec478e3fd41d19e1fcad9881b721d not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:41932
I20240502 01:59:29.446311 27287 tablet_replica.cc:330] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d: stopping tablet replica
I20240502 01:59:29.446444 27287 raft_consensus.cc:2229] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:29.446596 27287 raft_consensus.cc:2258] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:29.447314 27287 ts_tablet_manager.cc:1875] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:29.448885 27287 ts_tablet_manager.cc:1888] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:59:29.448951 27287 log.cc:1196] T 845975499fb04e9fbe2b20a161acb94f P 766ec478e3fd41d19e1fcad9881b721d: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/845975499fb04e9fbe2b20a161acb94f
I20240502 01:59:29.449375 25765 catalog_manager.cc:4830] TS 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196:45865): tablet 845975499fb04e9fbe2b20a161acb94f (table rebalance_test_table_1 [id=1d36356d81ef4557afb95f702e37c3fa]) successfully deleted
I20240502 01:59:29.472754 27168 raft_consensus.cc:1050] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed: attempting to promote NON_VOTER cf1bc781aacc4b5cb3d98af660b7b6a6 to VOTER
I20240502 01:59:29.473122 27168 consensus_queue.cc:237] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } }
I20240502 01:59:29.474256 26640 raft_consensus.cc:1261] T 4c474cfa879341b7b0957ee409376bab P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 LEARNER]: Refusing update from remote peer 05e040a7804046ac81822a0ec26a69ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:29.474314 26328 raft_consensus.cc:1261] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Refusing update from remote peer 05e040a7804046ac81822a0ec26a69ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:29.474712 26996 consensus_queue.cc:1035] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:29.474925 27168 consensus_queue.cc:1035] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:29.476723 27169 raft_consensus.cc:2932] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } } }
I20240502 01:59:29.477180 26640 raft_consensus.cc:2932] T 4c474cfa879341b7b0957ee409376bab P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } } }
I20240502 01:59:29.477308 26328 raft_consensus.cc:2932] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } } }
I20240502 01:59:29.479400 25779 catalog_manager.cc:5484] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed reported cstate change: config changed from index 4 to 5, cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "05e040a7804046ac81822a0ec26a69ed" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:29.482110 25924 consensus_queue.cc:237] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } }
I20240502 01:59:29.482995 26640 raft_consensus.cc:1261] T 4c474cfa879341b7b0957ee409376bab P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 FOLLOWER]: Refusing update from remote peer 05e040a7804046ac81822a0ec26a69ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:29.483299 27168 consensus_queue.cc:1035] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:29.484566 26996 raft_consensus.cc:2932] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } } }
I20240502 01:59:29.484995 26640 raft_consensus.cc:2932] T 4c474cfa879341b7b0957ee409376bab P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } } }
I20240502 01:59:29.485919 25767 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 4c474cfa879341b7b0957ee409376bab with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:29.486815 25780 catalog_manager.cc:5484] T 4c474cfa879341b7b0957ee409376bab P 05e040a7804046ac81822a0ec26a69ed reported cstate change: config changed from index 5 to 6, VOTER 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "05e040a7804046ac81822a0ec26a69ed" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:29.488837 26307 tablet_service.cc:1514] Processing DeleteTablet for tablet 4c474cfa879341b7b0957ee409376bab with delete_type TABLET_DATA_TOMBSTONED (TS 766ec478e3fd41d19e1fcad9881b721d not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:41932
I20240502 01:59:29.489066 27287 tablet_replica.cc:330] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d: stopping tablet replica
I20240502 01:59:29.489219 27287 raft_consensus.cc:2229] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:29.489372 27287 raft_consensus.cc:2258] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:29.489961 27287 ts_tablet_manager.cc:1875] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:29.491751 27287 ts_tablet_manager.cc:1888] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:59:29.491822 27287 log.cc:1196] T 4c474cfa879341b7b0957ee409376bab P 766ec478e3fd41d19e1fcad9881b721d: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/4c474cfa879341b7b0957ee409376bab
I20240502 01:59:29.492264 25765 catalog_manager.cc:4830] TS 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196:45865): tablet 4c474cfa879341b7b0957ee409376bab (table rebalance_test_table_0 [id=bad97e39292c4a02a01b4d1cd61076fb]) successfully deleted
I20240502 01:59:29.592269 25924 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "adc6a6b402bf488c9f8ff21ecbaf3385"
dest_uuid: "05e040a7804046ac81822a0ec26a69ed"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:53660
I20240502 01:59:29.592401 25924 raft_consensus.cc:595] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Received request to transfer leadership
I20240502 01:59:29.606983 25924 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "adc6a6b402bf488c9f8ff21ecbaf3385"
dest_uuid: "05e040a7804046ac81822a0ec26a69ed"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:53666
I20240502 01:59:29.607115 25924 raft_consensus.cc:595] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Received request to transfer leadership
I20240502 01:59:29.612769 27381 raft_consensus.cc:1050] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d: attempting to promote NON_VOTER cf1bc781aacc4b5cb3d98af660b7b6a6 to VOTER
I20240502 01:59:29.613142 27381 consensus_queue.cc:237] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } }
I20240502 01:59:29.614332 26640 raft_consensus.cc:1261] T 25234fd535834012b836adcfcfe6aa78 P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 LEARNER]: Refusing update from remote peer 766ec478e3fd41d19e1fcad9881b721d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:29.614331 25924 raft_consensus.cc:1261] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Refusing update from remote peer 766ec478e3fd41d19e1fcad9881b721d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:29.614748 27383 consensus_queue.cc:1035] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [LEADER]: Connected to new peer: Peer: permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:29.614931 27166 consensus_queue.cc:1035] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:29.616765 27381 raft_consensus.cc:2932] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } } }
I20240502 01:59:29.617241 25924 raft_consensus.cc:2932] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } } }
I20240502 01:59:29.617352 26640 raft_consensus.cc:2932] T 25234fd535834012b836adcfcfe6aa78 P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } } }
I20240502 01:59:29.619717 25776 catalog_manager.cc:5484] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed reported cstate change: config changed from index 4 to 5, cf1bc781aacc4b5cb3d98af660b7b6a6 (127.10.133.194) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "766ec478e3fd41d19e1fcad9881b721d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } } }
I20240502 01:59:29.622922 26328 consensus_queue.cc:237] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } }
I20240502 01:59:29.623792 26640 raft_consensus.cc:1261] T 25234fd535834012b836adcfcfe6aa78 P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 FOLLOWER]: Refusing update from remote peer 766ec478e3fd41d19e1fcad9881b721d: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:29.624138 27383 consensus_queue.cc:1035] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:29.625448 27166 raft_consensus.cc:2932] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 05e040a7804046ac81822a0ec26a69ed (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } } }
I20240502 01:59:29.625947 26640 raft_consensus.cc:2932] T 25234fd535834012b836adcfcfe6aa78 P cf1bc781aacc4b5cb3d98af660b7b6a6 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, VOTER 05e040a7804046ac81822a0ec26a69ed (127.10.133.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } } }
I20240502 01:59:29.626765 25765 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 25234fd535834012b836adcfcfe6aa78 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:29.627503 25780 catalog_manager.cc:5484] T 25234fd535834012b836adcfcfe6aa78 P 766ec478e3fd41d19e1fcad9881b721d reported cstate change: config changed from index 5 to 6, VOTER 05e040a7804046ac81822a0ec26a69ed (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "766ec478e3fd41d19e1fcad9881b721d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf1bc781aacc4b5cb3d98af660b7b6a6" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 46463 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:29.629525 25903 tablet_service.cc:1514] Processing DeleteTablet for tablet 25234fd535834012b836adcfcfe6aa78 with delete_type TABLET_DATA_TOMBSTONED (TS 05e040a7804046ac81822a0ec26a69ed not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:53118
I20240502 01:59:29.629936 27386 tablet_replica.cc:330] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed: stopping tablet replica
I20240502 01:59:29.630093 27386 raft_consensus.cc:2229] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:29.630260 27386 raft_consensus.cc:2258] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:29.630884 27386 ts_tablet_manager.cc:1875] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:29.632530 27386 ts_tablet_manager.cc:1888] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.5
I20240502 01:59:29.632606 27386 log.cc:1196] T 25234fd535834012b836adcfcfe6aa78 P 05e040a7804046ac81822a0ec26a69ed: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/25234fd535834012b836adcfcfe6aa78
I20240502 01:59:29.633070 25767 catalog_manager.cc:4830] TS 05e040a7804046ac81822a0ec26a69ed (127.10.133.193:38177): tablet 25234fd535834012b836adcfcfe6aa78 (table rebalance_test_table_2 [id=fc3228ae04954ae2b302b822d881ac3e]) successfully deleted
I20240502 01:59:29.708683 26996 raft_consensus.cc:979] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed: : Instructing follower d7706cd297b24c5e9919098d0fd279f8 to start an election
I20240502 01:59:29.708797 26996 raft_consensus.cc:1067] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Signalling peer d7706cd297b24c5e9919098d0fd279f8 to start an election
I20240502 01:59:29.709443 26773 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "adc6a6b402bf488c9f8ff21ecbaf3385"
dest_uuid: "d7706cd297b24c5e9919098d0fd279f8"
from {username='slave'} at 127.10.133.193:40729
I20240502 01:59:29.709645 26773 raft_consensus.cc:482] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20240502 01:59:29.709753 26773 raft_consensus.cc:3037] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:59:29.710727 26773 raft_consensus.cc:504] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } }
I20240502 01:59:29.711680 26773 leader_election.cc:288] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 [CANDIDATE]: Term 2 election: Requested vote from peers 05e040a7804046ac81822a0ec26a69ed (127.10.133.193:38177), 766ec478e3fd41d19e1fcad9881b721d (127.10.133.196:45865)
I20240502 01:59:29.712028 25924 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc6a6b402bf488c9f8ff21ecbaf3385" candidate_uuid: "d7706cd297b24c5e9919098d0fd279f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "05e040a7804046ac81822a0ec26a69ed"
I20240502 01:59:29.712172 25924 raft_consensus.cc:3032] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Stepping down as leader of term 1
I20240502 01:59:29.712226 25924 raft_consensus.cc:729] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 05e040a7804046ac81822a0ec26a69ed, State: Running, Role: LEADER
I20240502 01:59:29.712390 25924 consensus_queue.cc:260] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } }
I20240502 01:59:29.712568 25924 raft_consensus.cc:3037] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:59:29.713577 25924 raft_consensus.cc:2454] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7706cd297b24c5e9919098d0fd279f8 in term 2.
I20240502 01:59:29.713958 26706 leader_election.cc:302] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05e040a7804046ac81822a0ec26a69ed, d7706cd297b24c5e9919098d0fd279f8; no voters:
I20240502 01:59:29.714226 27088 raft_consensus.cc:2781] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 01:59:29.714442 27088 raft_consensus.cc:686] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 [term 2 LEADER]: Becoming Leader. State: Replica: d7706cd297b24c5e9919098d0fd279f8, State: Running, Role: LEADER
I20240502 01:59:29.714733 27088 consensus_queue.cc:237] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } }
I20240502 01:59:29.716203 26328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adc6a6b402bf488c9f8ff21ecbaf3385" candidate_uuid: "d7706cd297b24c5e9919098d0fd279f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 5 } } ignore_live_leader: true dest_uuid: "766ec478e3fd41d19e1fcad9881b721d"
I20240502 01:59:29.716332 26328 raft_consensus.cc:3037] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d [term 1 FOLLOWER]: Advancing to term 2
I20240502 01:59:29.716753 25779 catalog_manager.cc:5484] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 reported cstate change: term changed from 1 to 2, leader changed from 05e040a7804046ac81822a0ec26a69ed (127.10.133.193) to d7706cd297b24c5e9919098d0fd279f8 (127.10.133.195). New cstate: current_term: 2 leader_uuid: "d7706cd297b24c5e9919098d0fd279f8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:29.717101 26328 raft_consensus.cc:2454] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7706cd297b24c5e9919098d0fd279f8 in term 2.
I20240502 01:59:30.155661 25924 raft_consensus.cc:1261] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 2 FOLLOWER]: Refusing update from remote peer d7706cd297b24c5e9919098d0fd279f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20240502 01:59:30.156201 27088 consensus_queue.cc:1035] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05e040a7804046ac81822a0ec26a69ed" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 38177 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:30.158954 26328 raft_consensus.cc:1261] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d [term 2 FOLLOWER]: Refusing update from remote peer d7706cd297b24c5e9919098d0fd279f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20240502 01:59:30.159317 27088 consensus_queue.cc:1035] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:30.618408 26773 consensus_queue.cc:237] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 2.6, Last appended by leader: 5, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } }
I20240502 01:59:30.619555 26328 raft_consensus.cc:1261] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d [term 2 FOLLOWER]: Refusing update from remote peer d7706cd297b24c5e9919098d0fd279f8: Log matching property violated. Preceding OpId in replica: term: 2 index: 6. Preceding OpId from leader: term: 2 index: 7. (index mismatch)
I20240502 01:59:30.619942 27424 consensus_queue.cc:1035] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:30.621569 27388 raft_consensus.cc:2932] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 [term 2 LEADER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER 05e040a7804046ac81822a0ec26a69ed (127.10.133.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } } }
I20240502 01:59:30.622072 26328 raft_consensus.cc:2932] T adc6a6b402bf488c9f8ff21ecbaf3385 P 766ec478e3fd41d19e1fcad9881b721d [term 2 FOLLOWER]: Committing config change with OpId 2.7: config changed from index 5 to 7, VOTER 05e040a7804046ac81822a0ec26a69ed (127.10.133.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } } }
I20240502 01:59:30.622995 25765 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet adc6a6b402bf488c9f8ff21ecbaf3385 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:30.624207 25779 catalog_manager.cc:5484] T adc6a6b402bf488c9f8ff21ecbaf3385 P d7706cd297b24c5e9919098d0fd279f8 reported cstate change: config changed from index 5 to 7, VOTER 05e040a7804046ac81822a0ec26a69ed (127.10.133.193) evicted. New cstate: current_term: 2 leader_uuid: "d7706cd297b24c5e9919098d0fd279f8" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "766ec478e3fd41d19e1fcad9881b721d" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7706cd297b24c5e9919098d0fd279f8" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 36453 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:30.626847 25903 tablet_service.cc:1514] Processing DeleteTablet for tablet adc6a6b402bf488c9f8ff21ecbaf3385 with delete_type TABLET_DATA_TOMBSTONED (TS 05e040a7804046ac81822a0ec26a69ed not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:53118
I20240502 01:59:30.627207 27429 tablet_replica.cc:330] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed: stopping tablet replica
I20240502 01:59:30.627367 27429 raft_consensus.cc:2229] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:30.627503 27429 raft_consensus.cc:2258] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:30.628067 27429 ts_tablet_manager.cc:1875] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:30.630336 27429 ts_tablet_manager.cc:1888] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.6
I20240502 01:59:30.630411 27429 log.cc:1196] T adc6a6b402bf488c9f8ff21ecbaf3385 P 05e040a7804046ac81822a0ec26a69ed: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.Rebalance_idx7_rf2_t3_l_1_2_1.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/adc6a6b402bf488c9f8ff21ecbaf3385
I20240502 01:59:30.630945 25767 catalog_manager.cc:4830] TS 05e040a7804046ac81822a0ec26a69ed (127.10.133.193:38177): tablet adc6a6b402bf488c9f8ff21ecbaf3385 (table rebalance_test_table_0 [id=bad97e39292c4a02a01b4d1cd61076fb]) successfully deleted
I20240502 01:59:30.698252 25903 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:30.698598 26307 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:59:30.698904 26752 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:30.706470 26620 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:30.785403 25903 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:30.786652 26752 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:30.787184 26307 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:59:30.787954 26620 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:30.868108 25903 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:30.868746 26620 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:30.870466 26307 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:59:30.870891 26752 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:30.907243 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 25843
I20240502 01:59:30.914369 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 26556
I20240502 01:59:30.920529 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 26689
I20240502 01:59:30.926645 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 26244
I20240502 01:59:30.933001 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 25750
2024-05-02T01:59:30Z chronyd exiting
[ OK ] LocationAwareRebalancingParamTest.Rebalance/idx7_rf2_t3_l_1_2_1 (10387 ms)
[ RUN ] LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer/idx6_rf7_t7_l_3_4_3
I20240502 01:59:30.959247 10775 test_util.cc:268] Using random seed: -198113398
I20240502 01:59:30.960067 10775 ts_itest-base.cc:112] Starting cluster with:
I20240502 01:59:30.960122 10775 ts_itest-base.cc:113] --------------
I20240502 01:59:30.960142 10775 ts_itest-base.cc:114] 10 tablet servers
I20240502 01:59:30.960160 10775 ts_itest-base.cc:115] 7 replicas per TS
I20240502 01:59:30.960184 10775 ts_itest-base.cc:116] --------------
2024-05-02T01:59:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T01:59:30Z Disabled control of system clock
I20240502 01:59:30.968441 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.133.254:40911
--webserver_interface=127.10.133.254
--webserver_port=0
--builtin_ntp_servers=127.10.133.212:44201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.133.254:40911
--location_mapping_cmd=/tmp/dist-test-taskVdqkLT/build/debug/bin/testdata/assign-location.py --state_store=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/location-assignment.state --map /A:3 --map /B:4 --map /C:3
--tserver_unresponsive_timeout_ms=3000
--enable_range_replica_placement=false
--raft_prepare_replacement_before_eviction=true
--enable_range_replica_placement=false
--master_client_location_assignment_enabled=false
--allow_unsafe_replication_factor with env {}
W20240502 01:59:31.079308 27548 flags.cc:425] Enabled unsafe flag: --allow_unsafe_replication_factor=true
W20240502 01:59:31.079586 27548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:31.079634 27548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:31.079890 27548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:31.084661 27548 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:31.084767 27548 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 01:59:31.084829 27548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:31.084877 27548 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 01:59:31.084916 27548 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 01:59:31.090313 27548 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:44201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
--allow_unsafe_replication_factor=true
--enable_range_replica_placement=false
--location_mapping_cmd=/tmp/dist-test-taskVdqkLT/build/debug/bin/testdata/assign-location.py --state_store=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/location-assignment.state --map /A:3 --map /B:4 --map /C:3
--ipki_ca_key_size=768
--master_addresses=127.10.133.254:40911
--tserver_unresponsive_timeout_ms=3000
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.133.254:40911
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.10.133.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.27548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:31.091478 27548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:31.092896 27548 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:31.100468 27553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:31.100929 27554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:31.101648 27548 server_base.cc:1034] running on GCE node
W20240502 01:59:31.103003 27556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:31.103529 27548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:31.104409 27548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:31.105561 27548 hybrid_clock.cc:648] HybridClock initialized: now 1714615171105542 us; error 32 us; skew 500 ppm
I20240502 01:59:31.107545 27548 webserver.cc:460] Webserver started at http://127.10.133.254:33749/ using document root <none> and password file <none>
I20240502 01:59:31.108091 27548 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:31.108152 27548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:31.108319 27548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:31.109911 27548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "64533e45b24049dfa6fee44bb97447b1"
format_stamp: "Formatted at 2024-05-02 01:59:31 on dist-test-slave-dr9f"
I20240502 01:59:31.110411 27548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "64533e45b24049dfa6fee44bb97447b1"
format_stamp: "Formatted at 2024-05-02 01:59:31 on dist-test-slave-dr9f"
I20240502 01:59:31.113538 27548 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20240502 01:59:31.115661 27562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:31.116612 27548 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:31.116730 27548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
uuid: "64533e45b24049dfa6fee44bb97447b1"
format_stamp: "Formatted at 2024-05-02 01:59:31 on dist-test-slave-dr9f"
I20240502 01:59:31.116813 27548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:31.129498 27548 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:31.130085 27548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:31.130211 27548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:31.136214 27548 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.254:40911
I20240502 01:59:31.136251 27621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.254:40911 every 8 connection(s)
I20240502 01:59:31.137130 27548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20240502 01:59:31.139608 27622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:31.143347 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 27548
I20240502 01:59:31.143462 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/master-0/wal/instance
I20240502 01:59:31.144738 27622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1: Bootstrap starting.
I20240502 01:59:31.146863 27622 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:31.147516 27622 log.cc:824] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:31.149016 27622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1: No bootstrap required, opened a new log
I20240502 01:59:31.151902 27622 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64533e45b24049dfa6fee44bb97447b1" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 40911 } }
I20240502 01:59:31.152069 27622 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:31.152107 27622 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64533e45b24049dfa6fee44bb97447b1, State: Initialized, Role: FOLLOWER
I20240502 01:59:31.152489 27622 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64533e45b24049dfa6fee44bb97447b1" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 40911 } }
I20240502 01:59:31.152603 27622 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 01:59:31.152665 27622 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 01:59:31.152779 27622 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:31.153499 27622 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64533e45b24049dfa6fee44bb97447b1" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 40911 } }
I20240502 01:59:31.153791 27622 leader_election.cc:302] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64533e45b24049dfa6fee44bb97447b1; no voters:
I20240502 01:59:31.154419 27622 leader_election.cc:288] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 01:59:31.154511 27627 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:31.154762 27627 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1 [term 1 LEADER]: Becoming Leader. State: Replica: 64533e45b24049dfa6fee44bb97447b1, State: Running, Role: LEADER
I20240502 01:59:31.155036 27627 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64533e45b24049dfa6fee44bb97447b1" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 40911 } }
I20240502 01:59:31.155483 27622 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 01:59:31.156656 27628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64533e45b24049dfa6fee44bb97447b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64533e45b24049dfa6fee44bb97447b1" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 40911 } } }
I20240502 01:59:31.156792 27628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1 [sys.catalog]: This master's current role is: LEADER
I20240502 01:59:31.157130 27636 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 01:59:31.157284 27629 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64533e45b24049dfa6fee44bb97447b1. Latest consensus state: current_term: 1 leader_uuid: "64533e45b24049dfa6fee44bb97447b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64533e45b24049dfa6fee44bb97447b1" member_type: VOTER last_known_addr { host: "127.10.133.254" port: 40911 } } }
I20240502 01:59:31.157375 27629 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1 [sys.catalog]: This master's current role is: LEADER
I20240502 01:59:31.159905 27636 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 01:59:31.164842 27636 catalog_manager.cc:1347] Generated new cluster ID: 614569de15434430a5f0a5d38112e3b2
I20240502 01:59:31.164897 27636 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 01:59:31.175285 27636 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 01:59:31.176424 27636 catalog_manager.cc:1504] Loading token signing keys...
I20240502 01:59:31.186475 27636 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 64533e45b24049dfa6fee44bb97447b1: Generated new TSK 0
I20240502 01:59:31.187148 27636 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 01:59:31.192382 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.193:0
--local_ip_for_outbound_sockets=127.10.133.193
--webserver_interface=127.10.133.193
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40911
--builtin_ntp_servers=127.10.133.212:44201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 01:59:31.306095 27646 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:31.306278 27646 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:31.306344 27646 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:31.309185 27646 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:31.309252 27646 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:31.309338 27646 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.193
I20240502 01:59:31.312808 27646 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:44201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.10.133.193
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40911
--never_fsync=true
--heap_profile_path=/tmp/kudu.27646
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.193
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:31.313572 27646 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:31.314622 27646 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:31.323107 27652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:31.323585 27651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:31.324268 27654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:31.325021 27646 server_base.cc:1034] running on GCE node
I20240502 01:59:31.325356 27646 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:31.325861 27646 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:31.327018 27646 hybrid_clock.cc:648] HybridClock initialized: now 1714615171327006 us; error 29 us; skew 500 ppm
I20240502 01:59:31.328843 27646 webserver.cc:460] Webserver started at http://127.10.133.193:33033/ using document root <none> and password file <none>
I20240502 01:59:31.329344 27646 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:31.329402 27646 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:31.329584 27646 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:31.331143 27646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "da58b5341d344efd833502f214e69ff1"
format_stamp: "Formatted at 2024-05-02 01:59:31 on dist-test-slave-dr9f"
I20240502 01:59:31.331593 27646 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "da58b5341d344efd833502f214e69ff1"
format_stamp: "Formatted at 2024-05-02 01:59:31 on dist-test-slave-dr9f"
I20240502 01:59:31.334709 27646 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 01:59:31.336834 27660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:31.337733 27646 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:31.337844 27646 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "da58b5341d344efd833502f214e69ff1"
format_stamp: "Formatted at 2024-05-02 01:59:31 on dist-test-slave-dr9f"
I20240502 01:59:31.337924 27646 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:31.358487 27646 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:31.359076 27646 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:31.359222 27646 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:31.359800 27646 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:31.360699 27646 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:31.360749 27646 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:31.360810 27646 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:31.360836 27646 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:31.368983 27646 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.193:40835
I20240502 01:59:31.369009 27775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.193:40835 every 8 connection(s)
I20240502 01:59:31.369844 27646 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20240502 01:59:31.378034 27776 heartbeater.cc:347] Connected to a master server at 127.10.133.254:40911
I20240502 01:59:31.378228 27776 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:31.378777 27776 heartbeater.cc:511] Master 127.10.133.254:40911 requested a full tablet report, sending...
I20240502 01:59:31.378856 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 27646
I20240502 01:59:31.378985 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20240502 01:59:31.381300 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.194:0
--local_ip_for_outbound_sockets=127.10.133.194
--webserver_interface=127.10.133.194
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40911
--builtin_ntp_servers=127.10.133.212:44201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:59:31.428887 27579 ts_manager.cc:194] Registered new tserver with Master: da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835)
I20240502 01:59:31.430327 27579 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.193:40073
W20240502 01:59:31.502565 27780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:31.502748 27780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:31.502794 27780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:31.505730 27780 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:31.505785 27780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:31.505895 27780 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.194
I20240502 01:59:31.509361 27780 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:44201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.10.133.194
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40911
--never_fsync=true
--heap_profile_path=/tmp/kudu.27780
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.194
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:31.510181 27780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:31.511225 27780 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:31.519528 27785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:31.519930 27788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:31.520622 27786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:31.521369 27780 server_base.cc:1034] running on GCE node
I20240502 01:59:31.521746 27780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:31.522342 27780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:31.523492 27780 hybrid_clock.cc:648] HybridClock initialized: now 1714615171523473 us; error 33 us; skew 500 ppm
I20240502 01:59:31.525413 27780 webserver.cc:460] Webserver started at http://127.10.133.194:44523/ using document root <none> and password file <none>
I20240502 01:59:31.525970 27780 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:31.526080 27780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:31.526264 27780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:31.528123 27780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98"
format_stamp: "Formatted at 2024-05-02 01:59:31 on dist-test-slave-dr9f"
I20240502 01:59:31.528712 27780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98"
format_stamp: "Formatted at 2024-05-02 01:59:31 on dist-test-slave-dr9f"
I20240502 01:59:31.533439 27780 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20240502 01:59:31.536016 27794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:31.537040 27780 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:31.537156 27780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98"
format_stamp: "Formatted at 2024-05-02 01:59:31 on dist-test-slave-dr9f"
I20240502 01:59:31.537240 27780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:31.554277 27780 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:31.554836 27780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:31.554989 27780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:31.555550 27780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:31.556437 27780 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:31.556485 27780 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:31.556540 27780 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:31.556571 27780 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:31.564589 27780 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.194:37731
I20240502 01:59:31.564639 27910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.194:37731 every 8 connection(s)
I20240502 01:59:31.565465 27780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20240502 01:59:31.567767 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 27780
I20240502 01:59:31.567896 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20240502 01:59:31.569866 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.195:0
--local_ip_for_outbound_sockets=127.10.133.195
--webserver_interface=127.10.133.195
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40911
--builtin_ntp_servers=127.10.133.212:44201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:59:31.573956 27911 heartbeater.cc:347] Connected to a master server at 127.10.133.254:40911
I20240502 01:59:31.574221 27911 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:31.574888 27911 heartbeater.cc:511] Master 127.10.133.254:40911 requested a full tablet report, sending...
I20240502 01:59:31.613353 27579 ts_manager.cc:194] Registered new tserver with Master: a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731)
I20240502 01:59:31.614576 27579 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.194:48863
W20240502 01:59:31.680431 27914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:31.680640 27914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:31.680691 27914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:31.683645 27914 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:31.683704 27914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:31.683768 27914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.195
I20240502 01:59:31.687323 27914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:44201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.10.133.195
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40911
--never_fsync=true
--heap_profile_path=/tmp/kudu.27914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.195
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:31.688124 27914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:31.689183 27914 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:31.697214 27920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:31.697943 27921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:31.698487 27923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:31.699252 27914 server_base.cc:1034] running on GCE node
I20240502 01:59:31.699584 27914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:31.700106 27914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:31.701258 27914 hybrid_clock.cc:648] HybridClock initialized: now 1714615171701247 us; error 23 us; skew 500 ppm
I20240502 01:59:31.703159 27914 webserver.cc:460] Webserver started at http://127.10.133.195:43907/ using document root <none> and password file <none>
I20240502 01:59:31.703691 27914 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:31.703744 27914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:31.703963 27914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:31.705571 27914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "86e11777d9d744d0a5a8139c99e89f4f"
format_stamp: "Formatted at 2024-05-02 01:59:31 on dist-test-slave-dr9f"
I20240502 01:59:31.706138 27914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "86e11777d9d744d0a5a8139c99e89f4f"
format_stamp: "Formatted at 2024-05-02 01:59:31 on dist-test-slave-dr9f"
I20240502 01:59:31.709326 27914 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20240502 01:59:31.711354 27929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:31.712355 27914 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:31.712463 27914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "86e11777d9d744d0a5a8139c99e89f4f"
format_stamp: "Formatted at 2024-05-02 01:59:31 on dist-test-slave-dr9f"
I20240502 01:59:31.712545 27914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:31.729350 27914 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:31.729938 27914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:31.730105 27914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:31.730602 27914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:31.731474 27914 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:31.731524 27914 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:31.731585 27914 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:31.731609 27914 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:31.739490 27914 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.195:42917
I20240502 01:59:31.739542 28045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.195:42917 every 8 connection(s)
I20240502 01:59:31.740397 27914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20240502 01:59:31.746479 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 27914
I20240502 01:59:31.746585 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20240502 01:59:31.748724 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.196:0
--local_ip_for_outbound_sockets=127.10.133.196
--webserver_interface=127.10.133.196
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40911
--builtin_ntp_servers=127.10.133.212:44201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:59:31.749979 28046 heartbeater.cc:347] Connected to a master server at 127.10.133.254:40911
I20240502 01:59:31.750211 28046 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:31.750694 28046 heartbeater.cc:511] Master 127.10.133.254:40911 requested a full tablet report, sending...
I20240502 01:59:31.785396 27579 ts_manager.cc:194] Registered new tserver with Master: 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917)
I20240502 01:59:31.786180 27579 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.195:32777
W20240502 01:59:31.854311 28049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:31.854506 28049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:31.854574 28049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:31.857583 28049 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:31.857650 28049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:31.857756 28049 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.196
I20240502 01:59:31.861263 28049 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:44201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.196:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.10.133.196
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40911
--never_fsync=true
--heap_profile_path=/tmp/kudu.28049
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.196
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:31.862104 28049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:31.863149 28049 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:31.871083 28056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:31.871598 28055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:31.872210 28058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:31.873082 28049 server_base.cc:1034] running on GCE node
I20240502 01:59:31.873437 28049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:31.873972 28049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:31.875152 28049 hybrid_clock.cc:648] HybridClock initialized: now 1714615171875142 us; error 31 us; skew 500 ppm
I20240502 01:59:31.876967 28049 webserver.cc:460] Webserver started at http://127.10.133.196:33269/ using document root <none> and password file <none>
I20240502 01:59:31.877548 28049 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:31.877609 28049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:31.877801 28049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:31.879429 28049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "82e8cba6ed104c2c9869ea0365bbe482"
format_stamp: "Formatted at 2024-05-02 01:59:31 on dist-test-slave-dr9f"
I20240502 01:59:31.879918 28049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "82e8cba6ed104c2c9869ea0365bbe482"
format_stamp: "Formatted at 2024-05-02 01:59:31 on dist-test-slave-dr9f"
I20240502 01:59:31.883132 28049 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.001s
I20240502 01:59:31.885182 28064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:31.886160 28049 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20240502 01:59:31.886260 28049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "82e8cba6ed104c2c9869ea0365bbe482"
format_stamp: "Formatted at 2024-05-02 01:59:31 on dist-test-slave-dr9f"
I20240502 01:59:31.886348 28049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:31.896927 28049 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:31.897452 28049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:31.897599 28049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:31.898125 28049 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:31.898955 28049 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:31.899006 28049 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:31.899051 28049 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:31.899082 28049 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:31.907086 28049 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.196:41553
I20240502 01:59:31.907107 28179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.196:41553 every 8 connection(s)
I20240502 01:59:31.907931 28049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20240502 01:59:31.914898 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 28049
I20240502 01:59:31.915021 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20240502 01:59:31.916218 28180 heartbeater.cc:347] Connected to a master server at 127.10.133.254:40911
I20240502 01:59:31.916437 28180 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:31.916965 28180 heartbeater.cc:511] Master 127.10.133.254:40911 requested a full tablet report, sending...
I20240502 01:59:31.917232 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.197:0
--local_ip_for_outbound_sockets=127.10.133.197
--webserver_interface=127.10.133.197
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40911
--builtin_ntp_servers=127.10.133.212:44201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:59:31.960211 27578 ts_manager.cc:194] Registered new tserver with Master: 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553)
I20240502 01:59:31.961197 27578 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.196:51051
W20240502 01:59:32.025756 28183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:32.025956 28183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:32.026016 28183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:32.028892 28183 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:32.028954 28183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:32.029014 28183 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.197
I20240502 01:59:32.032414 28183 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:44201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.197:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/info.pb
--webserver_interface=127.10.133.197
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40911
--never_fsync=true
--heap_profile_path=/tmp/kudu.28183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.197
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:32.033174 28183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:32.034217 28183 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:32.042182 28189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:32.042904 28190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:32.043471 28192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:32.044193 28183 server_base.cc:1034] running on GCE node
I20240502 01:59:32.044538 28183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:32.045023 28183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:32.046168 28183 hybrid_clock.cc:648] HybridClock initialized: now 1714615172046157 us; error 27 us; skew 500 ppm
I20240502 01:59:32.047863 28183 webserver.cc:460] Webserver started at http://127.10.133.197:34997/ using document root <none> and password file <none>
I20240502 01:59:32.048364 28183 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:32.048424 28183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:32.048586 28183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:32.050525 28183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/instance:
uuid: "8ed4b4242123404f86485ec57dc34e88"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:32.051100 28183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal/instance:
uuid: "8ed4b4242123404f86485ec57dc34e88"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:32.054505 28183 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20240502 01:59:32.056530 28198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:32.057521 28183 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:32.057619 28183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
uuid: "8ed4b4242123404f86485ec57dc34e88"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:32.057698 28183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:32.074374 28183 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:32.074868 28183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:32.075017 28183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:32.075487 28183 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:32.076298 28183 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:32.076345 28183 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:32.076398 28183 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:32.076431 28183 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:32.084544 28183 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.197:46567
I20240502 01:59:32.084566 28313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.197:46567 every 8 connection(s)
I20240502 01:59:32.085386 28183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/data/info.pb
I20240502 01:59:32.093050 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 28183
I20240502 01:59:32.093169 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal/instance
I20240502 01:59:32.093917 28314 heartbeater.cc:347] Connected to a master server at 127.10.133.254:40911
I20240502 01:59:32.094172 28314 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:32.094702 28314 heartbeater.cc:511] Master 127.10.133.254:40911 requested a full tablet report, sending...
I20240502 01:59:32.095408 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.198:0
--local_ip_for_outbound_sockets=127.10.133.198
--webserver_interface=127.10.133.198
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40911
--builtin_ntp_servers=127.10.133.212:44201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:59:32.133622 27578 ts_manager.cc:194] Registered new tserver with Master: 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567)
I20240502 01:59:32.134536 27578 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.197:40481
W20240502 01:59:32.203483 28317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:32.203713 28317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:32.203791 28317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:32.206760 28317 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:32.206830 28317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:32.206919 28317 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.198
I20240502 01:59:32.210423 28317 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:44201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.198:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/info.pb
--webserver_interface=127.10.133.198
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40911
--never_fsync=true
--heap_profile_path=/tmp/kudu.28317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.198
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:32.211258 28317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:32.212352 28317 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:32.220551 28326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:32.221171 28323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:32.221648 28324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:32.222505 28317 server_base.cc:1034] running on GCE node
I20240502 01:59:32.222843 28317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:32.223356 28317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:32.224500 28317 hybrid_clock.cc:648] HybridClock initialized: now 1714615172224486 us; error 28 us; skew 500 ppm
I20240502 01:59:32.226306 28317 webserver.cc:460] Webserver started at http://127.10.133.198:40871/ using document root <none> and password file <none>
I20240502 01:59:32.226812 28317 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:32.226874 28317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:32.227069 28317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:32.228582 28317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/instance:
uuid: "12f527e76eff4669924a898d5029e3d1"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:32.229036 28317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal/instance:
uuid: "12f527e76eff4669924a898d5029e3d1"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:32.232228 28317 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 01:59:32.234333 28332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:32.235248 28317 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:32.235352 28317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal
uuid: "12f527e76eff4669924a898d5029e3d1"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:32.235430 28317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:32.248422 28317 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:32.248948 28317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:32.249091 28317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:32.249559 28317 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:32.250424 28317 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:32.250488 28317 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:32.250541 28317 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:32.250566 28317 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:32.259052 28317 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.198:44921
I20240502 01:59:32.259095 28447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.198:44921 every 8 connection(s)
I20240502 01:59:32.259910 28317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/data/info.pb
I20240502 01:59:32.260757 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 28317
I20240502 01:59:32.260882 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal/instance
I20240502 01:59:32.263029 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.199:0
--local_ip_for_outbound_sockets=127.10.133.199
--webserver_interface=127.10.133.199
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40911
--builtin_ntp_servers=127.10.133.212:44201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:59:32.268694 28448 heartbeater.cc:347] Connected to a master server at 127.10.133.254:40911
I20240502 01:59:32.269018 28448 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:32.269948 28448 heartbeater.cc:511] Master 127.10.133.254:40911 requested a full tablet report, sending...
I20240502 01:59:32.310752 27578 ts_manager.cc:194] Registered new tserver with Master: 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921)
I20240502 01:59:32.311504 27578 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.198:39485
W20240502 01:59:32.378541 28451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:32.378741 28451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:32.378808 28451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:32.381628 28451 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:32.381686 28451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:32.381800 28451 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.199
I20240502 01:59:32.386803 28451 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:44201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.199:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/info.pb
--webserver_interface=127.10.133.199
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40911
--never_fsync=true
--heap_profile_path=/tmp/kudu.28451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.199
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:32.388767 28451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:32.389843 28451 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:32.397964 28458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:32.398473 28457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:32.399300 28460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:32.399935 28451 server_base.cc:1034] running on GCE node
I20240502 01:59:32.400271 28451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:32.400770 28451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:32.401912 28451 hybrid_clock.cc:648] HybridClock initialized: now 1714615172401902 us; error 27 us; skew 500 ppm
I20240502 01:59:32.403769 28451 webserver.cc:460] Webserver started at http://127.10.133.199:44339/ using document root <none> and password file <none>
I20240502 01:59:32.404305 28451 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:32.404366 28451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:32.404536 28451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:32.406165 28451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/instance:
uuid: "257826b7ad7e4abb8499b6687e8c83eb"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:32.406636 28451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal/instance:
uuid: "257826b7ad7e4abb8499b6687e8c83eb"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:32.409754 28451 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20240502 01:59:32.411898 28466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:32.412839 28451 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20240502 01:59:32.412938 28451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
uuid: "257826b7ad7e4abb8499b6687e8c83eb"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:32.413019 28451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:32.433161 27776 heartbeater.cc:503] Master 127.10.133.254:40911 was elected leader, sending a full tablet report...
I20240502 01:59:32.435134 28451 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:32.435726 28451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:32.435881 28451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:32.436415 28451 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:32.437275 28451 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:32.437323 28451 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:32.437382 28451 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:32.437409 28451 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:32.445916 28451 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.199:35629
I20240502 01:59:32.445948 28580 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.199:35629 every 8 connection(s)
I20240502 01:59:32.446818 28451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/data/info.pb
I20240502 01:59:32.449431 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 28451
I20240502 01:59:32.449560 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal/instance
I20240502 01:59:32.451565 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.200:0
--local_ip_for_outbound_sockets=127.10.133.200
--webserver_interface=127.10.133.200
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40911
--builtin_ntp_servers=127.10.133.212:44201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:59:32.455323 28581 heartbeater.cc:347] Connected to a master server at 127.10.133.254:40911
I20240502 01:59:32.455564 28581 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:32.456275 28581 heartbeater.cc:511] Master 127.10.133.254:40911 requested a full tablet report, sending...
I20240502 01:59:32.515353 27578 ts_manager.cc:194] Registered new tserver with Master: 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:32.516320 27578 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.199:50193
W20240502 01:59:32.563380 28584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:32.563565 28584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:32.563604 28584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:32.566517 28584 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:32.566572 28584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:32.566663 28584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.200
I20240502 01:59:32.570135 28584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:44201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.200:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--webserver_interface=127.10.133.200
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40911
--never_fsync=true
--heap_profile_path=/tmp/kudu.28584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.200
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:32.570838 28584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:32.571833 28584 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:32.579942 28590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:32.580525 28593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:32.581080 28591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:32.581784 28584 server_base.cc:1034] running on GCE node
I20240502 01:59:32.582137 28584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:32.582616 28584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:32.583758 28584 hybrid_clock.cc:648] HybridClock initialized: now 1714615172583735 us; error 36 us; skew 500 ppm
I20240502 01:59:32.585464 28584 webserver.cc:460] Webserver started at http://127.10.133.200:35349/ using document root <none> and password file <none>
I20240502 01:59:32.586030 28584 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:32.586091 28584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:32.586272 28584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:32.587827 28584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/instance:
uuid: "0003837e2d88424093594ed169d82cd2"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:32.588271 28584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal/instance:
uuid: "0003837e2d88424093594ed169d82cd2"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:32.591487 28584 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 01:59:32.593459 28599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:32.594412 28584 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:32.594514 28584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
uuid: "0003837e2d88424093594ed169d82cd2"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:32.594601 28584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:32.616797 27911 heartbeater.cc:503] Master 127.10.133.254:40911 was elected leader, sending a full tablet report...
I20240502 01:59:32.619298 28584 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:32.619839 28584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:32.619995 28584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:32.620527 28584 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:32.621388 28584 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:32.621445 28584 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:32.621503 28584 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:32.621527 28584 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:32.629552 28584 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.200:45585
I20240502 01:59:32.629583 28715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.200:45585 every 8 connection(s)
I20240502 01:59:32.630473 28584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/info.pb
I20240502 01:59:32.637499 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 28584
I20240502 01:59:32.637650 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal/instance
I20240502 01:59:32.638648 28716 heartbeater.cc:347] Connected to a master server at 127.10.133.254:40911
I20240502 01:59:32.638857 28716 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:32.639410 28716 heartbeater.cc:511] Master 127.10.133.254:40911 requested a full tablet report, sending...
I20240502 01:59:32.639773 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.201:0
--local_ip_for_outbound_sockets=127.10.133.201
--webserver_interface=127.10.133.201
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40911
--builtin_ntp_servers=127.10.133.212:44201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:59:32.672631 27578 ts_manager.cc:194] Registered new tserver with Master: 0003837e2d88424093594ed169d82cd2 (127.10.133.200:45585)
I20240502 01:59:32.673563 27578 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.200:44223
W20240502 01:59:32.745618 28719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:32.745796 28719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:32.745836 28719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:32.748714 28719 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:32.748767 28719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:32.748828 28719 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.201
I20240502 01:59:32.752316 28719 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:44201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.201:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data/info.pb
--webserver_interface=127.10.133.201
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40911
--never_fsync=true
--heap_profile_path=/tmp/kudu.28719
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.201
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:32.753093 28719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:32.754228 28719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:32.762769 28726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:32.763450 28725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:32.764025 28728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:32.764816 28719 server_base.cc:1034] running on GCE node
I20240502 01:59:32.765180 28719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:32.765712 28719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:32.766853 28719 hybrid_clock.cc:648] HybridClock initialized: now 1714615172766831 us; error 37 us; skew 500 ppm
I20240502 01:59:32.768725 28719 webserver.cc:460] Webserver started at http://127.10.133.201:46711/ using document root <none> and password file <none>
I20240502 01:59:32.769249 28719 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:32.769300 28719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:32.769469 28719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:32.771077 28719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data/instance:
uuid: "7332064716f04e84ba81c1f2b70821f9"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:32.771556 28719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal/instance:
uuid: "7332064716f04e84ba81c1f2b70821f9"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:32.774698 28719 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20240502 01:59:32.776912 28734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:32.777853 28719 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:32.777962 28719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal
uuid: "7332064716f04e84ba81c1f2b70821f9"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:32.778074 28719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:32.788280 28046 heartbeater.cc:503] Master 127.10.133.254:40911 was elected leader, sending a full tablet report...
I20240502 01:59:32.794443 28719 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:32.795004 28719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:32.795166 28719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:32.795708 28719 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:32.796507 28719 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:32.796551 28719 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:32.796589 28719 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:32.796609 28719 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:32.804527 28719 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.201:40597
I20240502 01:59:32.804571 28850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.201:40597 every 8 connection(s)
I20240502 01:59:32.805424 28719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data/info.pb
I20240502 01:59:32.813427 28851 heartbeater.cc:347] Connected to a master server at 127.10.133.254:40911
I20240502 01:59:32.813621 28851 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:32.814195 28851 heartbeater.cc:511] Master 127.10.133.254:40911 requested a full tablet report, sending...
I20240502 01:59:32.815559 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 28719
I20240502 01:59:32.815721 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal/instance
I20240502 01:59:32.818507 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.202:0
--local_ip_for_outbound_sockets=127.10.133.202
--webserver_interface=127.10.133.202
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40911
--builtin_ntp_servers=127.10.133.212:44201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:59:32.847381 27578 ts_manager.cc:194] Registered new tserver with Master: 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201:40597)
I20240502 01:59:32.848058 27578 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.201:48697
W20240502 01:59:32.926362 28855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:32.926564 28855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:32.926638 28855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:32.929558 28855 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:32.929625 28855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:32.929713 28855 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.202
I20240502 01:59:32.933264 28855 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:44201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.202:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/data/info.pb
--webserver_interface=127.10.133.202
--webserver_port=0
--tserver_master_addrs=127.10.133.254:40911
--never_fsync=true
--heap_profile_path=/tmp/kudu.28855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.202
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:32.934141 28855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:32.935225 28855 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:32.943531 28863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:32.944051 28861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:32.944725 28860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:32.945362 28855 server_base.cc:1034] running on GCE node
I20240502 01:59:32.945693 28855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:32.946215 28855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:32.947355 28855 hybrid_clock.cc:648] HybridClock initialized: now 1714615172947343 us; error 26 us; skew 500 ppm
I20240502 01:59:32.949266 28855 webserver.cc:460] Webserver started at http://127.10.133.202:33215/ using document root <none> and password file <none>
I20240502 01:59:32.949810 28855 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:32.949863 28855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:32.950078 28855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 01:59:32.951678 28855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/data/instance:
uuid: "845294d663994245b540c006dca93b7d"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:32.952124 28855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/wal/instance:
uuid: "845294d663994245b540c006dca93b7d"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:32.955327 28855 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20240502 01:59:32.957535 28869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:32.958474 28855 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:32.958576 28855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/wal
uuid: "845294d663994245b540c006dca93b7d"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:32.958653 28855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:32.963335 28180 heartbeater.cc:503] Master 127.10.133.254:40911 was elected leader, sending a full tablet report...
I20240502 01:59:32.978646 28855 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:32.979175 28855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:32.979292 28855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:32.979727 28855 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:32.980501 28855 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:32.980546 28855 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:32.980581 28855 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:32.980600 28855 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:32.988803 28855 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.202:45645
I20240502 01:59:32.988835 28984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.202:45645 every 8 connection(s)
I20240502 01:59:32.989730 28855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/data/info.pb
I20240502 01:59:32.994459 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 28855
I20240502 01:59:32.994581 10775 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/wal/instance
I20240502 01:59:32.998427 28985 heartbeater.cc:347] Connected to a master server at 127.10.133.254:40911
I20240502 01:59:32.998626 28985 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:32.999145 28985 heartbeater.cc:511] Master 127.10.133.254:40911 requested a full tablet report, sending...
I20240502 01:59:33.032989 27578 ts_manager.cc:194] Registered new tserver with Master: 845294d663994245b540c006dca93b7d (127.10.133.202:45645)
I20240502 01:59:33.033646 27578 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.202:46697
I20240502 01:59:33.044595 10775 external_mini_cluster.cc:930] 10 TS(s) registered with all masters
I20240502 01:59:33.054013 10775 external_mini_cluster.cc:930] 10 TS(s) registered with all masters
I20240502 01:59:33.054104 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 28584
I20240502 01:59:33.060375 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 28719
I20240502 01:59:33.066666 10775 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu with pid 28855
I20240502 01:59:33.136821 28314 heartbeater.cc:503] Master 127.10.133.254:40911 was elected leader, sending a full tablet report...
I20240502 01:59:33.314069 28448 heartbeater.cc:503] Master 127.10.133.254:40911 was elected leader, sending a full tablet report...
I20240502 01:59:33.518601 28581 heartbeater.cc:503] Master 127.10.133.254:40911 was elected leader, sending a full tablet report...
I20240502 01:59:36.823458 27578 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55090:
name: "rebalance_test_table_0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 7
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20240502 01:59:36.826910 27578 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_0 in case of a server failure: 8 tablet servers would be needed, 7 are available. Consider bringing up more tablet servers.
I20240502 01:59:36.846022 28381 tablet_service.cc:1467] Processing CreateTablet for tablet 77e62ec43c8d442b9846f05439ac7a99 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:36.846028 28514 tablet_service.cc:1467] Processing CreateTablet for tablet 13a5600dc379460b9c433ffdaa0b3d02 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:36.847036 28514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13a5600dc379460b9c433ffdaa0b3d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.847038 28381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77e62ec43c8d442b9846f05439ac7a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.848399 28246 tablet_service.cc:1467] Processing CreateTablet for tablet 77e62ec43c8d442b9846f05439ac7a99 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:36.849328 28246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77e62ec43c8d442b9846f05439ac7a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.850943 28380 tablet_service.cc:1467] Processing CreateTablet for tablet 13a5600dc379460b9c433ffdaa0b3d02 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:36.846026 28515 tablet_service.cc:1467] Processing CreateTablet for tablet 77e62ec43c8d442b9846f05439ac7a99 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:36.851208 28380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13a5600dc379460b9c433ffdaa0b3d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.851235 28515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77e62ec43c8d442b9846f05439ac7a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.855240 28245 tablet_service.cc:1467] Processing CreateTablet for tablet 13a5600dc379460b9c433ffdaa0b3d02 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:36.855505 28245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13a5600dc379460b9c433ffdaa0b3d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.855780 29012 tablet_bootstrap.cc:492] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:36.856684 27708 tablet_service.cc:1467] Processing CreateTablet for tablet 77e62ec43c8d442b9846f05439ac7a99 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:36.857573 27708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77e62ec43c8d442b9846f05439ac7a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.858264 27707 tablet_service.cc:1467] Processing CreateTablet for tablet 13a5600dc379460b9c433ffdaa0b3d02 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:36.858494 27707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13a5600dc379460b9c433ffdaa0b3d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.858670 29012 tablet_bootstrap.cc:654] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.859470 29012 log.cc:824] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:36.861239 29012 tablet_bootstrap.cc:492] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:36.861407 29012 ts_tablet_manager.cc:1367] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20240502 01:59:36.864233 27978 tablet_service.cc:1467] Processing CreateTablet for tablet 77e62ec43c8d442b9846f05439ac7a99 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:36.865135 27978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77e62ec43c8d442b9846f05439ac7a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.865082 29012 raft_consensus.cc:348] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } }
I20240502 01:59:36.865295 29012 raft_consensus.cc:374] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.865343 29012 raft_consensus.cc:729] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.865064 27843 tablet_service.cc:1467] Processing CreateTablet for tablet 77e62ec43c8d442b9846f05439ac7a99 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:36.865064 27842 tablet_service.cc:1467] Processing CreateTablet for tablet 13a5600dc379460b9c433ffdaa0b3d02 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:36.865919 27843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77e62ec43c8d442b9846f05439ac7a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.866266 27977 tablet_service.cc:1467] Processing CreateTablet for tablet 13a5600dc379460b9c433ffdaa0b3d02 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:36.866531 27977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13a5600dc379460b9c433ffdaa0b3d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.866729 29012 consensus_queue.cc:260] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } }
I20240502 01:59:36.867604 29012 ts_tablet_manager.cc:1398] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20240502 01:59:36.867985 29012 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:36.868157 28113 tablet_service.cc:1467] Processing CreateTablet for tablet 77e62ec43c8d442b9846f05439ac7a99 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:36.868953 29012 tablet_bootstrap.cc:654] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.869014 28113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77e62ec43c8d442b9846f05439ac7a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.870179 29012 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:36.870255 29012 ts_tablet_manager.cc:1367] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:36.870267 28112 tablet_service.cc:1467] Processing CreateTablet for tablet 13a5600dc379460b9c433ffdaa0b3d02 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:36.870508 28112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13a5600dc379460b9c433ffdaa0b3d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.871119 29012 raft_consensus.cc:348] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:36.871326 29012 raft_consensus.cc:374] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.871448 29012 raft_consensus.cc:729] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.871678 29012 consensus_queue.cc:260] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:36.872114 29012 ts_tablet_manager.cc:1398] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:36.872447 29019 raft_consensus.cc:482] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:36.872632 29019 raft_consensus.cc:504] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } }
I20240502 01:59:36.875794 27842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13a5600dc379460b9c433ffdaa0b3d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.876796 29019 leader_election.cc:288] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731)
I20240502 01:59:36.877691 29018 tablet_bootstrap.cc:492] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
I20240502 01:59:36.879983 29018 tablet_bootstrap.cc:654] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.881896 28245 tablet_service.cc:1467] Processing CreateTablet for tablet b2133628f3584c8c900e569d8f45d3a9 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:36.881889 28113 tablet_service.cc:1467] Processing CreateTablet for tablet b2133628f3584c8c900e569d8f45d3a9 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:36.882160 28245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2133628f3584c8c900e569d8f45d3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.882160 28113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2133628f3584c8c900e569d8f45d3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.882128 28380 tablet_service.cc:1467] Processing CreateTablet for tablet b2133628f3584c8c900e569d8f45d3a9 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:36.882409 28380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2133628f3584c8c900e569d8f45d3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.884332 29012 tablet_bootstrap.cc:492] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:36.884855 29018 log.cc:824] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:36.885090 28514 tablet_service.cc:1467] Processing CreateTablet for tablet b2133628f3584c8c900e569d8f45d3a9 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:36.885283 29012 tablet_bootstrap.cc:654] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.885389 28514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2133628f3584c8c900e569d8f45d3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.886983 27977 tablet_service.cc:1467] Processing CreateTablet for tablet b2133628f3584c8c900e569d8f45d3a9 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:36.886215 28535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e62ec43c8d442b9846f05439ac7a99" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb" is_pre_election: true
I20240502 01:59:36.887415 27977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2133628f3584c8c900e569d8f45d3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.887454 27842 tablet_service.cc:1467] Processing CreateTablet for tablet b2133628f3584c8c900e569d8f45d3a9 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
W20240502 01:59:36.888089 28201 leader_election.cc:341] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:59:36.888149 27842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2133628f3584c8c900e569d8f45d3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.890427 27707 tablet_service.cc:1467] Processing CreateTablet for tablet b2133628f3584c8c900e569d8f45d3a9 (DEFAULT_TABLE table=rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:36.890830 27707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2133628f3584c8c900e569d8f45d3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:36.893160 29022 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:36.893220 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e62ec43c8d442b9846f05439ac7a99" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
W20240502 01:59:36.894870 28200 leader_election.cc:341] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:59:36.894569 28133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e62ec43c8d442b9846f05439ac7a99" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
W20240502 01:59:36.896041 28199 leader_election.cc:341] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:59:36.895577 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e62ec43c8d442b9846f05439ac7a99" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1" is_pre_election: true
I20240502 01:59:36.896654 29020 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
W20240502 01:59:36.897121 28201 leader_election.cc:341] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:59:36.897220 28201 leader_election.cc:302] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 7 voters: 1 yes votes; 4 no votes. yes voters: 8ed4b4242123404f86485ec57dc34e88; no voters: 257826b7ad7e4abb8499b6687e8c83eb, 82e8cba6ed104c2c9869ea0365bbe482, 86e11777d9d744d0a5a8139c99e89f4f, da58b5341d344efd833502f214e69ff1
I20240502 01:59:36.897447 29022 tablet_bootstrap.cc:654] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.897563 29019 raft_consensus.cc:2726] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:59:36.898294 29029 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:36.898401 29022 log.cc:824] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:36.897850 27864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e62ec43c8d442b9846f05439ac7a99" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" is_pre_election: true
I20240502 01:59:36.899366 29024 tablet_bootstrap.cc:492] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
W20240502 01:59:36.900418 28200 leader_election.cc:341] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:59:36.900497 29029 tablet_bootstrap.cc:654] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.900781 29020 tablet_bootstrap.cc:654] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.899403 28401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e62ec43c8d442b9846f05439ac7a99" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:36.901069 29012 tablet_bootstrap.cc:492] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:36.901154 29012 ts_tablet_manager.cc:1367] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.001s
W20240502 01:59:36.901551 28202 leader_election.cc:341] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:59:36.901574 29029 log.cc:824] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:36.901571 29020 log.cc:824] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:36.901611 29012 raft_consensus.cc:348] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:36.901721 29012 raft_consensus.cc:374] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.901751 29012 raft_consensus.cc:729] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.901875 29012 consensus_queue.cc:260] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:36.902213 29012 ts_tablet_manager.cc:1398] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:36.903462 29029 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:36.903491 29024 tablet_bootstrap.cc:654] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.903539 29020 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:36.903630 29029 ts_tablet_manager.cc:1367] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:59:36.903676 29020 ts_tablet_manager.cc:1367] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20240502 01:59:36.904511 29024 log.cc:824] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:36.905535 29014 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:36.906157 29020 raft_consensus.cc:348] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:36.906383 29020 raft_consensus.cc:374] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.906438 29020 raft_consensus.cc:729] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.906903 29020 consensus_queue.cc:260] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:36.907279 29018 tablet_bootstrap.cc:492] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:36.907286 29014 tablet_bootstrap.cc:654] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.907474 29018 ts_tablet_manager.cc:1367] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.000s
I20240502 01:59:36.907809 29020 ts_tablet_manager.cc:1398] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 01:59:36.908143 29020 tablet_bootstrap.cc:492] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
I20240502 01:59:36.908412 29014 log.cc:824] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:36.909063 29020 tablet_bootstrap.cc:654] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.910408 29022 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:36.910674 29022 ts_tablet_manager.cc:1367] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.002s
I20240502 01:59:36.910842 29029 raft_consensus.cc:348] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:36.911037 29029 raft_consensus.cc:374] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.911088 29029 raft_consensus.cc:729] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.911526 29029 consensus_queue.cc:260] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:36.912370 29029 ts_tablet_manager.cc:1398] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20240502 01:59:36.912684 29029 tablet_bootstrap.cc:492] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:36.913560 29029 tablet_bootstrap.cc:654] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.913859 29022 raft_consensus.cc:348] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:36.914171 29022 raft_consensus.cc:374] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.914286 29022 raft_consensus.cc:729] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.914814 29022 consensus_queue.cc:260] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:36.915268 29024 tablet_bootstrap.cc:492] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:36.915464 29024 ts_tablet_manager.cc:1367] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20240502 01:59:36.915405 29018 raft_consensus.cc:348] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } }
I20240502 01:59:36.915606 29018 raft_consensus.cc:374] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.915688 29022 ts_tablet_manager.cc:1398] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20240502 01:59:36.915701 29018 raft_consensus.cc:729] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.916131 29018 consensus_queue.cc:260] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } }
I20240502 01:59:36.916983 29018 ts_tablet_manager.cc:1398] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
I20240502 01:59:36.917073 29022 tablet_bootstrap.cc:492] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:36.917304 29018 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
I20240502 01:59:36.918018 29022 tablet_bootstrap.cc:654] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.918243 29018 tablet_bootstrap.cc:654] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.918713 29024 raft_consensus.cc:348] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } }
I20240502 01:59:36.918941 29024 raft_consensus.cc:374] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.919008 29024 raft_consensus.cc:729] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.919365 29018 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:36.919451 29018 ts_tablet_manager.cc:1367] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:36.919384 29024 consensus_queue.cc:260] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } }
I20240502 01:59:36.920104 29029 tablet_bootstrap.cc:492] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:36.920145 29024 ts_tablet_manager.cc:1398] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20240502 01:59:36.920188 29029 ts_tablet_manager.cc:1367] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20240502 01:59:36.920473 29024 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
I20240502 01:59:36.920769 29029 raft_consensus.cc:348] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } }
I20240502 01:59:36.920892 29029 raft_consensus.cc:374] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.920923 29029 raft_consensus.cc:729] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.921069 29029 consensus_queue.cc:260] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } }
I20240502 01:59:36.921353 29029 ts_tablet_manager.cc:1398] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:36.921408 29024 tablet_bootstrap.cc:654] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.921514 29029 tablet_bootstrap.cc:492] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:36.921521 29018 raft_consensus.cc:348] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:36.921623 29018 raft_consensus.cc:374] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.921653 29018 raft_consensus.cc:729] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.921799 29018 consensus_queue.cc:260] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:36.922133 29018 ts_tablet_manager.cc:1398] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:59:36.922293 29018 tablet_bootstrap.cc:492] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
I20240502 01:59:36.922495 29029 tablet_bootstrap.cc:654] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.923280 29018 tablet_bootstrap.cc:654] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.923372 29014 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:36.923542 29014 ts_tablet_manager.cc:1367] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20240502 01:59:36.923887 29022 tablet_bootstrap.cc:492] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:36.923977 29022 ts_tablet_manager.cc:1367] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240502 01:59:36.924614 29022 raft_consensus.cc:348] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } }
I20240502 01:59:36.924779 29022 raft_consensus.cc:374] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.924818 29022 raft_consensus.cc:729] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.924981 29022 consensus_queue.cc:260] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } }
I20240502 01:59:36.925199 29029 tablet_bootstrap.cc:492] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:36.925266 29022 ts_tablet_manager.cc:1398] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:36.925280 29029 ts_tablet_manager.cc:1367] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20240502 01:59:36.925441 29022 tablet_bootstrap.cc:492] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:36.925799 29029 raft_consensus.cc:348] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:36.925932 29029 raft_consensus.cc:374] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.925966 29029 raft_consensus.cc:729] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.926105 29029 consensus_queue.cc:260] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:36.926199 29014 raft_consensus.cc:348] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:36.926375 29022 tablet_bootstrap.cc:654] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.926396 29029 ts_tablet_manager.cc:1398] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:36.926390 29014 raft_consensus.cc:374] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.926448 29014 raft_consensus.cc:729] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.926857 29014 consensus_queue.cc:260] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:36.927024 29018 tablet_bootstrap.cc:492] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:36.927105 29018 ts_tablet_manager.cc:1367] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:59:36.927548 29018 raft_consensus.cc:348] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:36.927661 29018 raft_consensus.cc:374] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.927693 29018 raft_consensus.cc:729] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.927696 29014 ts_tablet_manager.cc:1398] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20240502 01:59:36.927706 29020 tablet_bootstrap.cc:492] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:36.927798 29020 ts_tablet_manager.cc:1367] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20240502 01:59:36.927811 29018 consensus_queue.cc:260] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:36.928053 29014 tablet_bootstrap.cc:492] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:36.928077 29018 ts_tablet_manager.cc:1398] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:36.928359 29020 raft_consensus.cc:348] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:36.928494 29020 raft_consensus.cc:374] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.928534 29020 raft_consensus.cc:729] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.928687 29020 consensus_queue.cc:260] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:36.928956 29020 ts_tablet_manager.cc:1398] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 01:59:36.928973 29024 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:36.929013 29014 tablet_bootstrap.cc:654] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.929052 29024 ts_tablet_manager.cc:1367] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240502 01:59:36.929141 29020 tablet_bootstrap.cc:492] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
I20240502 01:59:36.929581 29024 raft_consensus.cc:348] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:36.929705 29024 raft_consensus.cc:374] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.929742 29024 raft_consensus.cc:729] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.929867 29024 consensus_queue.cc:260] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:36.930166 29024 ts_tablet_manager.cc:1398] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:36.930328 29024 tablet_bootstrap.cc:492] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
I20240502 01:59:36.931223 29024 tablet_bootstrap.cc:654] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.931638 29020 tablet_bootstrap.cc:654] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.932906 29022 tablet_bootstrap.cc:492] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:36.932997 29022 ts_tablet_manager.cc:1367] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20240502 01:59:36.933391 29014 tablet_bootstrap.cc:492] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:36.933472 29014 ts_tablet_manager.cc:1367] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:59:36.933446 29022 raft_consensus.cc:348] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:36.933593 29022 raft_consensus.cc:374] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.933629 29022 raft_consensus.cc:729] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.933743 29022 consensus_queue.cc:260] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:36.934048 29022 ts_tablet_manager.cc:1398] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:36.934048 29014 raft_consensus.cc:348] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } }
I20240502 01:59:36.934167 29014 raft_consensus.cc:374] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.934204 29014 raft_consensus.cc:729] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.934350 29014 consensus_queue.cc:260] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } }
I20240502 01:59:36.934744 29014 ts_tablet_manager.cc:1398] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:36.934911 29014 tablet_bootstrap.cc:492] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:36.935039 29024 tablet_bootstrap.cc:492] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:36.935109 29024 ts_tablet_manager.cc:1367] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:59:36.935709 29024 raft_consensus.cc:348] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:36.935853 29014 tablet_bootstrap.cc:654] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:36.935853 29024 raft_consensus.cc:374] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.935889 29024 raft_consensus.cc:729] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.936015 29024 consensus_queue.cc:260] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:36.936102 29020 tablet_bootstrap.cc:492] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:36.936187 29020 ts_tablet_manager.cc:1367] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20240502 01:59:36.936297 29024 ts_tablet_manager.cc:1398] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:36.936606 29020 raft_consensus.cc:348] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } }
I20240502 01:59:36.936722 29020 raft_consensus.cc:374] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.936753 29020 raft_consensus.cc:729] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.936868 29020 consensus_queue.cc:260] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } }
I20240502 01:59:36.937044 29014 tablet_bootstrap.cc:492] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:36.937135 29014 ts_tablet_manager.cc:1367] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:36.937150 29020 ts_tablet_manager.cc:1398] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:36.937695 29014 raft_consensus.cc:348] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:36.937808 29014 raft_consensus.cc:374] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:36.937857 29014 raft_consensus.cc:729] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:36.937974 29014 consensus_queue.cc:260] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:36.938382 29014 ts_tablet_manager.cc:1398] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20240502 01:59:36.938663 29038 raft_consensus.cc:482] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:36.938808 29038 raft_consensus.cc:504] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } }
I20240502 01:59:36.940415 29038 leader_election.cc:288] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731)
I20240502 01:59:36.945946 28266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e62ec43c8d442b9846f05439ac7a99" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88" is_pre_election: true
I20240502 01:59:36.946084 28401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e62ec43c8d442b9846f05439ac7a99" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:36.946208 28266 raft_consensus.cc:2454] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:36.946295 28401 raft_consensus.cc:2454] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:36.946882 28535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e62ec43c8d442b9846f05439ac7a99" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb" is_pre_election: true
I20240502 01:59:36.947081 28535 raft_consensus.cc:2454] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:36.947428 27663 leader_election.cc:302] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, 8ed4b4242123404f86485ec57dc34e88, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:36.947517 28133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e62ec43c8d442b9846f05439ac7a99" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:36.947738 29038 raft_consensus.cc:2781] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:36.947752 28133 raft_consensus.cc:2454] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:36.947819 29038 raft_consensus.cc:482] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:36.947885 29038 raft_consensus.cc:3037] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.949029 29038 raft_consensus.cc:504] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } }
I20240502 01:59:36.949364 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e62ec43c8d442b9846f05439ac7a99" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:36.949580 27998 raft_consensus.cc:2454] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:36.949659 29038 leader_election.cc:288] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [CANDIDATE]: Term 1 election: Requested vote from peers 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731)
I20240502 01:59:36.950093 28401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e62ec43c8d442b9846f05439ac7a99" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1"
I20240502 01:59:36.950212 28401 raft_consensus.cc:3037] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.950378 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e62ec43c8d442b9846f05439ac7a99" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:36.950497 27998 raft_consensus.cc:3037] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.950865 28133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e62ec43c8d442b9846f05439ac7a99" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
W20240502 01:59:36.950973 28582 tablet.cc:2369] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 01:59:36.950980 28133 raft_consensus.cc:3037] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.950986 27864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e62ec43c8d442b9846f05439ac7a99" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" is_pre_election: true
I20240502 01:59:36.951197 27864 raft_consensus.cc:2454] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:36.951931 28535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e62ec43c8d442b9846f05439ac7a99" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb"
I20240502 01:59:36.952044 28133 raft_consensus.cc:2454] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:36.952059 28535 raft_consensus.cc:3037] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.952239 27998 raft_consensus.cc:2454] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:36.952296 27863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e62ec43c8d442b9846f05439ac7a99" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98"
I20240502 01:59:36.952399 27863 raft_consensus.cc:3037] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.953128 28535 raft_consensus.cc:2454] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:36.953431 27663 leader_election.cc:302] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 257826b7ad7e4abb8499b6687e8c83eb, 82e8cba6ed104c2c9869ea0365bbe482, 86e11777d9d744d0a5a8139c99e89f4f, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:36.953490 27863 raft_consensus.cc:2454] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:36.953619 29038 raft_consensus.cc:2781] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:36.953666 28401 raft_consensus.cc:2454] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:36.953821 29038 raft_consensus.cc:686] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Becoming Leader. State: Replica: da58b5341d344efd833502f214e69ff1, State: Running, Role: LEADER
I20240502 01:59:36.954048 28266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77e62ec43c8d442b9846f05439ac7a99" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88"
I20240502 01:59:36.954185 28266 raft_consensus.cc:3037] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.954193 29038 consensus_queue.cc:237] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } }
I20240502 01:59:36.955020 28266 raft_consensus.cc:2454] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:36.957286 27578 catalog_manager.cc:5484] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 reported cstate change: term changed from 0 to 1, leader changed from <none> to da58b5341d344efd833502f214e69ff1 (127.10.133.193). New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:36.970197 29050 raft_consensus.cc:482] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:36.970324 29050 raft_consensus.cc:504] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:36.971760 29050 leader_election.cc:288] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553)
I20240502 01:59:36.973488 29036 raft_consensus.cc:482] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:36.973618 29036 raft_consensus.cc:504] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:36.975195 29036 leader_election.cc:288] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629), a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917)
I20240502 01:59:36.977407 28401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13a5600dc379460b9c433ffdaa0b3d02" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:36.977551 28401 raft_consensus.cc:2454] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:36.979287 28266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13a5600dc379460b9c433ffdaa0b3d02" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88" is_pre_election: true
I20240502 01:59:36.979444 28266 raft_consensus.cc:2454] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:36.982255 27863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2133628f3584c8c900e569d8f45d3a9" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" is_pre_election: true
I20240502 01:59:36.982399 27863 raft_consensus.cc:2454] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 0.
I20240502 01:59:36.982470 28133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13a5600dc379460b9c433ffdaa0b3d02" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:36.982486 27864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13a5600dc379460b9c433ffdaa0b3d02" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" is_pre_election: true
I20240502 01:59:36.982604 27864 raft_consensus.cc:2454] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:36.982606 28133 raft_consensus.cc:2454] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:36.983073 28467 leader_election.cc:302] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, 82e8cba6ed104c2c9869ea0365bbe482, 8ed4b4242123404f86485ec57dc34e88; no voters:
I20240502 01:59:36.983372 29050 raft_consensus.cc:2781] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:36.983433 29050 raft_consensus.cc:482] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:36.983470 29050 raft_consensus.cc:3037] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.983520 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13a5600dc379460b9c433ffdaa0b3d02" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1" is_pre_election: true
I20240502 01:59:36.983683 27728 raft_consensus.cc:2454] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:36.983911 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13a5600dc379460b9c433ffdaa0b3d02" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:36.984051 27998 raft_consensus.cc:2454] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:36.984638 29050 raft_consensus.cc:504] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:36.985319 29050 leader_election.cc:288] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 election: Requested vote from peers a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553)
I20240502 01:59:36.985826 28401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13a5600dc379460b9c433ffdaa0b3d02" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1"
I20240502 01:59:36.985839 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13a5600dc379460b9c433ffdaa0b3d02" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1"
I20240502 01:59:36.985960 28401 raft_consensus.cc:3037] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.986006 27728 raft_consensus.cc:3037] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.986681 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13a5600dc379460b9c433ffdaa0b3d02" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:36.986791 27998 raft_consensus.cc:3037] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.986953 28401 raft_consensus.cc:2454] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:36.987097 27728 raft_consensus.cc:2454] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:36.987357 28266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2133628f3584c8c900e569d8f45d3a9" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88" is_pre_election: true
I20240502 01:59:36.987500 28266 raft_consensus.cc:2454] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 0.
I20240502 01:59:36.987736 27864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13a5600dc379460b9c433ffdaa0b3d02" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98"
I20240502 01:59:36.987774 27998 raft_consensus.cc:2454] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:36.987850 27864 raft_consensus.cc:3037] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.988595 28470 leader_election.cc:302] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, 86e11777d9d744d0a5a8139c99e89f4f, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:36.988647 28133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13a5600dc379460b9c433ffdaa0b3d02" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
I20240502 01:59:36.988756 28133 raft_consensus.cc:3037] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.988803 29050 raft_consensus.cc:2781] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:36.988934 27864 raft_consensus.cc:2454] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:36.989048 29050 raft_consensus.cc:686] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Becoming Leader. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Running, Role: LEADER
I20240502 01:59:36.989426 29050 consensus_queue.cc:237] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:36.989701 28133 raft_consensus.cc:2454] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:36.990268 28266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13a5600dc379460b9c433ffdaa0b3d02" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88"
I20240502 01:59:36.990382 28266 raft_consensus.cc:3037] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.990891 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2133628f3584c8c900e569d8f45d3a9" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:36.990993 27998 raft_consensus.cc:2454] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 0.
I20240502 01:59:36.991274 28334 leader_election.cc:302] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 86e11777d9d744d0a5a8139c99e89f4f, 8ed4b4242123404f86485ec57dc34e88, a8c1908b1c554e7cbbb9bf9751b8ee98; no voters:
I20240502 01:59:36.991380 28266 raft_consensus.cc:2454] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:36.991595 29036 raft_consensus.cc:2781] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:36.991652 29036 raft_consensus.cc:482] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:36.991698 29036 raft_consensus.cc:3037] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.992686 29036 raft_consensus.cc:504] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:36.993191 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2133628f3584c8c900e569d8f45d3a9" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1" is_pre_election: true
I20240502 01:59:36.993260 29036 leader_election.cc:288] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [CANDIDATE]: Term 1 election: Requested vote from peers 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629), a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917)
I20240502 01:59:36.993332 27728 raft_consensus.cc:2454] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 0.
I20240502 01:59:36.993569 27578 catalog_manager.cc:5484] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199). New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:36.994021 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2133628f3584c8c900e569d8f45d3a9" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1"
I20240502 01:59:36.994119 27728 raft_consensus.cc:3037] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.994096 28535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2133628f3584c8c900e569d8f45d3a9" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb" is_pre_election: true
I20240502 01:59:36.994218 28535 raft_consensus.cc:2454] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 0.
I20240502 01:59:36.994488 27864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2133628f3584c8c900e569d8f45d3a9" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98"
I20240502 01:59:36.994599 27864 raft_consensus.cc:3037] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.995036 27728 raft_consensus.cc:2454] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 1.
W20240502 01:59:36.995194 28047 tablet.cc:2369] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20240502 01:59:36.995301 28534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2133628f3584c8c900e569d8f45d3a9" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb"
I20240502 01:59:36.995388 28534 raft_consensus.cc:3037] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.995554 27864 raft_consensus.cc:2454] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 1.
I20240502 01:59:36.996327 28534 raft_consensus.cc:2454] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 1.
I20240502 01:59:36.996536 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2133628f3584c8c900e569d8f45d3a9" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:36.996654 27998 raft_consensus.cc:3037] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.996726 28335 leader_election.cc:302] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, a8c1908b1c554e7cbbb9bf9751b8ee98, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:36.996860 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2133628f3584c8c900e569d8f45d3a9" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
I20240502 01:59:36.996912 29036 raft_consensus.cc:2781] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:36.996980 28132 raft_consensus.cc:3037] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.997119 29036 raft_consensus.cc:686] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Becoming Leader. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Running, Role: LEADER
I20240502 01:59:36.997459 29036 consensus_queue.cc:237] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:36.997649 27998 raft_consensus.cc:2454] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 1.
I20240502 01:59:36.998026 28132 raft_consensus.cc:2454] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 1.
I20240502 01:59:36.998174 28133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2133628f3584c8c900e569d8f45d3a9" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:36.998306 28133 raft_consensus.cc:2362] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 1. Re-sending same reply.
I20240502 01:59:36.998402 28266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b2133628f3584c8c900e569d8f45d3a9" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88"
I20240502 01:59:36.998546 28266 raft_consensus.cc:3037] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:36.999497 28266 raft_consensus.cc:2454] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 1.
I20240502 01:59:37.001497 27578 catalog_manager.cc:5484] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 12f527e76eff4669924a898d5029e3d1 (127.10.133.198). New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } }
W20240502 01:59:37.014531 28449 tablet.cc:2369] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 01:59:37.070317 27912 tablet.cc:2369] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 01:59:37.090283 28315 tablet.cc:2369] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 01:59:37.124877 27777 tablet.cc:2369] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20240502 01:59:37.155517 29085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:37.155746 29085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:37.159021 29085 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
W20240502 01:59:37.162711 28181 tablet.cc:2369] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482: Can't schedule compaction. Clean time has not been advanced past its initial value.
Using table 'rebalance_test_table_0'
I20240502 01:59:37.254642 28401 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.254921 27728 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.255390 28266 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.255357 27864 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.256176 28133 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.256904 27998 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.257210 29119 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.257323 28534 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.257498 27997 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.257635 29120 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.258157 27864 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.258272 29050 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.258267 29083 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.258407 29121 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.258908 28266 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.259145 29081 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.259984 29083 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.260039 27728 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.260226 29120 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.260804 29083 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.266247 28133 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.268862 29126 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.269285 29126 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.269764 29125 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.290539 27862 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.290757 27996 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.291380 29061 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.291837 29061 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.294302 29116 mvcc.cc:205] Tried to move back new op lower bound from 7023063766027337728 to 7023063764954066944. Current Snapshot: MvccSnapshot[applied={T|T < 7023063766027337728}]
I20240502 01:59:37.295015 29117 mvcc.cc:205] Tried to move back new op lower bound from 7023063766027337728 to 7023063764954066944. Current Snapshot: MvccSnapshot[applied={T|T < 7023063766027337728}]
I20240502 01:59:37.296934 28535 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.297184 28265 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.297325 29038 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.297827 28131 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.299844 29130 mvcc.cc:205] Tried to move back new op lower bound from 7023063766027337728 to 7023063764954066944. Current Snapshot: MvccSnapshot[applied={T|T < 7023063766027337728}]
I20240502 01:59:37.305076 29038 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.307688 29038 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.308120 29146 mvcc.cc:205] Tried to move back new op lower bound from 7023063766051958784 to 7023063764988657664. Current Snapshot: MvccSnapshot[applied={T|T < 7023063766035304448}]
I20240502 01:59:37.313472 29144 mvcc.cc:205] Tried to move back new op lower bound from 7023063766027337728 to 7023063764954066944. Current Snapshot: MvccSnapshot[applied={T|T < 7023063766027337728}]
I20240502 01:59:37.318305 28401 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.318845 29061 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.339624 29118 mvcc.cc:205] Tried to move back new op lower bound from 7023063766157230080 to 7023063764808347648. Current Snapshot: MvccSnapshot[applied={T|T < 7023063766157230080}]
I20240502 01:59:37.360946 29140 mvcc.cc:205] Tried to move back new op lower bound from 7023063766051958784 to 7023063764988657664. Current Snapshot: MvccSnapshot[applied={T|T < 7023063766035304448}]
INSERT report
rows total: 2000
time total: 231.349 ms
time per row: 0.115674 ms
I20240502 01:59:37.438251 27575 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55090:
name: "rebalance_test_table_1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 7
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20240502 01:59:37.438867 27575 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_1 in case of a server failure: 8 tablet servers would be needed, 7 are available. Consider bringing up more tablet servers.
I20240502 01:59:37.444368 28381 tablet_service.cc:1467] Processing CreateTablet for tablet 9ee07ceb106a46778d215684d8fac8da (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.444483 28113 tablet_service.cc:1467] Processing CreateTablet for tablet 9ee07ceb106a46778d215684d8fac8da (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.444707 28381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ee07ceb106a46778d215684d8fac8da. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.444797 28113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ee07ceb106a46778d215684d8fac8da. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.444759 28245 tablet_service.cc:1467] Processing CreateTablet for tablet 9ee07ceb106a46778d215684d8fac8da (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.445041 28245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ee07ceb106a46778d215684d8fac8da. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.447000 29186 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:37.447156 29187 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
I20240502 01:59:37.447605 28246 tablet_service.cc:1467] Processing CreateTablet for tablet b247e3ad657f4661ab40ebd1cc8756b8 (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.447834 28246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b247e3ad657f4661ab40ebd1cc8756b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.448081 29186 tablet_bootstrap.cc:654] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.448093 29187 tablet_bootstrap.cc:654] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.449291 29187 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:37.449368 29187 ts_tablet_manager.cc:1367] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:37.449844 29187 raft_consensus.cc:348] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.449934 29190 tablet_bootstrap.cc:492] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:37.449970 29187 raft_consensus.cc:374] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.450042 29187 raft_consensus.cc:729] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.450115 28244 tablet_service.cc:1467] Processing CreateTablet for tablet 0883c95dc88f4fb4a7a715c23fb7f078 (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.450249 28112 tablet_service.cc:1467] Processing CreateTablet for tablet b247e3ad657f4661ab40ebd1cc8756b8 (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.450346 28244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0883c95dc88f4fb4a7a715c23fb7f078. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.450162 29187 consensus_queue.cc:260] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.450471 28112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b247e3ad657f4661ab40ebd1cc8756b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.450708 29187 ts_tablet_manager.cc:1398] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:37.450796 29190 tablet_bootstrap.cc:654] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.451856 29190 tablet_bootstrap.cc:492] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:37.451944 29190 ts_tablet_manager.cc:1367] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:37.452425 29190 raft_consensus.cc:348] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:37.452556 29190 raft_consensus.cc:374] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.452593 29190 raft_consensus.cc:729] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.452755 29190 consensus_queue.cc:260] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:37.452857 28514 tablet_service.cc:1467] Processing CreateTablet for tablet 9ee07ceb106a46778d215684d8fac8da (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.453125 28514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ee07ceb106a46778d215684d8fac8da. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.453292 28381 tablet_service.cc:1467] Processing CreateTablet for tablet b247e3ad657f4661ab40ebd1cc8756b8 (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.453516 28381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b247e3ad657f4661ab40ebd1cc8756b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.453512 29190 ts_tablet_manager.cc:1398] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:37.453491 28515 tablet_service.cc:1467] Processing CreateTablet for tablet b247e3ad657f4661ab40ebd1cc8756b8 (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.453675 29190 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:37.453727 28515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b247e3ad657f4661ab40ebd1cc8756b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.454546 29190 tablet_bootstrap.cc:654] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.455467 29193 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:37.455552 28380 tablet_service.cc:1467] Processing CreateTablet for tablet 0883c95dc88f4fb4a7a715c23fb7f078 (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.455788 28380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0883c95dc88f4fb4a7a715c23fb7f078. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.455803 28513 tablet_service.cc:1467] Processing CreateTablet for tablet 0883c95dc88f4fb4a7a715c23fb7f078 (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.456043 28513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0883c95dc88f4fb4a7a715c23fb7f078. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.456285 29193 tablet_bootstrap.cc:654] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.457273 29193 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:37.457350 29193 ts_tablet_manager.cc:1367] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:37.457469 29187 tablet_bootstrap.cc:492] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
I20240502 01:59:37.457767 29193 raft_consensus.cc:348] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.457892 29193 raft_consensus.cc:374] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.457928 29193 raft_consensus.cc:729] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.458101 29193 consensus_queue.cc:260] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.458325 29187 tablet_bootstrap.cc:654] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.458401 29193 ts_tablet_manager.cc:1398] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:37.458338 27707 tablet_service.cc:1467] Processing CreateTablet for tablet 9ee07ceb106a46778d215684d8fac8da (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.458573 29193 tablet_bootstrap.cc:492] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:37.458626 27707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ee07ceb106a46778d215684d8fac8da. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.459091 27706 tablet_service.cc:1467] Processing CreateTablet for tablet 0883c95dc88f4fb4a7a715c23fb7f078 (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.459362 27706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0883c95dc88f4fb4a7a715c23fb7f078. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.459854 29193 tablet_bootstrap.cc:654] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.460909 29193 tablet_bootstrap.cc:492] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:37.460981 29193 ts_tablet_manager.cc:1367] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:37.461112 29197 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:37.461274 27842 tablet_service.cc:1467] Processing CreateTablet for tablet 9ee07ceb106a46778d215684d8fac8da (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.461536 27842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ee07ceb106a46778d215684d8fac8da. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.461576 29193 raft_consensus.cc:348] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:37.461691 29193 raft_consensus.cc:374] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.461723 29193 raft_consensus.cc:729] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.461752 27977 tablet_service.cc:1467] Processing CreateTablet for tablet 9ee07ceb106a46778d215684d8fac8da (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.461833 29193 consensus_queue.cc:260] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:37.462036 29197 tablet_bootstrap.cc:654] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.462046 27977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ee07ceb106a46778d215684d8fac8da. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.462109 29193 ts_tablet_manager.cc:1398] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:37.462257 29193 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:37.463039 29193 tablet_bootstrap.cc:654] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.463454 29199 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
I20240502 01:59:37.463582 27843 tablet_service.cc:1467] Processing CreateTablet for tablet b247e3ad657f4661ab40ebd1cc8756b8 (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.463794 27843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b247e3ad657f4661ab40ebd1cc8756b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.464226 29199 tablet_bootstrap.cc:654] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.464247 29201 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
I20240502 01:59:37.464314 27978 tablet_service.cc:1467] Processing CreateTablet for tablet b247e3ad657f4661ab40ebd1cc8756b8 (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.464512 27978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b247e3ad657f4661ab40ebd1cc8756b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.465144 29193 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:37.465214 29193 ts_tablet_manager.cc:1367] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:59:37.465344 29199 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:37.465435 29199 ts_tablet_manager.cc:1367] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:37.465623 29193 raft_consensus.cc:348] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.465739 29193 raft_consensus.cc:374] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.465770 29193 raft_consensus.cc:729] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.465878 29193 consensus_queue.cc:260] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.465883 27841 tablet_service.cc:1467] Processing CreateTablet for tablet 0883c95dc88f4fb4a7a715c23fb7f078 (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.466171 27841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0883c95dc88f4fb4a7a715c23fb7f078. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.466189 29193 ts_tablet_manager.cc:1398] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:37.466609 27976 tablet_service.cc:1467] Processing CreateTablet for tablet 0883c95dc88f4fb4a7a715c23fb7f078 (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.466773 29201 tablet_bootstrap.cc:654] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.466853 27976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0883c95dc88f4fb4a7a715c23fb7f078. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.467100 29122 raft_consensus.cc:482] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:37.467185 29122 raft_consensus.cc:504] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.467869 29122 leader_election.cc:288] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917)
I20240502 01:59:37.467981 28401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee07ceb106a46778d215684d8fac8da" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:37.468091 28401 raft_consensus.cc:2454] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:37.465881 29199 raft_consensus.cc:348] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.468225 29199 raft_consensus.cc:374] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.468259 29199 raft_consensus.cc:729] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.468258 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee07ceb106a46778d215684d8fac8da" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1" is_pre_election: true
I20240502 01:59:37.468402 29199 consensus_queue.cc:260] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.468688 29199 ts_tablet_manager.cc:1398] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:59:37.458344 27708 tablet_service.cc:1467] Processing CreateTablet for tablet b247e3ad657f4661ab40ebd1cc8756b8 (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.468837 29199 tablet_bootstrap.cc:492] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
I20240502 01:59:37.468815 27997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee07ceb106a46778d215684d8fac8da" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:37.468943 27708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b247e3ad657f4661ab40ebd1cc8756b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.469292 27863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee07ceb106a46778d215684d8fac8da" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" is_pre_election: true
W20240502 01:59:37.469326 28469 leader_election.cc:341] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:59:37.469390 27863 raft_consensus.cc:2454] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:37.469661 29199 tablet_bootstrap.cc:654] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.469794 28131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee07ceb106a46778d215684d8fac8da" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
W20240502 01:59:37.469842 28468 leader_election.cc:341] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917): Illegal state: must be running to vote when last-logged opid is not known
W20240502 01:59:37.470482 28467 leader_election.cc:341] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553): Illegal state: must be running to vote when last-logged opid is not known
I20240502 01:59:37.470722 29199 tablet_bootstrap.cc:492] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:37.470800 29199 ts_tablet_manager.cc:1367] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240502 01:59:37.471494 29199 raft_consensus.cc:348] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:37.471602 29199 raft_consensus.cc:374] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.471632 29199 raft_consensus.cc:729] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.471773 29199 consensus_queue.cc:260] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:37.472043 29199 ts_tablet_manager.cc:1398] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:37.472193 29199 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
W20240502 01:59:37.472708 28467 leader_election.cc:341] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567): Not found: Tablet not found: 9ee07ceb106a46778d215684d8fac8da
I20240502 01:59:37.472775 28467 leader_election.cc:302] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 7 responses out of 7 voters: 3 yes votes; 4 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, a8c1908b1c554e7cbbb9bf9751b8ee98; no voters: 82e8cba6ed104c2c9869ea0365bbe482, 86e11777d9d744d0a5a8139c99e89f4f, 8ed4b4242123404f86485ec57dc34e88, da58b5341d344efd833502f214e69ff1
I20240502 01:59:37.473062 29199 tablet_bootstrap.cc:654] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.473155 29122 raft_consensus.cc:2726] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20240502 01:59:37.475203 29190 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:37.475304 29190 ts_tablet_manager.cc:1367] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20240502 01:59:37.475723 29190 raft_consensus.cc:348] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.475812 29190 raft_consensus.cc:374] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.475831 29190 raft_consensus.cc:729] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.475833 29199 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:37.475898 29199 ts_tablet_manager.cc:1367] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20240502 01:59:37.475943 29190 consensus_queue.cc:260] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.476190 29190 ts_tablet_manager.cc:1398] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:37.476248 29199 raft_consensus.cc:348] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.476346 29199 raft_consensus.cc:374] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.476377 29190 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:37.476382 29199 raft_consensus.cc:729] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.476518 29199 consensus_queue.cc:260] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.476799 28113 tablet_service.cc:1467] Processing CreateTablet for tablet 0883c95dc88f4fb4a7a715c23fb7f078 (DEFAULT_TABLE table=rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.477064 28113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0883c95dc88f4fb4a7a715c23fb7f078. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.477257 29190 tablet_bootstrap.cc:654] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.479079 29190 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:37.479105 29199 ts_tablet_manager.cc:1398] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20240502 01:59:37.479290 29190 ts_tablet_manager.cc:1367] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:59:37.479723 29190 raft_consensus.cc:348] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.479853 29190 raft_consensus.cc:374] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.479890 29190 raft_consensus.cc:729] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.480027 29190 consensus_queue.cc:260] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.480432 29190 ts_tablet_manager.cc:1398] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:37.482730 29187 tablet_bootstrap.cc:492] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:37.482846 29187 ts_tablet_manager.cc:1367] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.001s
I20240502 01:59:37.483229 29186 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:37.483307 29186 ts_tablet_manager.cc:1367] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.000s
I20240502 01:59:37.483494 29187 raft_consensus.cc:348] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:37.483587 29187 raft_consensus.cc:374] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.483606 29187 raft_consensus.cc:729] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.483719 29187 consensus_queue.cc:260] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:37.483731 29186 raft_consensus.cc:348] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.483843 29186 raft_consensus.cc:374] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.483868 29186 raft_consensus.cc:729] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.484006 29187 ts_tablet_manager.cc:1398] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240502 01:59:37.483987 29186 consensus_queue.cc:260] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.484186 29187 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
I20240502 01:59:37.484221 29186 ts_tablet_manager.cc:1398] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:37.484364 29186 tablet_bootstrap.cc:492] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:37.484860 29187 tablet_bootstrap.cc:654] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.485136 29186 tablet_bootstrap.cc:654] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.485755 29187 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:37.485834 29187 ts_tablet_manager.cc:1367] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:59:37.486622 29187 raft_consensus.cc:348] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.486742 29187 raft_consensus.cc:374] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.486779 29187 raft_consensus.cc:729] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.486932 29187 consensus_queue.cc:260] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.487115 29197 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:37.487211 29197 ts_tablet_manager.cc:1367] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.001s
I20240502 01:59:37.487262 29187 ts_tablet_manager.cc:1398] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:37.487619 29197 raft_consensus.cc:348] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.487762 29197 raft_consensus.cc:374] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.487790 29197 raft_consensus.cc:729] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.487892 29197 consensus_queue.cc:260] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.488121 29197 ts_tablet_manager.cc:1398] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:37.488255 29197 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:37.488935 29201 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:37.488993 29197 tablet_bootstrap.cc:654] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.489259 29201 ts_tablet_manager.cc:1367] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
I20240502 01:59:37.489962 29197 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:37.490057 29197 ts_tablet_manager.cc:1367] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240502 01:59:37.489919 29201 raft_consensus.cc:348] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.490216 29201 raft_consensus.cc:374] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.490317 29201 raft_consensus.cc:729] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.490365 29197 raft_consensus.cc:348] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.490465 29197 raft_consensus.cc:374] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.490644 29197 raft_consensus.cc:729] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.490792 29197 consensus_queue.cc:260] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.490828 29201 consensus_queue.cc:260] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.491032 29197 ts_tablet_manager.cc:1398] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:37.491178 29197 tablet_bootstrap.cc:492] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:37.491926 29197 tablet_bootstrap.cc:654] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.492944 29197 tablet_bootstrap.cc:492] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:37.493022 29197 ts_tablet_manager.cc:1367] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:37.493379 29197 raft_consensus.cc:348] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:37.493487 29197 raft_consensus.cc:374] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.493522 29197 raft_consensus.cc:729] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.493561 29201 ts_tablet_manager.cc:1398] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20240502 01:59:37.493620 29197 consensus_queue.cc:260] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:37.493770 29201 tablet_bootstrap.cc:492] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
I20240502 01:59:37.493844 29197 ts_tablet_manager.cc:1398] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:37.494658 29201 tablet_bootstrap.cc:654] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.495977 29186 tablet_bootstrap.cc:492] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:37.496074 29186 ts_tablet_manager.cc:1367] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20240502 01:59:37.496089 29201 tablet_bootstrap.cc:492] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:37.496155 29201 ts_tablet_manager.cc:1367] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:37.496505 29186 raft_consensus.cc:348] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:37.496543 29201 raft_consensus.cc:348] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:37.496629 29186 raft_consensus.cc:374] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.496639 29201 raft_consensus.cc:374] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.496673 29201 raft_consensus.cc:729] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.496673 29186 raft_consensus.cc:729] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.496788 29201 consensus_queue.cc:260] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:37.496788 29186 consensus_queue.cc:260] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:37.497054 29186 ts_tablet_manager.cc:1398] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:37.497215 29186 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:37.497421 29201 ts_tablet_manager.cc:1398] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:37.497596 29201 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
I20240502 01:59:37.498090 29186 tablet_bootstrap.cc:654] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.498512 29201 tablet_bootstrap.cc:654] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.499337 29186 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:37.499423 29186 ts_tablet_manager.cc:1367] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240502 01:59:37.499758 29186 raft_consensus.cc:348] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.499897 29186 raft_consensus.cc:374] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.499938 29186 raft_consensus.cc:729] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.500049 29186 consensus_queue.cc:260] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.500406 29186 ts_tablet_manager.cc:1398] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:37.500655 29201 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:37.500726 29201 ts_tablet_manager.cc:1367] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:59:37.501144 29201 raft_consensus.cc:348] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.501277 29201 raft_consensus.cc:374] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.501313 29201 raft_consensus.cc:729] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.501317 29015 raft_consensus.cc:482] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:37.501436 29015 raft_consensus.cc:504] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.501447 29201 consensus_queue.cc:260] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.501725 29201 ts_tablet_manager.cc:1398] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:37.502350 28534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee07ceb106a46778d215684d8fac8da" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb" is_pre_election: true
I20240502 01:59:37.502360 28401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee07ceb106a46778d215684d8fac8da" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:37.502490 28534 raft_consensus.cc:2454] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 0.
I20240502 01:59:37.502496 28401 raft_consensus.cc:2454] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 0.
I20240502 01:59:37.502732 28131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee07ceb106a46778d215684d8fac8da" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:37.502856 28131 raft_consensus.cc:2454] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 0.
I20240502 01:59:37.503108 29015 leader_election.cc:288] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917)
I20240502 01:59:37.503307 28201 leader_election.cc:302] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, 82e8cba6ed104c2c9869ea0365bbe482, 8ed4b4242123404f86485ec57dc34e88; no voters:
I20240502 01:59:37.503485 29015 raft_consensus.cc:2781] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:37.503537 29015 raft_consensus.cc:482] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:37.503573 29015 raft_consensus.cc:3037] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.503687 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee07ceb106a46778d215684d8fac8da" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1" is_pre_election: true
I20240502 01:59:37.503810 27728 raft_consensus.cc:2454] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 0.
I20240502 01:59:37.503798 27863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee07ceb106a46778d215684d8fac8da" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" is_pre_election: true
I20240502 01:59:37.503945 27863 raft_consensus.cc:2454] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 0.
I20240502 01:59:37.504176 27997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee07ceb106a46778d215684d8fac8da" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:37.504293 27997 raft_consensus.cc:2454] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 0.
I20240502 01:59:37.504593 29015 raft_consensus.cc:504] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.505239 29015 leader_election.cc:288] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [CANDIDATE]: Term 1 election: Requested vote from peers 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917)
I20240502 01:59:37.505332 28131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee07ceb106a46778d215684d8fac8da" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
I20240502 01:59:37.505437 28131 raft_consensus.cc:3037] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.505492 28401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee07ceb106a46778d215684d8fac8da" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1"
I20240502 01:59:37.505584 28401 raft_consensus.cc:3037] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.505658 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee07ceb106a46778d215684d8fac8da" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1"
I20240502 01:59:37.505757 27728 raft_consensus.cc:3037] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.506464 28131 raft_consensus.cc:2454] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 1.
I20240502 01:59:37.506536 28401 raft_consensus.cc:2454] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 1.
I20240502 01:59:37.506600 27728 raft_consensus.cc:2454] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 1.
I20240502 01:59:37.506852 28534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee07ceb106a46778d215684d8fac8da" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb"
I20240502 01:59:37.506947 28534 raft_consensus.cc:3037] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.506983 27863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee07ceb106a46778d215684d8fac8da" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98"
I20240502 01:59:37.506981 27997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ee07ceb106a46778d215684d8fac8da" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:37.507081 27997 raft_consensus.cc:3037] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.507081 27863 raft_consensus.cc:3037] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.507778 28534 raft_consensus.cc:2454] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 1.
I20240502 01:59:37.508018 27997 raft_consensus.cc:2454] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 1.
I20240502 01:59:37.508024 27863 raft_consensus.cc:2454] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 1.
I20240502 01:59:37.508085 28201 leader_election.cc:302] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, 8ed4b4242123404f86485ec57dc34e88, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:37.508261 29015 raft_consensus.cc:2781] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:37.508430 29015 raft_consensus.cc:686] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Becoming Leader. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Running, Role: LEADER
I20240502 01:59:37.508760 29015 consensus_queue.cc:237] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.511170 27577 catalog_manager.cc:5484] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197). New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:37.521836 29122 raft_consensus.cc:482] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:37.521948 29122 raft_consensus.cc:504] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.522573 29122 leader_election.cc:288] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917)
I20240502 01:59:37.522837 28131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0883c95dc88f4fb4a7a715c23fb7f078" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:37.522866 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0883c95dc88f4fb4a7a715c23fb7f078" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1" is_pre_election: true
I20240502 01:59:37.522984 28131 raft_consensus.cc:2454] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:37.522998 27728 raft_consensus.cc:2454] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:37.523023 28401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0883c95dc88f4fb4a7a715c23fb7f078" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:37.523144 28401 raft_consensus.cc:2454] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:37.523118 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0883c95dc88f4fb4a7a715c23fb7f078" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88" is_pre_election: true
I20240502 01:59:37.523241 28265 raft_consensus.cc:2454] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:37.523469 28470 leader_election.cc:302] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, 82e8cba6ed104c2c9869ea0365bbe482, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:37.523638 29122 raft_consensus.cc:2781] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:37.523689 29122 raft_consensus.cc:482] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:37.523731 29122 raft_consensus.cc:3037] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.523716 27997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0883c95dc88f4fb4a7a715c23fb7f078" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:37.523741 27863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0883c95dc88f4fb4a7a715c23fb7f078" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" is_pre_election: true
I20240502 01:59:37.523854 27863 raft_consensus.cc:2454] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:37.523854 27997 raft_consensus.cc:2454] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:37.524648 29122 raft_consensus.cc:504] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.525172 29122 leader_election.cc:288] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 election: Requested vote from peers 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917)
I20240502 01:59:37.525350 28401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0883c95dc88f4fb4a7a715c23fb7f078" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1"
I20240502 01:59:37.525450 28401 raft_consensus.cc:3037] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.525482 27997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0883c95dc88f4fb4a7a715c23fb7f078" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:37.525542 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0883c95dc88f4fb4a7a715c23fb7f078" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88"
I20240502 01:59:37.525591 27997 raft_consensus.cc:3037] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.525595 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0883c95dc88f4fb4a7a715c23fb7f078" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1"
I20240502 01:59:37.525641 28265 raft_consensus.cc:3037] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.525710 27728 raft_consensus.cc:3037] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.526446 28401 raft_consensus.cc:2454] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:37.526540 27997 raft_consensus.cc:2454] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:37.526540 28265 raft_consensus.cc:2454] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:37.526679 27728 raft_consensus.cc:2454] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:37.526769 28131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0883c95dc88f4fb4a7a715c23fb7f078" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
I20240502 01:59:37.526892 28131 raft_consensus.cc:3037] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.526966 28469 leader_election.cc:302] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, 86e11777d9d744d0a5a8139c99e89f4f, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:37.527143 29122 raft_consensus.cc:2781] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:37.527256 29122 raft_consensus.cc:686] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Becoming Leader. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Running, Role: LEADER
I20240502 01:59:37.527390 29122 consensus_queue.cc:237] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:37.527482 27863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0883c95dc88f4fb4a7a715c23fb7f078" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98"
I20240502 01:59:37.527585 27863 raft_consensus.cc:3037] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.527863 28131 raft_consensus.cc:2454] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:37.528482 27863 raft_consensus.cc:2454] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:37.529531 27577 catalog_manager.cc:5484] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199). New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:37.609266 29083 raft_consensus.cc:482] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:37.609392 29083 raft_consensus.cc:504] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:37.610087 29083 leader_election.cc:288] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:37.610355 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b247e3ad657f4661ab40ebd1cc8756b8" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1" is_pre_election: true
I20240502 01:59:37.610508 27728 raft_consensus.cc:2454] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 0.
I20240502 01:59:37.610486 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b247e3ad657f4661ab40ebd1cc8756b8" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88" is_pre_election: true
I20240502 01:59:37.610570 27863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b247e3ad657f4661ab40ebd1cc8756b8" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" is_pre_election: true
I20240502 01:59:37.610630 28265 raft_consensus.cc:2454] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 0.
I20240502 01:59:37.610703 27863 raft_consensus.cc:2454] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 0.
I20240502 01:59:37.610741 28534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b247e3ad657f4661ab40ebd1cc8756b8" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb" is_pre_election: true
I20240502 01:59:37.610898 28534 raft_consensus.cc:2454] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 0.
I20240502 01:59:37.611104 28335 leader_election.cc:302] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 8ed4b4242123404f86485ec57dc34e88, a8c1908b1c554e7cbbb9bf9751b8ee98, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:37.611117 27997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b247e3ad657f4661ab40ebd1cc8756b8" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:37.611127 28131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b247e3ad657f4661ab40ebd1cc8756b8" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:37.611258 28131 raft_consensus.cc:2454] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 0.
I20240502 01:59:37.611266 27997 raft_consensus.cc:2454] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 0.
I20240502 01:59:37.611289 29083 raft_consensus.cc:2781] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:37.611338 29083 raft_consensus.cc:482] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:37.611371 29083 raft_consensus.cc:3037] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.612263 29083 raft_consensus.cc:504] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:37.612802 29083 leader_election.cc:288] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [CANDIDATE]: Term 1 election: Requested vote from peers a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:37.612879 27863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b247e3ad657f4661ab40ebd1cc8756b8" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98"
I20240502 01:59:37.612943 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b247e3ad657f4661ab40ebd1cc8756b8" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1"
I20240502 01:59:37.612978 27863 raft_consensus.cc:3037] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.612989 27997 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b247e3ad657f4661ab40ebd1cc8756b8" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:37.613044 27728 raft_consensus.cc:3037] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.613098 27997 raft_consensus.cc:3037] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.613474 28534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b247e3ad657f4661ab40ebd1cc8756b8" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb"
I20240502 01:59:37.613565 28534 raft_consensus.cc:3037] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.613915 27863 raft_consensus.cc:2454] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 1.
I20240502 01:59:37.613931 27728 raft_consensus.cc:2454] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 1.
I20240502 01:59:37.614308 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b247e3ad657f4661ab40ebd1cc8756b8" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88"
I20240502 01:59:37.614336 28131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b247e3ad657f4661ab40ebd1cc8756b8" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
I20240502 01:59:37.614431 28265 raft_consensus.cc:3037] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.614454 28131 raft_consensus.cc:3037] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:37.614584 28534 raft_consensus.cc:2454] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 1.
I20240502 01:59:37.614665 27997 raft_consensus.cc:2454] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 1.
I20240502 01:59:37.615044 28335 leader_election.cc:302] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, a8c1908b1c554e7cbbb9bf9751b8ee98, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:37.615199 29083 raft_consensus.cc:2781] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:37.615304 29083 raft_consensus.cc:686] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Becoming Leader. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Running, Role: LEADER
I20240502 01:59:37.615505 28131 raft_consensus.cc:2454] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 1.
I20240502 01:59:37.615478 29083 consensus_queue.cc:237] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:37.615564 28265 raft_consensus.cc:2454] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 1.
I20240502 01:59:37.617892 27577 catalog_manager.cc:5484] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 12f527e76eff4669924a898d5029e3d1 (127.10.133.198). New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } }
W20240502 01:59:37.741444 29219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:37.741763 29219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:37.745967 29219 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_1'
I20240502 01:59:37.825273 28534 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.825917 29083 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.826635 27997 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.826996 27863 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.827571 29120 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.827850 29120 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.829887 27997 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.830286 28535 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.830385 29015 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.830749 27863 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.830799 28401 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.831804 27728 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.832278 29122 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.832609 28131 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.832899 28401 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.833313 27727 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.833611 29122 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.833631 29215 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.835206 29215 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.838135 28132 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.839258 29121 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.839607 28265 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.840627 29121 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.841048 29215 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.841323 29215 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.841578 29215 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.847050 28266 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.847548 28133 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.847826 27997 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.848336 29125 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.848645 29124 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.848922 29125 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.849212 27726 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.849390 27864 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:37.849654 29125 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:37.853583 29125 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 186.035 ms
time per row: 0.0930173 ms
I20240502 01:59:37.979770 27576 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55090:
name: "rebalance_test_table_2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 7
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20240502 01:59:37.980311 27576 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_2 in case of a server failure: 8 tablet servers would be needed, 7 are available. Consider bringing up more tablet servers.
I20240502 01:59:37.986469 28380 tablet_service.cc:1467] Processing CreateTablet for tablet 110a6faea0904da9970934cb2aba94c6 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.986840 28380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 110a6faea0904da9970934cb2aba94c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.988313 27708 tablet_service.cc:1467] Processing CreateTablet for tablet 110a6faea0904da9970934cb2aba94c6 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.988459 27707 tablet_service.cc:1467] Processing CreateTablet for tablet 798ef14558d44d01911b4c8453c2b126 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.988570 27708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 110a6faea0904da9970934cb2aba94c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.988710 27707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 798ef14558d44d01911b4c8453c2b126. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.989233 27706 tablet_service.cc:1467] Processing CreateTablet for tablet 3b56295cbe014d6894812ee0a64bc513 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.989421 27706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b56295cbe014d6894812ee0a64bc513. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.989887 28112 tablet_service.cc:1467] Processing CreateTablet for tablet 3b56295cbe014d6894812ee0a64bc513 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.990195 28112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b56295cbe014d6894812ee0a64bc513. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.990648 28245 tablet_service.cc:1467] Processing CreateTablet for tablet 110a6faea0904da9970934cb2aba94c6 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.990919 28245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 110a6faea0904da9970934cb2aba94c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.990931 28113 tablet_service.cc:1467] Processing CreateTablet for tablet 110a6faea0904da9970934cb2aba94c6 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.991173 28113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 110a6faea0904da9970934cb2aba94c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.992429 28110 tablet_service.cc:1467] Processing CreateTablet for tablet 798ef14558d44d01911b4c8453c2b126 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.992583 29282 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:37.992697 28110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 798ef14558d44d01911b4c8453c2b126. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.992748 28244 tablet_service.cc:1467] Processing CreateTablet for tablet 3b56295cbe014d6894812ee0a64bc513 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.992949 28244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b56295cbe014d6894812ee0a64bc513. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.993029 29197 tablet_bootstrap.cc:492] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:37.993463 29282 tablet_bootstrap.cc:654] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.993835 29197 tablet_bootstrap.cc:654] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.994297 28246 tablet_service.cc:1467] Processing CreateTablet for tablet 798ef14558d44d01911b4c8453c2b126 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.994382 29186 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:37.994498 28246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 798ef14558d44d01911b4c8453c2b126. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.994823 28513 tablet_service.cc:1467] Processing CreateTablet for tablet 110a6faea0904da9970934cb2aba94c6 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.995090 28513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 110a6faea0904da9970934cb2aba94c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.995112 29186 tablet_bootstrap.cc:654] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:37.996166 29186 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:37.996250 29186 ts_tablet_manager.cc:1367] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20240502 01:59:37.996738 29186 raft_consensus.cc:348] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:37.996873 29186 raft_consensus.cc:374] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:37.996919 29186 raft_consensus.cc:729] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:37.997053 29186 consensus_queue.cc:260] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:37.997107 27841 tablet_service.cc:1467] Processing CreateTablet for tablet 110a6faea0904da9970934cb2aba94c6 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.997314 29186 ts_tablet_manager.cc:1398] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:37.997398 27841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 110a6faea0904da9970934cb2aba94c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.997468 29186 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:37.997630 28515 tablet_service.cc:1467] Processing CreateTablet for tablet 3b56295cbe014d6894812ee0a64bc513 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.997855 28515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b56295cbe014d6894812ee0a64bc513. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.998581 27976 tablet_service.cc:1467] Processing CreateTablet for tablet 110a6faea0904da9970934cb2aba94c6 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.998903 27976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 110a6faea0904da9970934cb2aba94c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:37.999868 28514 tablet_service.cc:1467] Processing CreateTablet for tablet 798ef14558d44d01911b4c8453c2b126 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:37.999917 27843 tablet_service.cc:1467] Processing CreateTablet for tablet 3b56295cbe014d6894812ee0a64bc513 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.000082 28514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 798ef14558d44d01911b4c8453c2b126. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.000108 27843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b56295cbe014d6894812ee0a64bc513. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.000939 29282 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:38.001034 29282 ts_tablet_manager.cc:1367] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240502 01:59:38.001327 27978 tablet_service.cc:1467] Processing CreateTablet for tablet 3b56295cbe014d6894812ee0a64bc513 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.001552 27978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b56295cbe014d6894812ee0a64bc513. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.001502 29282 raft_consensus.cc:348] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.001619 29282 raft_consensus.cc:374] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.001650 29282 raft_consensus.cc:729] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.001772 29282 consensus_queue.cc:260] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.002123 29282 ts_tablet_manager.cc:1398] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.002302 29282 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:38.002298 27842 tablet_service.cc:1467] Processing CreateTablet for tablet 798ef14558d44d01911b4c8453c2b126 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.002521 27842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 798ef14558d44d01911b4c8453c2b126. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.003232 29282 tablet_bootstrap.cc:654] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.003628 27977 tablet_service.cc:1467] Processing CreateTablet for tablet 798ef14558d44d01911b4c8453c2b126 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.003818 28381 tablet_service.cc:1467] Processing CreateTablet for tablet 798ef14558d44d01911b4c8453c2b126 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.003886 27977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 798ef14558d44d01911b4c8453c2b126. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.004098 28381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 798ef14558d44d01911b4c8453c2b126. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.004452 29282 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:38.004523 29282 ts_tablet_manager.cc:1367] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:38.004992 29282 raft_consensus.cc:348] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.005105 29282 raft_consensus.cc:374] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.005136 29282 raft_consensus.cc:729] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.005244 29282 consensus_queue.cc:260] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.005584 29282 ts_tablet_manager.cc:1398] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.005740 29282 tablet_bootstrap.cc:492] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:38.006211 29201 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
I20240502 01:59:38.006577 29282 tablet_bootstrap.cc:654] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.006912 28380 tablet_service.cc:1467] Processing CreateTablet for tablet 3b56295cbe014d6894812ee0a64bc513 (DEFAULT_TABLE table=rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.007135 28380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b56295cbe014d6894812ee0a64bc513. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.007140 29201 tablet_bootstrap.cc:654] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.007716 29287 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
I20240502 01:59:38.009337 29186 tablet_bootstrap.cc:654] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.009954 29286 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:38.010548 29287 tablet_bootstrap.cc:654] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.010710 29201 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:38.010798 29201 ts_tablet_manager.cc:1367] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:59:38.010840 29186 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:38.010890 29286 tablet_bootstrap.cc:654] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.010917 29186 ts_tablet_manager.cc:1367] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.001s
I20240502 01:59:38.011270 29201 raft_consensus.cc:348] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.011389 29201 raft_consensus.cc:374] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.011438 29201 raft_consensus.cc:729] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.011575 29281 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
I20240502 01:59:38.011518 29186 raft_consensus.cc:348] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.011569 29201 consensus_queue.cc:260] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.011647 29186 raft_consensus.cc:374] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.011691 29186 raft_consensus.cc:729] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.011758 29197 tablet_bootstrap.cc:492] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:38.011850 29201 ts_tablet_manager.cc:1398] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.011853 29197 ts_tablet_manager.cc:1367] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20240502 01:59:38.011807 29186 consensus_queue.cc:260] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.012033 29201 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
I20240502 01:59:38.012107 29186 ts_tablet_manager.cc:1398] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20240502 01:59:38.012254 29186 tablet_bootstrap.cc:492] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:38.012300 29197 raft_consensus.cc:348] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.012434 29197 raft_consensus.cc:374] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.012470 29197 raft_consensus.cc:729] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.012595 29197 consensus_queue.cc:260] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.012846 29201 tablet_bootstrap.cc:654] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.012897 29197 ts_tablet_manager.cc:1398] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.013079 29197 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:38.013130 29186 tablet_bootstrap.cc:654] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.013952 29197 tablet_bootstrap.cc:654] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.014968 29186 tablet_bootstrap.cc:492] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:38.015065 29186 ts_tablet_manager.cc:1367] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20240502 01:59:38.015452 29281 tablet_bootstrap.cc:654] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.015511 29186 raft_consensus.cc:348] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.015635 29186 raft_consensus.cc:374] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.015679 29186 raft_consensus.cc:729] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.015802 29186 consensus_queue.cc:260] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.016068 29186 ts_tablet_manager.cc:1398] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:38.016086 29282 tablet_bootstrap.cc:492] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:38.016173 29282 ts_tablet_manager.cc:1367] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20240502 01:59:38.016702 29197 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:38.016813 29197 ts_tablet_manager.cc:1367] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20240502 01:59:38.016821 29282 raft_consensus.cc:348] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.016940 29282 raft_consensus.cc:374] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.016988 29282 raft_consensus.cc:729] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.017163 29282 consensus_queue.cc:260] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.017271 29197 raft_consensus.cc:348] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.017374 29197 raft_consensus.cc:374] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.017410 29197 raft_consensus.cc:729] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.017536 29197 consensus_queue.cc:260] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.017653 29282 ts_tablet_manager.cc:1398] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.017830 29197 ts_tablet_manager.cc:1398] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:38.018779 29286 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:38.018890 29286 ts_tablet_manager.cc:1367] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240502 01:59:38.019349 29286 raft_consensus.cc:348] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.019459 29201 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:38.019483 29286 raft_consensus.cc:374] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.019519 29286 raft_consensus.cc:729] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.019552 29201 ts_tablet_manager.cc:1367] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20240502 01:59:38.019694 29286 consensus_queue.cc:260] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.020018 29201 raft_consensus.cc:348] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.020087 29286 ts_tablet_manager.cc:1398] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.020135 29201 raft_consensus.cc:374] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.020169 29201 raft_consensus.cc:729] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.020263 29286 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:38.020509 29197 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:38.021143 29286 tablet_bootstrap.cc:654] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.021246 29201 consensus_queue.cc:260] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.021395 29197 tablet_bootstrap.cc:654] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.023093 29201 ts_tablet_manager.cc:1398] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:59:38.023129 29287 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:38.023224 29287 ts_tablet_manager.cc:1367] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.002s
I20240502 01:59:38.023288 29201 tablet_bootstrap.cc:492] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
I20240502 01:59:38.023694 29287 raft_consensus.cc:348] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.023826 29287 raft_consensus.cc:374] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.023856 29287 raft_consensus.cc:729] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.024029 29287 consensus_queue.cc:260] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.024197 29201 tablet_bootstrap.cc:654] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.024433 29287 ts_tablet_manager.cc:1398] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:38.024581 29287 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
I20240502 01:59:38.025655 29287 tablet_bootstrap.cc:654] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.025692 29201 tablet_bootstrap.cc:492] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:38.025770 29201 ts_tablet_manager.cc:1367] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:59:38.026264 29201 raft_consensus.cc:348] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.026521 29201 raft_consensus.cc:374] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.026571 29201 raft_consensus.cc:729] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.026708 29287 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:38.026696 29201 consensus_queue.cc:260] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.026798 29287 ts_tablet_manager.cc:1367] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20240502 01:59:38.026949 29201 ts_tablet_manager.cc:1398] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.027210 29287 raft_consensus.cc:348] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.027345 29287 raft_consensus.cc:374] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.027391 29287 raft_consensus.cc:729] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.027511 29287 consensus_queue.cc:260] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.027832 29287 ts_tablet_manager.cc:1398] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:38.028326 29197 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:38.028405 29197 ts_tablet_manager.cc:1367] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20240502 01:59:38.028858 29197 raft_consensus.cc:348] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.028973 29197 raft_consensus.cc:374] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.029012 29197 raft_consensus.cc:729] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.029134 29197 consensus_queue.cc:260] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.029510 29197 ts_tablet_manager.cc:1398] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.029876 29287 tablet_bootstrap.cc:492] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
I20240502 01:59:38.030714 29281 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:38.030826 29281 ts_tablet_manager.cc:1367] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20240502 01:59:38.030925 29287 tablet_bootstrap.cc:654] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.031356 29281 raft_consensus.cc:348] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.031505 29281 raft_consensus.cc:374] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.031543 29281 raft_consensus.cc:729] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.031668 29281 consensus_queue.cc:260] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.032006 29281 ts_tablet_manager.cc:1398] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 01:59:38.032215 29281 tablet_bootstrap.cc:492] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
I20240502 01:59:38.032415 29287 tablet_bootstrap.cc:492] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:38.032495 29287 ts_tablet_manager.cc:1367] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240502 01:59:38.032526 29286 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:38.032636 29286 ts_tablet_manager.cc:1367] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20240502 01:59:38.032804 29287 raft_consensus.cc:348] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.032883 29287 raft_consensus.cc:374] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.032902 29287 raft_consensus.cc:729] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.033015 29287 consensus_queue.cc:260] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.033087 29281 tablet_bootstrap.cc:654] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.033072 29286 raft_consensus.cc:348] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.033190 29286 raft_consensus.cc:374] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.033226 29286 raft_consensus.cc:729] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.033252 29287 ts_tablet_manager.cc:1398] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:38.033367 29286 consensus_queue.cc:260] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.033676 29286 ts_tablet_manager.cc:1398] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:38.033898 29286 tablet_bootstrap.cc:492] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:38.034880 29286 tablet_bootstrap.cc:654] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.035096 29281 tablet_bootstrap.cc:492] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:38.035181 29281 ts_tablet_manager.cc:1367] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:59:38.035634 29281 raft_consensus.cc:348] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.035773 29281 raft_consensus.cc:374] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.035809 29281 raft_consensus.cc:729] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.035935 29281 consensus_queue.cc:260] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.036000 29286 tablet_bootstrap.cc:492] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:38.036074 29286 ts_tablet_manager.cc:1367] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:38.036233 29281 ts_tablet_manager.cc:1398] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.036407 29281 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
I20240502 01:59:38.036697 29286 raft_consensus.cc:348] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.036851 29286 raft_consensus.cc:374] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.036883 29286 raft_consensus.cc:729] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.037017 29286 consensus_queue.cc:260] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.037292 29281 tablet_bootstrap.cc:654] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.037319 29286 ts_tablet_manager.cc:1398] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.038414 29281 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:38.038479 29281 ts_tablet_manager.cc:1367] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:38.039016 29281 raft_consensus.cc:348] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.039188 29281 raft_consensus.cc:374] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.039234 29281 raft_consensus.cc:729] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.039367 29281 consensus_queue.cc:260] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.039660 29281 ts_tablet_manager.cc:1398] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.050630 29132 raft_consensus.cc:482] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:38.050768 29132 raft_consensus.cc:504] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.052088 29132 leader_election.cc:288] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:38.057355 27726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "798ef14558d44d01911b4c8453c2b126" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1" is_pre_election: true
I20240502 01:59:38.057511 27726 raft_consensus.cc:2454] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:38.057965 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "798ef14558d44d01911b4c8453c2b126" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88" is_pre_election: true
I20240502 01:59:38.058117 28265 raft_consensus.cc:2454] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:38.058348 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "798ef14558d44d01911b4c8453c2b126" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:38.058481 27998 raft_consensus.cc:2454] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:38.058779 27796 leader_election.cc:302] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 86e11777d9d744d0a5a8139c99e89f4f, 8ed4b4242123404f86485ec57dc34e88, a8c1908b1c554e7cbbb9bf9751b8ee98, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:38.059069 29132 raft_consensus.cc:2781] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:38.059144 29132 raft_consensus.cc:482] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:38.059190 29132 raft_consensus.cc:3037] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.060194 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "798ef14558d44d01911b4c8453c2b126" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:38.060333 28132 raft_consensus.cc:2454] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:38.060304 29132 raft_consensus.cc:504] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.060940 29132 leader_election.cc:288] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 election: Requested vote from peers da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:38.061062 27726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "798ef14558d44d01911b4c8453c2b126" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1"
I20240502 01:59:38.061204 27726 raft_consensus.cc:3037] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.061504 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "798ef14558d44d01911b4c8453c2b126" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88"
I20240502 01:59:38.061612 28265 raft_consensus.cc:3037] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.061837 28534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "798ef14558d44d01911b4c8453c2b126" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb" is_pre_election: true
I20240502 01:59:38.061838 28401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "798ef14558d44d01911b4c8453c2b126" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:38.061970 28401 raft_consensus.cc:2454] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:38.061970 28534 raft_consensus.cc:2454] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:38.062245 28400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "798ef14558d44d01911b4c8453c2b126" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1"
I20240502 01:59:38.062342 28400 raft_consensus.cc:3037] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.062459 27726 raft_consensus.cc:2454] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:38.062758 28265 raft_consensus.cc:2454] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:38.062966 28535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "798ef14558d44d01911b4c8453c2b126" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb"
I20240502 01:59:38.063079 28535 raft_consensus.cc:3037] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.063175 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "798ef14558d44d01911b4c8453c2b126" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
I20240502 01:59:38.063287 28132 raft_consensus.cc:3037] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.063434 28400 raft_consensus.cc:2454] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:38.063700 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "798ef14558d44d01911b4c8453c2b126" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:38.063735 27798 leader_election.cc:302] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 8ed4b4242123404f86485ec57dc34e88, a8c1908b1c554e7cbbb9bf9751b8ee98, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:38.063829 27998 raft_consensus.cc:3037] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.064111 28535 raft_consensus.cc:2454] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:38.064255 28132 raft_consensus.cc:2454] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:38.064429 29132 raft_consensus.cc:2781] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:38.064666 29132 raft_consensus.cc:686] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Becoming Leader. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Running, Role: LEADER
I20240502 01:59:38.064699 27998 raft_consensus.cc:2454] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:38.065021 29132 consensus_queue.cc:237] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.067538 27576 catalog_manager.cc:5484] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194). New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:38.096634 29061 raft_consensus.cc:482] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:38.096807 29061 raft_consensus.cc:504] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.097489 29061 leader_election.cc:288] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:38.097854 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110a6faea0904da9970934cb2aba94c6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88" is_pre_election: true
I20240502 01:59:38.097853 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110a6faea0904da9970934cb2aba94c6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:38.098021 28265 raft_consensus.cc:2454] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:38.098021 27998 raft_consensus.cc:2454] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:38.098264 28400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110a6faea0904da9970934cb2aba94c6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:38.098393 28400 raft_consensus.cc:2454] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:38.098428 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110a6faea0904da9970934cb2aba94c6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:38.098428 27862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110a6faea0904da9970934cb2aba94c6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" is_pre_election: true
I20240502 01:59:38.098559 27862 raft_consensus.cc:2454] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:38.098559 28132 raft_consensus.cc:2454] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:38.098799 28535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110a6faea0904da9970934cb2aba94c6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb" is_pre_election: true
I20240502 01:59:38.098934 28535 raft_consensus.cc:2454] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:38.098930 27662 leader_election.cc:302] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 86e11777d9d744d0a5a8139c99e89f4f, 8ed4b4242123404f86485ec57dc34e88, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:38.099306 29061 raft_consensus.cc:2781] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:38.099371 29061 raft_consensus.cc:482] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:38.099406 29061 raft_consensus.cc:3037] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.100903 29061 raft_consensus.cc:504] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.101733 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110a6faea0904da9970934cb2aba94c6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88"
I20240502 01:59:38.101733 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110a6faea0904da9970934cb2aba94c6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:38.101850 28265 raft_consensus.cc:3037] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.101850 27998 raft_consensus.cc:3037] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.101974 28400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110a6faea0904da9970934cb2aba94c6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1"
I20240502 01:59:38.102108 28400 raft_consensus.cc:3037] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.102795 28265 raft_consensus.cc:2454] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:38.102794 27998 raft_consensus.cc:2454] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:38.103008 28400 raft_consensus.cc:2454] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:38.103159 27862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110a6faea0904da9970934cb2aba94c6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98"
I20240502 01:59:38.103159 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110a6faea0904da9970934cb2aba94c6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
I20240502 01:59:38.103271 28132 raft_consensus.cc:3037] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.103271 27862 raft_consensus.cc:3037] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.103425 28535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "110a6faea0904da9970934cb2aba94c6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb"
I20240502 01:59:38.103528 28535 raft_consensus.cc:3037] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.104205 28132 raft_consensus.cc:2454] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:38.104290 27862 raft_consensus.cc:2454] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:38.104391 28535 raft_consensus.cc:2454] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:38.104701 29061 leader_election.cc:288] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [CANDIDATE]: Term 1 election: Requested vote from peers a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:38.104893 27661 leader_election.cc:302] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, 82e8cba6ed104c2c9869ea0365bbe482, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:38.105075 29061 raft_consensus.cc:2781] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:38.105157 29061 raft_consensus.cc:686] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Becoming Leader. State: Replica: da58b5341d344efd833502f214e69ff1, State: Running, Role: LEADER
I20240502 01:59:38.105302 29061 consensus_queue.cc:237] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.107782 27575 catalog_manager.cc:5484] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 reported cstate change: term changed from 0 to 1, leader changed from <none> to da58b5341d344efd833502f214e69ff1 (127.10.133.193). New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:38.150794 29083 raft_consensus.cc:482] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:38.150945 29083 raft_consensus.cc:504] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.151024 29132 raft_consensus.cc:482] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:38.151147 29132 raft_consensus.cc:504] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.151662 29083 leader_election.cc:288] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:38.151788 29132 leader_election.cc:288] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:38.152086 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:38.152099 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:38.152232 28132 raft_consensus.cc:2454] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 0.
I20240502 01:59:38.152232 27998 raft_consensus.cc:2454] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 0.
I20240502 01:59:38.152212 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88" is_pre_election: true
I20240502 01:59:38.152387 28400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:38.152510 28400 raft_consensus.cc:2454] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:38.152762 28265 raft_consensus.cc:2454] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 0.
I20240502 01:59:38.152869 28266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88" is_pre_election: true
I20240502 01:59:38.153000 28266 raft_consensus.cc:2454] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:38.153029 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:38.153158 28132 raft_consensus.cc:2454] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:38.153316 27726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1" is_pre_election: true
I20240502 01:59:38.153317 27862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" is_pre_election: true
I20240502 01:59:38.153322 28534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb" is_pre_election: true
I20240502 01:59:38.153373 28333 leader_election.cc:302] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 82e8cba6ed104c2c9869ea0365bbe482, 86e11777d9d744d0a5a8139c99e89f4f, 8ed4b4242123404f86485ec57dc34e88; no voters:
I20240502 01:59:38.153434 27862 raft_consensus.cc:2454] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 0.
I20240502 01:59:38.153435 27726 raft_consensus.cc:2454] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 0.
I20240502 01:59:38.153451 28534 raft_consensus.cc:2454] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:38.153630 29083 raft_consensus.cc:2781] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:38.153695 29083 raft_consensus.cc:482] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:38.153741 29083 raft_consensus.cc:3037] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.153857 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:38.153934 27797 leader_election.cc:302] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 257826b7ad7e4abb8499b6687e8c83eb, 82e8cba6ed104c2c9869ea0365bbe482, 8ed4b4242123404f86485ec57dc34e88, a8c1908b1c554e7cbbb9bf9751b8ee98; no voters:
I20240502 01:59:38.154017 27998 raft_consensus.cc:2454] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:38.154130 29132 raft_consensus.cc:2781] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:38.154178 29132 raft_consensus.cc:482] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:38.154212 29132 raft_consensus.cc:3037] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.154409 28535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb" is_pre_election: true
I20240502 01:59:38.154474 27726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1" is_pre_election: true
I20240502 01:59:38.154525 28535 raft_consensus.cc:2454] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 0.
I20240502 01:59:38.154582 27726 raft_consensus.cc:2454] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:38.154870 29083 raft_consensus.cc:504] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.155294 29132 raft_consensus.cc:504] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.155579 29083 leader_election.cc:288] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [CANDIDATE]: Term 1 election: Requested vote from peers da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:38.156041 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1"
I20240502 01:59:38.156081 27862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98"
I20240502 01:59:38.156181 27728 raft_consensus.cc:3037] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.156200 28131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
I20240502 01:59:38.156225 27862 raft_consensus.cc:2379] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 12f527e76eff4669924a898d5029e3d1 in current term 1: Already voted for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in this term.
I20240502 01:59:38.156307 28131 raft_consensus.cc:3037] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.156689 27726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1"
I20240502 01:59:38.156703 28535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb"
I20240502 01:59:38.156796 28535 raft_consensus.cc:3037] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.156229 29132 leader_election.cc:288] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 election: Requested vote from peers da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:38.157205 27728 raft_consensus.cc:2454] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:38.157362 28131 raft_consensus.cc:2454] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 1.
I20240502 01:59:38.157428 27996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:38.157557 27996 raft_consensus.cc:3037] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.157752 28266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88"
I20240502 01:59:38.157779 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88"
I20240502 01:59:38.157858 28266 raft_consensus.cc:3037] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.157871 28535 raft_consensus.cc:2454] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 1.
I20240502 01:59:38.156316 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
I20240502 01:59:38.158299 28132 raft_consensus.cc:2379] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in current term 1: Already voted for candidate 12f527e76eff4669924a898d5029e3d1 in this term.
I20240502 01:59:38.158672 27996 raft_consensus.cc:2454] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:38.158919 28266 raft_consensus.cc:2454] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12f527e76eff4669924a898d5029e3d1 in term 1.
I20240502 01:59:38.158955 28400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1"
I20240502 01:59:38.158987 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "12f527e76eff4669924a898d5029e3d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:38.159106 28400 raft_consensus.cc:2379] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in current term 1: Already voted for candidate 12f527e76eff4669924a898d5029e3d1 in this term.
I20240502 01:59:38.159106 27998 raft_consensus.cc:2379] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 12f527e76eff4669924a898d5029e3d1 in current term 1: Already voted for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in this term.
I20240502 01:59:38.159188 28333 leader_election.cc:302] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 6 responses out of 7 voters: 4 yes votes; 2 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, 82e8cba6ed104c2c9869ea0365bbe482, 8ed4b4242123404f86485ec57dc34e88; no voters: a8c1908b1c554e7cbbb9bf9751b8ee98, da58b5341d344efd833502f214e69ff1
I20240502 01:59:38.159240 28535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b56295cbe014d6894812ee0a64bc513" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb"
I20240502 01:59:38.159374 28535 raft_consensus.cc:2379] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in current term 1: Already voted for candidate 12f527e76eff4669924a898d5029e3d1 in this term.
I20240502 01:59:38.159386 29083 raft_consensus.cc:2781] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:38.159529 29083 raft_consensus.cc:686] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Becoming Leader. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Running, Role: LEADER
I20240502 01:59:38.159727 27797 leader_election.cc:302] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 7 responses out of 7 voters: 3 yes votes; 4 no votes. yes voters: 86e11777d9d744d0a5a8139c99e89f4f, a8c1908b1c554e7cbbb9bf9751b8ee98, da58b5341d344efd833502f214e69ff1; no voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, 82e8cba6ed104c2c9869ea0365bbe482, 8ed4b4242123404f86485ec57dc34e88
I20240502 01:59:38.159694 29083 consensus_queue.cc:237] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.159890 29132 raft_consensus.cc:2726] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20240502 01:59:38.161919 27575 catalog_manager.cc:5484] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 12f527e76eff4669924a898d5029e3d1 (127.10.133.198). New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } }
W20240502 01:59:38.315274 29319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:38.315531 29319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:38.319021 29319 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_2'
I20240502 01:59:38.407970 28535 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.408404 29083 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.410732 28534 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.411132 29061 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.411825 27998 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.412195 28266 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.413199 29124 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.413479 29124 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.414928 28132 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.415236 28131 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.415541 27862 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.415607 28533 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.416148 27728 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.416504 29061 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.417295 28400 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.417291 27996 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.418308 27998 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.418963 29061 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.419242 28266 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.419974 29132 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.420363 29132 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.420614 29132 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.421193 28400 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.421877 28265 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.422592 29168 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.422951 29168 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.423218 29315 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.423506 29315 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.423723 29315 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.425751 29061 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.437520 27863 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.438228 29124 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.438519 28133 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.443753 29125 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.445029 27726 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.447023 29083 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 220.605 ms
time per row: 0.110302 ms
I20240502 01:59:38.583595 27571 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55090:
name: "rebalance_test_table_3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 7
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20240502 01:59:38.584157 27571 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_3 in case of a server failure: 8 tablet servers would be needed, 7 are available. Consider bringing up more tablet servers.
I20240502 01:59:38.589354 27842 tablet_service.cc:1467] Processing CreateTablet for tablet fea2267a27de4324948a5549eb399267 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.589483 27706 tablet_service.cc:1467] Processing CreateTablet for tablet fea2267a27de4324948a5549eb399267 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.589680 27842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fea2267a27de4324948a5549eb399267. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.589826 27706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fea2267a27de4324948a5549eb399267. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.592147 28244 tablet_service.cc:1467] Processing CreateTablet for tablet 98464434decb46a9810c228f92a41732 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.592419 28244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98464434decb46a9810c228f92a41732. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.592628 28245 tablet_service.cc:1467] Processing CreateTablet for tablet 5c23922560934ef3be8f4659d8727995 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.592880 28245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c23922560934ef3be8f4659d8727995. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.593544 28514 tablet_service.cc:1467] Processing CreateTablet for tablet fea2267a27de4324948a5549eb399267 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.593842 28514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fea2267a27de4324948a5549eb399267. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.594945 27708 tablet_service.cc:1467] Processing CreateTablet for tablet 5c23922560934ef3be8f4659d8727995 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.595186 27708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c23922560934ef3be8f4659d8727995. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.595256 28110 tablet_service.cc:1467] Processing CreateTablet for tablet fea2267a27de4324948a5549eb399267 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.595366 28112 tablet_service.cc:1467] Processing CreateTablet for tablet 5c23922560934ef3be8f4659d8727995 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.595520 28110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fea2267a27de4324948a5549eb399267. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.596586 27977 tablet_service.cc:1467] Processing CreateTablet for tablet fea2267a27de4324948a5549eb399267 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.596868 27977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fea2267a27de4324948a5549eb399267. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.596835 28515 tablet_service.cc:1467] Processing CreateTablet for tablet 98464434decb46a9810c228f92a41732 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.597052 28515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98464434decb46a9810c228f92a41732. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.597373 28113 tablet_service.cc:1467] Processing CreateTablet for tablet 98464434decb46a9810c228f92a41732 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.597579 28113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98464434decb46a9810c228f92a41732. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.598281 27978 tablet_service.cc:1467] Processing CreateTablet for tablet 98464434decb46a9810c228f92a41732 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.598491 27978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98464434decb46a9810c228f92a41732. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.598578 27843 tablet_service.cc:1467] Processing CreateTablet for tablet 5c23922560934ef3be8f4659d8727995 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.598840 27843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c23922560934ef3be8f4659d8727995. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.599136 28513 tablet_service.cc:1467] Processing CreateTablet for tablet 5c23922560934ef3be8f4659d8727995 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.599349 28513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c23922560934ef3be8f4659d8727995. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.592418 28246 tablet_service.cc:1467] Processing CreateTablet for tablet fea2267a27de4324948a5549eb399267 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.600644 27976 tablet_service.cc:1467] Processing CreateTablet for tablet 5c23922560934ef3be8f4659d8727995 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.600760 28246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fea2267a27de4324948a5549eb399267. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.600878 27976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c23922560934ef3be8f4659d8727995. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.602164 28380 tablet_service.cc:1467] Processing CreateTablet for tablet fea2267a27de4324948a5549eb399267 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.602450 28380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fea2267a27de4324948a5549eb399267. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.603015 28379 tablet_service.cc:1467] Processing CreateTablet for tablet 5c23922560934ef3be8f4659d8727995 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.603228 28379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c23922560934ef3be8f4659d8727995. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.604566 29406 tablet_bootstrap.cc:492] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
I20240502 01:59:38.604590 27842 tablet_service.cc:1467] Processing CreateTablet for tablet 98464434decb46a9810c228f92a41732 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.604655 28381 tablet_service.cc:1467] Processing CreateTablet for tablet 98464434decb46a9810c228f92a41732 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.604800 27842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98464434decb46a9810c228f92a41732. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.604884 28381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98464434decb46a9810c228f92a41732. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.605427 29406 tablet_bootstrap.cc:654] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.605592 28112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c23922560934ef3be8f4659d8727995. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.606715 29406 tablet_bootstrap.cc:492] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:38.606804 29406 ts_tablet_manager.cc:1367] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:38.607113 27706 tablet_service.cc:1467] Processing CreateTablet for tablet 98464434decb46a9810c228f92a41732 (DEFAULT_TABLE table=rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:38.607249 29406 raft_consensus.cc:348] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.607376 29406 raft_consensus.cc:374] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.607410 27706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98464434decb46a9810c228f92a41732. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:38.607409 29406 raft_consensus.cc:729] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.607535 29406 consensus_queue.cc:260] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.607825 29406 ts_tablet_manager.cc:1398] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.607986 29406 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
I20240502 01:59:38.608309 29404 tablet_bootstrap.cc:492] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:38.608839 29406 tablet_bootstrap.cc:654] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.609354 29404 tablet_bootstrap.cc:654] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.610049 29403 tablet_bootstrap.cc:492] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:38.610358 29400 tablet_bootstrap.cc:492] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
I20240502 01:59:38.610589 29401 tablet_bootstrap.cc:492] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:38.610976 29403 tablet_bootstrap.cc:654] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.611560 29401 tablet_bootstrap.cc:654] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.611574 29405 tablet_bootstrap.cc:492] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
I20240502 01:59:38.611755 29400 tablet_bootstrap.cc:654] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.612277 29402 tablet_bootstrap.cc:492] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:38.612453 29405 tablet_bootstrap.cc:654] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.612479 29404 tablet_bootstrap.cc:492] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:38.612562 29404 ts_tablet_manager.cc:1367] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:59:38.613027 29404 raft_consensus.cc:348] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.613166 29404 raft_consensus.cc:374] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.613209 29404 raft_consensus.cc:729] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.613371 29404 consensus_queue.cc:260] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.613448 29406 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:38.613524 29406 ts_tablet_manager.cc:1367] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240502 01:59:38.613685 29403 tablet_bootstrap.cc:492] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:38.613777 29403 ts_tablet_manager.cc:1367] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:59:38.613778 29404 ts_tablet_manager.cc:1398] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.613978 29404 tablet_bootstrap.cc:492] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:38.614228 29403 raft_consensus.cc:348] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.614341 29403 raft_consensus.cc:374] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.614348 29400 tablet_bootstrap.cc:492] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:38.614372 29403 raft_consensus.cc:729] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.614435 29400 ts_tablet_manager.cc:1367] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:59:38.614504 29403 consensus_queue.cc:260] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.614770 29403 ts_tablet_manager.cc:1398] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:38.614830 29404 tablet_bootstrap.cc:654] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.614974 29403 tablet_bootstrap.cc:492] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:38.614849 29400 raft_consensus.cc:348] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.615024 29400 raft_consensus.cc:374] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.615068 29400 raft_consensus.cc:729] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.615221 29400 consensus_queue.cc:260] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.615528 29400 ts_tablet_manager.cc:1398] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.615585 29406 raft_consensus.cc:348] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.615746 29400 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
I20240502 01:59:38.615753 29406 raft_consensus.cc:374] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.615798 29406 raft_consensus.cc:729] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.615833 29403 tablet_bootstrap.cc:654] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.615998 29404 tablet_bootstrap.cc:492] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:38.615926 29406 consensus_queue.cc:260] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.616073 29404 ts_tablet_manager.cc:1367] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:38.616240 29406 ts_tablet_manager.cc:1398] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:59:38.616407 29406 tablet_bootstrap.cc:492] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
I20240502 01:59:38.616465 29404 raft_consensus.cc:348] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:38.616562 29400 tablet_bootstrap.cc:654] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.616596 29404 raft_consensus.cc:374] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.616626 29404 raft_consensus.cc:729] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.616748 29404 consensus_queue.cc:260] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:38.617091 29404 ts_tablet_manager.cc:1398] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.617275 29404 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:38.617275 29406 tablet_bootstrap.cc:654] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.618067 29405 tablet_bootstrap.cc:492] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:38.618156 29405 ts_tablet_manager.cc:1367] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240502 01:59:38.618156 29404 tablet_bootstrap.cc:654] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.618636 29405 raft_consensus.cc:348] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:38.618764 29405 raft_consensus.cc:374] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.618804 29405 raft_consensus.cc:729] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.618944 29405 consensus_queue.cc:260] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:38.619231 29405 ts_tablet_manager.cc:1398] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:38.619427 29405 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
I20240502 01:59:38.619984 29403 tablet_bootstrap.cc:492] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:38.620074 29403 ts_tablet_manager.cc:1367] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:59:38.620260 29405 tablet_bootstrap.cc:654] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.620494 29403 raft_consensus.cc:348] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:38.620599 29403 raft_consensus.cc:374] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.620628 29403 raft_consensus.cc:729] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.620730 29403 consensus_queue.cc:260] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:38.621102 29403 ts_tablet_manager.cc:1398] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.621353 29403 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:38.621356 29401 tablet_bootstrap.cc:492] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:38.621443 29401 ts_tablet_manager.cc:1367] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20240502 01:59:38.621927 29401 raft_consensus.cc:348] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.622092 29401 raft_consensus.cc:374] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.622128 29401 raft_consensus.cc:729] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.622165 29403 tablet_bootstrap.cc:654] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.622258 29401 consensus_queue.cc:260] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.622571 29401 ts_tablet_manager.cc:1398] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.622735 29401 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:38.623059 29404 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:38.623145 29404 ts_tablet_manager.cc:1367] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240502 01:59:38.623612 29401 tablet_bootstrap.cc:654] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.623576 29404 raft_consensus.cc:348] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.623684 29404 raft_consensus.cc:374] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.623719 29404 raft_consensus.cc:729] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.623840 29404 consensus_queue.cc:260] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.624136 29404 ts_tablet_manager.cc:1398] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.624323 29402 tablet_bootstrap.cc:654] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.624819 29403 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:38.624934 29403 ts_tablet_manager.cc:1367] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240502 01:59:38.625373 29403 raft_consensus.cc:348] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.625483 29403 raft_consensus.cc:374] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.625520 29403 raft_consensus.cc:729] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.625644 29403 consensus_queue.cc:260] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.625952 29403 ts_tablet_manager.cc:1398] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.626545 29400 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:38.626626 29400 ts_tablet_manager.cc:1367] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20240502 01:59:38.626664 29406 tablet_bootstrap.cc:492] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:38.626691 29401 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:38.626744 29406 ts_tablet_manager.cc:1367] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20240502 01:59:38.626765 29401 ts_tablet_manager.cc:1367] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240502 01:59:38.627074 29400 raft_consensus.cc:348] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.627197 29400 raft_consensus.cc:374] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.627228 29400 raft_consensus.cc:729] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.627164 29401 raft_consensus.cc:348] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.627278 29401 raft_consensus.cc:374] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.627313 29401 raft_consensus.cc:729] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.627243 29406 raft_consensus.cc:348] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:38.627352 29406 raft_consensus.cc:374] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.627384 29406 raft_consensus.cc:729] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.627355 29400 consensus_queue.cc:260] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.627419 29401 consensus_queue.cc:260] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.627516 29406 consensus_queue.cc:260] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:38.627645 29400 ts_tablet_manager.cc:1398] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.627681 29401 ts_tablet_manager.cc:1398] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:38.627821 29406 ts_tablet_manager.cc:1398] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:38.627828 29400 tablet_bootstrap.cc:492] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
I20240502 01:59:38.628507 29405 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:38.628589 29405 ts_tablet_manager.cc:1367] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20240502 01:59:38.628844 29401 tablet_bootstrap.cc:492] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:38.628902 29400 tablet_bootstrap.cc:654] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.629060 29405 raft_consensus.cc:348] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.629189 29405 raft_consensus.cc:374] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.629228 29405 raft_consensus.cc:729] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.629344 29405 consensus_queue.cc:260] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.629621 29405 ts_tablet_manager.cc:1398] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.629729 29401 tablet_bootstrap.cc:654] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.629792 29405 tablet_bootstrap.cc:492] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
I20240502 01:59:38.630859 29405 tablet_bootstrap.cc:654] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.630892 29402 tablet_bootstrap.cc:492] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:38.630991 29402 ts_tablet_manager.cc:1367] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20240502 01:59:38.632058 29402 raft_consensus.cc:348] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:38.632220 29402 raft_consensus.cc:374] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.632263 29402 raft_consensus.cc:729] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.632405 29402 consensus_queue.cc:260] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:38.632495 29405 tablet_bootstrap.cc:492] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:38.632716 29402 ts_tablet_manager.cc:1398] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:38.632877 29402 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:38.633131 29405 ts_tablet_manager.cc:1367] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:59:38.633603 29405 raft_consensus.cc:348] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.633770 29402 tablet_bootstrap.cc:654] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.633862 29405 raft_consensus.cc:374] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.633950 29405 raft_consensus.cc:729] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.634187 29405 consensus_queue.cc:260] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.634944 29400 tablet_bootstrap.cc:492] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:38.635031 29400 ts_tablet_manager.cc:1367] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20240502 01:59:38.635129 29401 tablet_bootstrap.cc:492] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:38.635203 29401 ts_tablet_manager.cc:1367] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20240502 01:59:38.635458 29400 raft_consensus.cc:348] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:38.635578 29400 raft_consensus.cc:374] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.635619 29400 raft_consensus.cc:729] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.635588 29401 raft_consensus.cc:348] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:38.635695 29401 raft_consensus.cc:374] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.635725 29401 raft_consensus.cc:729] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.635769 29400 consensus_queue.cc:260] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:38.635839 29401 consensus_queue.cc:260] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:38.636080 29400 ts_tablet_manager.cc:1398] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:38.636116 29401 ts_tablet_manager.cc:1398] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:38.636107 29405 ts_tablet_manager.cc:1398] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:59:38.637032 29402 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:38.637120 29402 ts_tablet_manager.cc:1367] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20240502 01:59:38.637542 29402 raft_consensus.cc:348] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.637702 29402 raft_consensus.cc:374] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.637742 29402 raft_consensus.cc:729] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.637874 29402 consensus_queue.cc:260] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.638376 29402 ts_tablet_manager.cc:1398] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20240502 01:59:38.638556 29402 tablet_bootstrap.cc:492] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:38.639603 29355 raft_consensus.cc:482] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:38.639703 29355 raft_consensus.cc:504] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:38.640211 29402 tablet_bootstrap.cc:654] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:38.640480 29355 leader_election.cc:288] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917)
I20240502 01:59:38.640671 28400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98464434decb46a9810c228f92a41732" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:38.640753 27996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98464434decb46a9810c228f92a41732" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:38.640807 28400 raft_consensus.cc:2454] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:38.640884 27996 raft_consensus.cc:2454] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:38.641230 28133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98464434decb46a9810c228f92a41732" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:38.641294 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98464434decb46a9810c228f92a41732" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88" is_pre_election: true
I20240502 01:59:38.641352 28133 raft_consensus.cc:2454] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:38.641414 28265 raft_consensus.cc:2454] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:38.641438 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98464434decb46a9810c228f92a41732" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1" is_pre_election: true
I20240502 01:59:38.641561 27728 raft_consensus.cc:2454] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:38.641600 28535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98464434decb46a9810c228f92a41732" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb" is_pre_election: true
I20240502 01:59:38.641744 28535 raft_consensus.cc:2454] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:38.641819 27797 leader_election.cc:302] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 8ed4b4242123404f86485ec57dc34e88, a8c1908b1c554e7cbbb9bf9751b8ee98, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:38.642048 29355 raft_consensus.cc:2781] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:38.642098 29355 raft_consensus.cc:482] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:38.642149 29355 raft_consensus.cc:3037] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.643023 29355 raft_consensus.cc:504] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:38.643633 29402 tablet_bootstrap.cc:492] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:38.643622 29355 leader_election.cc:288] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 election: Requested vote from peers 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917)
I20240502 01:59:38.643823 28133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98464434decb46a9810c228f92a41732" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
I20240502 01:59:38.643929 28133 raft_consensus.cc:3037] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.643723 29402 ts_tablet_manager.cc:1367] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20240502 01:59:38.643818 28264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98464434decb46a9810c228f92a41732" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88"
I20240502 01:59:38.644160 28264 raft_consensus.cc:3037] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.644161 27996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98464434decb46a9810c228f92a41732" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:38.644253 27996 raft_consensus.cc:3037] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.644425 29402 raft_consensus.cc:348] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.644529 29402 raft_consensus.cc:374] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:38.644556 29402 raft_consensus.cc:729] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:38.644668 29402 consensus_queue.cc:260] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.644927 28133 raft_consensus.cc:2454] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:38.644973 29402 ts_tablet_manager.cc:1398] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:38.645169 28264 raft_consensus.cc:2454] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:38.645154 28400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98464434decb46a9810c228f92a41732" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1"
I20240502 01:59:38.645220 27996 raft_consensus.cc:2454] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:38.645258 28400 raft_consensus.cc:3037] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.646188 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98464434decb46a9810c228f92a41732" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1"
I20240502 01:59:38.646301 27728 raft_consensus.cc:3037] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.646953 28535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98464434decb46a9810c228f92a41732" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb"
I20240502 01:59:38.647056 28535 raft_consensus.cc:3037] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.647343 27728 raft_consensus.cc:2454] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:38.647948 28535 raft_consensus.cc:2454] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:38.648008 27797 leader_election.cc:302] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 86e11777d9d744d0a5a8139c99e89f4f, 8ed4b4242123404f86485ec57dc34e88, a8c1908b1c554e7cbbb9bf9751b8ee98, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:38.648202 29355 raft_consensus.cc:2781] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:38.648275 29355 raft_consensus.cc:686] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Becoming Leader. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Running, Role: LEADER
I20240502 01:59:38.648407 29355 consensus_queue.cc:237] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:38.648759 28400 raft_consensus.cc:2454] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:38.650547 27573 catalog_manager.cc:5484] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194). New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:38.681041 29120 raft_consensus.cc:482] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:38.681164 29120 raft_consensus.cc:504] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.681761 29120 leader_election.cc:288] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921)
I20240502 01:59:38.681910 27862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fea2267a27de4324948a5549eb399267" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" is_pre_election: true
I20240502 01:59:38.681955 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fea2267a27de4324948a5549eb399267" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1" is_pre_election: true
I20240502 01:59:38.681977 27996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fea2267a27de4324948a5549eb399267" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:38.682060 27862 raft_consensus.cc:2454] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:38.682113 27728 raft_consensus.cc:2454] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:38.682132 27996 raft_consensus.cc:2454] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:38.682335 28400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fea2267a27de4324948a5549eb399267" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:38.682473 28400 raft_consensus.cc:2454] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:38.682466 28133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fea2267a27de4324948a5549eb399267" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:38.682471 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fea2267a27de4324948a5549eb399267" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88" is_pre_election: true
I20240502 01:59:38.682613 28133 raft_consensus.cc:2454] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:38.682618 28265 raft_consensus.cc:2454] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:38.682816 28470 leader_election.cc:302] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, 86e11777d9d744d0a5a8139c99e89f4f, a8c1908b1c554e7cbbb9bf9751b8ee98; no voters:
I20240502 01:59:38.683018 29120 raft_consensus.cc:2781] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:38.683089 29120 raft_consensus.cc:482] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:38.683127 29120 raft_consensus.cc:3037] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.684095 29120 raft_consensus.cc:504] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.684657 29120 leader_election.cc:288] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 election: Requested vote from peers a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921)
I20240502 01:59:38.684845 27862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fea2267a27de4324948a5549eb399267" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98"
I20240502 01:59:38.684975 27862 raft_consensus.cc:3037] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.684962 28400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fea2267a27de4324948a5549eb399267" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1"
I20240502 01:59:38.685060 28400 raft_consensus.cc:3037] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.685070 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fea2267a27de4324948a5549eb399267" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88"
I20240502 01:59:38.685174 28265 raft_consensus.cc:3037] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.685201 27996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fea2267a27de4324948a5549eb399267" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:38.685221 28133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fea2267a27de4324948a5549eb399267" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
I20240502 01:59:38.685295 27996 raft_consensus.cc:3037] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.685314 28133 raft_consensus.cc:3037] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.686005 28400 raft_consensus.cc:2454] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:38.686122 28265 raft_consensus.cc:2454] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:38.686179 27996 raft_consensus.cc:2454] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:38.686276 28133 raft_consensus.cc:2454] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:38.686450 28468 leader_election.cc:302] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, 86e11777d9d744d0a5a8139c99e89f4f, 8ed4b4242123404f86485ec57dc34e88; no voters:
I20240502 01:59:38.686594 29120 raft_consensus.cc:2781] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:38.686609 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fea2267a27de4324948a5549eb399267" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1"
I20240502 01:59:38.686688 29120 raft_consensus.cc:686] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Becoming Leader. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Running, Role: LEADER
I20240502 01:59:38.686760 27728 raft_consensus.cc:3037] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.686828 29120 consensus_queue.cc:237] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.687572 27728 raft_consensus.cc:2454] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:38.688632 27573 catalog_manager.cc:5484] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199). New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:38.706692 27862 raft_consensus.cc:2454] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:38.751220 29353 raft_consensus.cc:482] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:38.751363 29353 raft_consensus.cc:504] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.752110 29353 leader_election.cc:288] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:38.752557 27996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c23922560934ef3be8f4659d8727995" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:38.752593 27862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c23922560934ef3be8f4659d8727995" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" is_pre_election: true
I20240502 01:59:38.752712 27862 raft_consensus.cc:2454] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:38.752710 27996 raft_consensus.cc:2454] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:38.752687 28400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c23922560934ef3be8f4659d8727995" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:38.752851 28400 raft_consensus.cc:2454] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:38.753196 27662 leader_election.cc:302] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 86e11777d9d744d0a5a8139c99e89f4f, a8c1908b1c554e7cbbb9bf9751b8ee98, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:38.753208 28535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c23922560934ef3be8f4659d8727995" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb" is_pre_election: true
I20240502 01:59:38.753368 29353 raft_consensus.cc:2781] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:38.753345 28535 raft_consensus.cc:2454] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:38.753425 29353 raft_consensus.cc:482] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:38.753461 29353 raft_consensus.cc:3037] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.753530 28133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c23922560934ef3be8f4659d8727995" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:38.753540 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c23922560934ef3be8f4659d8727995" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88" is_pre_election: true
I20240502 01:59:38.753669 28133 raft_consensus.cc:2454] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:38.753715 28265 raft_consensus.cc:2454] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:38.754861 29353 raft_consensus.cc:504] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.755518 29353 leader_election.cc:288] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [CANDIDATE]: Term 1 election: Requested vote from peers a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:38.755815 28133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c23922560934ef3be8f4659d8727995" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
I20240502 01:59:38.755880 28400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c23922560934ef3be8f4659d8727995" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1"
I20240502 01:59:38.755946 28133 raft_consensus.cc:3037] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.755993 28400 raft_consensus.cc:3037] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.756183 27862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c23922560934ef3be8f4659d8727995" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98"
I20240502 01:59:38.756287 27862 raft_consensus.cc:3037] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.756948 28400 raft_consensus.cc:2454] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:38.756991 28133 raft_consensus.cc:2454] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:38.757237 27862 raft_consensus.cc:2454] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:38.757305 28535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c23922560934ef3be8f4659d8727995" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb"
I20240502 01:59:38.757398 28535 raft_consensus.cc:3037] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.757423 27996 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c23922560934ef3be8f4659d8727995" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:38.757539 27996 raft_consensus.cc:3037] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.757637 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c23922560934ef3be8f4659d8727995" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88"
I20240502 01:59:38.757710 27664 leader_election.cc:302] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 82e8cba6ed104c2c9869ea0365bbe482, a8c1908b1c554e7cbbb9bf9751b8ee98, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:38.757766 28265 raft_consensus.cc:3037] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:38.757882 29353 raft_consensus.cc:2781] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:38.758249 29353 raft_consensus.cc:686] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Becoming Leader. State: Replica: da58b5341d344efd833502f214e69ff1, State: Running, Role: LEADER
I20240502 01:59:38.758394 29353 consensus_queue.cc:237] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:38.758487 27996 raft_consensus.cc:2454] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:38.758757 28265 raft_consensus.cc:2454] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:38.760700 27573 catalog_manager.cc:5484] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 reported cstate change: term changed from 0 to 1, leader changed from <none> to da58b5341d344efd833502f214e69ff1 (127.10.133.193). New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:38.774803 28535 raft_consensus.cc:2454] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
W20240502 01:59:38.880398 29431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:38.880687 29431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:38.883738 29431 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_3'
I20240502 01:59:38.976325 27996 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.976784 29355 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.979071 28400 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.979352 28535 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.979477 29120 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.979732 29354 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.982575 28265 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.983013 28133 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.983659 29354 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.983979 29354 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.984591 28401 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.984937 27728 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.986410 28534 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.987020 29352 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.988497 29355 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.989524 28401 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.989802 29355 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.991636 29353 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.995820 28264 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.995846 28131 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.996237 29352 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.996702 27862 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.996816 27998 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:38.997223 29353 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.997347 29061 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:38.997622 29168 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.006398 27863 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.006717 27727 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.006976 27996 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.007062 28132 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.007508 28264 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.007803 29122 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.008211 29122 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.010332 29120 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.010673 29120 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.024283 29122 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.055800 29133 mvcc.cc:205] Tried to move back new op lower bound from 7023063773092413440 to 7023063771903258624. Current Snapshot: MvccSnapshot[applied={T|T < 7023063773092413440}]
I20240502 01:59:39.075254 29171 mvcc.cc:205] Tried to move back new op lower bound from 7023063773107462144 to 7023063772197322752. Current Snapshot: MvccSnapshot[applied={T|T < 7023063773107462144}]
I20240502 01:59:39.077279 29370 mvcc.cc:205] Tried to move back new op lower bound from 7023063773107462144 to 7023063772197322752. Current Snapshot: MvccSnapshot[applied={T|T < 7023063773107462144}]
I20240502 01:59:39.082110 29474 mvcc.cc:205] Tried to move back new op lower bound from 7023063773133373440 to 7023063771747450880. Current Snapshot: MvccSnapshot[applied={T|T < 7023063773133373440}]
I20240502 01:59:39.090170 29374 mvcc.cc:205] Tried to move back new op lower bound from 7023063773107462144 to 7023063772197322752. Current Snapshot: MvccSnapshot[applied={T|T < 7023063773107462144}]
INSERT report
rows total: 2000
time total: 191.737 ms
time per row: 0.0958685 ms
I20240502 01:59:39.112666 29489 mvcc.cc:205] Tried to move back new op lower bound from 7023063773220765696 to 7023063771903258624. Current Snapshot: MvccSnapshot[applied={T|T < 7023063773092413440}]
I20240502 01:59:39.115787 29144 mvcc.cc:205] Tried to move back new op lower bound from 7023063773220765696 to 7023063771903258624. Current Snapshot: MvccSnapshot[applied={T|T < 7023063773092413440}]
I20240502 01:59:39.133570 27578 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55090:
name: "rebalance_test_table_4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 7
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20240502 01:59:39.134195 27578 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_4 in case of a server failure: 8 tablet servers would be needed, 7 are available. Consider bringing up more tablet servers.
I20240502 01:59:39.143268 28381 tablet_service.cc:1467] Processing CreateTablet for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.143580 28381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.146030 28379 tablet_service.cc:1467] Processing CreateTablet for tablet 25d8fba21674442fbd100478245ff9aa (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.146279 28379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25d8fba21674442fbd100478245ff9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.148268 28380 tablet_service.cc:1467] Processing CreateTablet for tablet 8e28491b849646a08325fb239f64542c (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.148489 28380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e28491b849646a08325fb239f64542c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.150568 28513 tablet_service.cc:1467] Processing CreateTablet for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.150837 28513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.153044 28515 tablet_service.cc:1467] Processing CreateTablet for tablet 25d8fba21674442fbd100478245ff9aa (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.153276 28515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25d8fba21674442fbd100478245ff9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.155599 27707 tablet_service.cc:1467] Processing CreateTablet for tablet 8e28491b849646a08325fb239f64542c (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.155599 27706 tablet_service.cc:1467] Processing CreateTablet for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.155627 27708 tablet_service.cc:1467] Processing CreateTablet for tablet 25d8fba21674442fbd100478245ff9aa (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.155948 27706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.156096 27708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25d8fba21674442fbd100478245ff9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.156296 27707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e28491b849646a08325fb239f64542c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.157629 27842 tablet_service.cc:1467] Processing CreateTablet for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.157895 27842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.157840 27977 tablet_service.cc:1467] Processing CreateTablet for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.158166 27977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.158294 27976 tablet_service.cc:1467] Processing CreateTablet for tablet 25d8fba21674442fbd100478245ff9aa (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.158504 27976 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25d8fba21674442fbd100478245ff9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.159827 29506 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
I20240502 01:59:39.159998 27843 tablet_service.cc:1467] Processing CreateTablet for tablet 25d8fba21674442fbd100478245ff9aa (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.160208 27843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25d8fba21674442fbd100478245ff9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.160389 27978 tablet_service.cc:1467] Processing CreateTablet for tablet 8e28491b849646a08325fb239f64542c (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.160621 27978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e28491b849646a08325fb239f64542c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.160810 29506 tablet_bootstrap.cc:654] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.161960 29506 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:39.162070 29506 ts_tablet_manager.cc:1367] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:39.162362 27841 tablet_service.cc:1467] Processing CreateTablet for tablet 8e28491b849646a08325fb239f64542c (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.162600 27841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e28491b849646a08325fb239f64542c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.162557 29506 raft_consensus.cc:348] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.162672 29506 raft_consensus.cc:374] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.162710 29506 raft_consensus.cc:729] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.162822 29506 consensus_queue.cc:260] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.163211 29506 ts_tablet_manager.cc:1398] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.163370 29506 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
I20240502 01:59:39.164110 29507 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
I20240502 01:59:39.164261 29506 tablet_bootstrap.cc:654] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.164964 29507 tablet_bootstrap.cc:654] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.165326 29506 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:39.165416 29506 ts_tablet_manager.cc:1367] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:39.165881 29506 raft_consensus.cc:348] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.166014 29506 raft_consensus.cc:374] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.166011 29505 tablet_bootstrap.cc:492] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:39.166054 29506 raft_consensus.cc:729] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.166011 28246 tablet_service.cc:1467] Processing CreateTablet for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.166193 29506 consensus_queue.cc:260] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.166275 28246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.166414 28245 tablet_service.cc:1467] Processing CreateTablet for tablet 25d8fba21674442fbd100478245ff9aa (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.166491 29506 ts_tablet_manager.cc:1398] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:39.166644 29506 tablet_bootstrap.cc:492] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
I20240502 01:59:39.166658 28245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25d8fba21674442fbd100478245ff9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.166906 29505 tablet_bootstrap.cc:654] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.167493 29506 tablet_bootstrap.cc:654] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.167908 29507 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:39.167999 29507 ts_tablet_manager.cc:1367] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240502 01:59:39.168437 29507 raft_consensus.cc:348] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.168576 29507 raft_consensus.cc:374] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.168617 29507 raft_consensus.cc:729] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.168745 28244 tablet_service.cc:1467] Processing CreateTablet for tablet 8e28491b849646a08325fb239f64542c (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.168761 29507 consensus_queue.cc:260] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.168953 28244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e28491b849646a08325fb239f64542c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.169118 29507 ts_tablet_manager.cc:1398] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.169283 29507 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
I20240502 01:59:39.169283 29513 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:39.170183 29513 tablet_bootstrap.cc:654] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.170890 29507 tablet_bootstrap.cc:654] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.170915 28112 tablet_service.cc:1467] Processing CreateTablet for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.171195 28112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.171279 29513 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:39.171351 29513 ts_tablet_manager.cc:1367] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:39.171792 29507 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:39.171849 29507 ts_tablet_manager.cc:1367] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:59:39.171763 29513 raft_consensus.cc:348] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.171880 29513 raft_consensus.cc:374] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.171911 29513 raft_consensus.cc:729] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.172019 29513 consensus_queue.cc:260] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.172142 29507 raft_consensus.cc:348] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.172251 29507 raft_consensus.cc:374] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.172282 29507 raft_consensus.cc:729] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.172322 29513 ts_tablet_manager.cc:1398] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.172403 29507 consensus_queue.cc:260] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.172480 29513 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:39.172658 29507 ts_tablet_manager.cc:1398] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:39.172783 29507 tablet_bootstrap.cc:492] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
I20240502 01:59:39.173327 29513 tablet_bootstrap.cc:654] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.173422 29516 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:39.173436 29507 tablet_bootstrap.cc:654] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.173615 28113 tablet_service.cc:1467] Processing CreateTablet for tablet 25d8fba21674442fbd100478245ff9aa (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.173849 28113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25d8fba21674442fbd100478245ff9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.174386 29516 tablet_bootstrap.cc:654] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.175046 29505 tablet_bootstrap.cc:492] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:39.175155 29505 ts_tablet_manager.cc:1367] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240502 01:59:39.175419 29516 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:39.175504 29516 ts_tablet_manager.cc:1367] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:39.175655 29505 raft_consensus.cc:348] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.175786 29505 raft_consensus.cc:374] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.175825 29505 raft_consensus.cc:729] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.175810 28110 tablet_service.cc:1467] Processing CreateTablet for tablet 8e28491b849646a08325fb239f64542c (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.175940 29516 raft_consensus.cc:348] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.175956 29505 consensus_queue.cc:260] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.176043 28110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e28491b849646a08325fb239f64542c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.176057 29516 raft_consensus.cc:374] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.176155 29516 raft_consensus.cc:729] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.176313 29516 consensus_queue.cc:260] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.176349 29505 ts_tablet_manager.cc:1398] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.176671 29516 ts_tablet_manager.cc:1398] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.176846 29516 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:39.177000 29505 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:39.177712 29516 tablet_bootstrap.cc:654] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.178058 29505 tablet_bootstrap.cc:654] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.178782 29516 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:39.178867 29516 ts_tablet_manager.cc:1367] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:39.179039 29505 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:39.179097 29505 ts_tablet_manager.cc:1367] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:39.179250 29516 raft_consensus.cc:348] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.179352 29516 raft_consensus.cc:374] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.179381 29516 raft_consensus.cc:729] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.179396 29505 raft_consensus.cc:348] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.179518 29505 raft_consensus.cc:374] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.179488 29516 consensus_queue.cc:260] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.179544 29505 raft_consensus.cc:729] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.179661 29505 consensus_queue.cc:260] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.179752 29516 ts_tablet_manager.cc:1398] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.179932 29516 tablet_bootstrap.cc:492] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:39.179944 29505 ts_tablet_manager.cc:1398] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:39.180068 29505 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:39.180713 29505 tablet_bootstrap.cc:654] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.180718 29516 tablet_bootstrap.cc:654] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.181556 29505 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:39.181635 29505 ts_tablet_manager.cc:1367] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:39.181968 29505 raft_consensus.cc:348] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.186110 29505 raft_consensus.cc:374] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.186167 29505 raft_consensus.cc:729] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.186339 29505 consensus_queue.cc:260] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.186704 29505 ts_tablet_manager.cc:1398] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20240502 01:59:39.186807 28515 tablet_service.cc:1467] Processing CreateTablet for tablet 8e28491b849646a08325fb239f64542c (DEFAULT_TABLE table=rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.187101 28515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e28491b849646a08325fb239f64542c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.187356 29504 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:39.188546 29503 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
I20240502 01:59:39.189911 29504 tablet_bootstrap.cc:654] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.190207 29506 tablet_bootstrap.cc:492] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:39.190308 29506 ts_tablet_manager.cc:1367] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.001s
I20240502 01:59:39.190644 29503 tablet_bootstrap.cc:654] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.190932 29506 raft_consensus.cc:348] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.191109 29506 raft_consensus.cc:374] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.191149 29506 raft_consensus.cc:729] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.191288 29506 consensus_queue.cc:260] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.191586 29504 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:39.191608 29506 ts_tablet_manager.cc:1398] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.191757 29504 ts_tablet_manager.cc:1367] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:59:39.191792 29513 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:39.191906 29513 ts_tablet_manager.cc:1367] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.000s
I20240502 01:59:39.192214 29504 raft_consensus.cc:348] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.192349 29504 raft_consensus.cc:374] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.192389 29504 raft_consensus.cc:729] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.192384 29513 raft_consensus.cc:348] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.192508 29513 raft_consensus.cc:374] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.192507 29504 consensus_queue.cc:260] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.192545 29513 raft_consensus.cc:729] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.192689 29513 consensus_queue.cc:260] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.192763 29504 ts_tablet_manager.cc:1398] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:39.192912 29504 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:39.193015 29513 ts_tablet_manager.cc:1398] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.193209 29513 tablet_bootstrap.cc:492] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:39.193845 29504 tablet_bootstrap.cc:654] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.195012 29513 tablet_bootstrap.cc:654] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.196143 29513 tablet_bootstrap.cc:492] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:39.196225 29513 ts_tablet_manager.cc:1367] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:59:39.196632 29513 raft_consensus.cc:348] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.196727 29513 raft_consensus.cc:374] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.196748 29513 raft_consensus.cc:729] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.196851 29513 consensus_queue.cc:260] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.197088 29513 ts_tablet_manager.cc:1398] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:39.198096 29503 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:39.198192 29504 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:39.198276 29504 ts_tablet_manager.cc:1367] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20240502 01:59:39.198297 29503 ts_tablet_manager.cc:1367] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20240502 01:59:39.198706 29504 raft_consensus.cc:348] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.198889 29504 raft_consensus.cc:374] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.198930 29504 raft_consensus.cc:729] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.198796 29503 raft_consensus.cc:348] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.199108 29503 raft_consensus.cc:374] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.199095 29504 consensus_queue.cc:260] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.199405 29504 ts_tablet_manager.cc:1398] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:39.199604 29504 tablet_bootstrap.cc:492] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:39.199180 29503 raft_consensus.cc:729] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.199883 29503 consensus_queue.cc:260] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.200290 29503 ts_tablet_manager.cc:1398] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:39.200682 29504 tablet_bootstrap.cc:654] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.201073 29503 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
I20240502 01:59:39.201876 29503 tablet_bootstrap.cc:654] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.202487 29504 tablet_bootstrap.cc:492] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:39.202567 29504 ts_tablet_manager.cc:1367] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:59:39.203019 29503 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:39.203115 29503 ts_tablet_manager.cc:1367] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:39.203056 29504 raft_consensus.cc:348] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.203166 29504 raft_consensus.cc:374] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.203200 29504 raft_consensus.cc:729] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.203361 29504 consensus_queue.cc:260] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.203655 29504 ts_tablet_manager.cc:1398] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.203652 29503 raft_consensus.cc:348] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.203780 29503 raft_consensus.cc:374] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.203820 29503 raft_consensus.cc:729] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.203948 29503 consensus_queue.cc:260] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.204252 29503 ts_tablet_manager.cc:1398] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.204425 29503 tablet_bootstrap.cc:492] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
I20240502 01:59:39.205207 29503 tablet_bootstrap.cc:654] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.206652 29503 tablet_bootstrap.cc:492] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:39.206662 29516 tablet_bootstrap.cc:492] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:39.206745 29503 ts_tablet_manager.cc:1367] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:39.206756 29516 ts_tablet_manager.cc:1367] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.000s
I20240502 01:59:39.207171 29503 raft_consensus.cc:348] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.207296 29503 raft_consensus.cc:374] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.207226 29516 raft_consensus.cc:348] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.207335 29503 raft_consensus.cc:729] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.207345 29516 raft_consensus.cc:374] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.207379 29516 raft_consensus.cc:729] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.207499 29503 consensus_queue.cc:260] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.207509 29516 consensus_queue.cc:260] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.207803 29516 ts_tablet_manager.cc:1398] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.208163 29503 ts_tablet_manager.cc:1398] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.214349 29507 tablet_bootstrap.cc:492] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:39.214468 29507 ts_tablet_manager.cc:1367] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.000s
I20240502 01:59:39.214954 29507 raft_consensus.cc:348] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.215126 29507 raft_consensus.cc:374] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.215159 29507 raft_consensus.cc:729] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.215281 29507 consensus_queue.cc:260] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.215548 29507 ts_tablet_manager.cc:1398] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:39.220423 29487 raft_consensus.cc:482] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:39.220530 29487 raft_consensus.cc:504] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.221216 29487 leader_election.cc:288] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:39.221371 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d8fba21674442fbd100478245ff9aa" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1" is_pre_election: true
I20240502 01:59:39.221428 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d8fba21674442fbd100478245ff9aa" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:39.221531 27728 raft_consensus.cc:2454] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 0.
I20240502 01:59:39.221578 28132 raft_consensus.cc:2454] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 0.
I20240502 01:59:39.221556 27862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d8fba21674442fbd100478245ff9aa" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" is_pre_election: true
I20240502 01:59:39.221697 27862 raft_consensus.cc:2454] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 0.
I20240502 01:59:39.222115 28399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d8fba21674442fbd100478245ff9aa" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:39.222132 28201 leader_election.cc:302] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 82e8cba6ed104c2c9869ea0365bbe482, 8ed4b4242123404f86485ec57dc34e88, a8c1908b1c554e7cbbb9bf9751b8ee98, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:39.222251 28399 raft_consensus.cc:2454] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 0.
I20240502 01:59:39.222250 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d8fba21674442fbd100478245ff9aa" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:39.222357 27998 raft_consensus.cc:2454] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 0.
I20240502 01:59:39.222513 28534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d8fba21674442fbd100478245ff9aa" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb" is_pre_election: true
I20240502 01:59:39.222673 28534 raft_consensus.cc:2454] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 0.
I20240502 01:59:39.222914 29487 raft_consensus.cc:2781] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:39.222980 29487 raft_consensus.cc:482] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:39.223032 29487 raft_consensus.cc:3037] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.223851 29487 raft_consensus.cc:504] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.224049 29355 raft_consensus.cc:482] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:39.224155 29355 raft_consensus.cc:504] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.224409 29487 leader_election.cc:288] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [CANDIDATE]: Term 1 election: Requested vote from peers da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:39.224797 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d8fba21674442fbd100478245ff9aa" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
I20240502 01:59:39.224913 28132 raft_consensus.cc:3037] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.224959 29355 leader_election.cc:288] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917)
I20240502 01:59:39.225023 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d8fba21674442fbd100478245ff9aa" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:39.225138 27998 raft_consensus.cc:3037] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.225258 27727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc0c5e7b20cd4fb8ac78ae2bff4f8187" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1" is_pre_election: true
I20240502 01:59:39.225391 27727 raft_consensus.cc:2454] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:39.225700 28399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d8fba21674442fbd100478245ff9aa" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1"
I20240502 01:59:39.225824 28399 raft_consensus.cc:3037] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.225890 28132 raft_consensus.cc:2454] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 1.
I20240502 01:59:39.226101 27998 raft_consensus.cc:2454] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 1.
I20240502 01:59:39.226349 28534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc0c5e7b20cd4fb8ac78ae2bff4f8187" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb" is_pre_election: true
I20240502 01:59:39.226480 28534 raft_consensus.cc:2454] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:39.226580 27862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d8fba21674442fbd100478245ff9aa" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98"
I20240502 01:59:39.226688 27862 raft_consensus.cc:3037] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.226940 28534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d8fba21674442fbd100478245ff9aa" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb"
I20240502 01:59:39.227041 28534 raft_consensus.cc:3037] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.227046 28399 raft_consensus.cc:2454] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 1.
I20240502 01:59:39.227286 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25d8fba21674442fbd100478245ff9aa" candidate_uuid: "8ed4b4242123404f86485ec57dc34e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1"
I20240502 01:59:39.227393 27728 raft_consensus.cc:3037] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.227705 27862 raft_consensus.cc:2454] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 1.
I20240502 01:59:39.228039 28534 raft_consensus.cc:2454] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 1.
I20240502 01:59:39.228242 27728 raft_consensus.cc:2454] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ed4b4242123404f86485ec57dc34e88 in term 1.
I20240502 01:59:39.228361 28202 leader_election.cc:302] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, 82e8cba6ed104c2c9869ea0365bbe482, 8ed4b4242123404f86485ec57dc34e88; no voters:
I20240502 01:59:39.228415 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc0c5e7b20cd4fb8ac78ae2bff4f8187" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:39.228518 28132 raft_consensus.cc:2454] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:39.228755 27795 leader_election.cc:302] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 257826b7ad7e4abb8499b6687e8c83eb, 82e8cba6ed104c2c9869ea0365bbe482, a8c1908b1c554e7cbbb9bf9751b8ee98, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:39.228787 28264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc0c5e7b20cd4fb8ac78ae2bff4f8187" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88" is_pre_election: true
I20240502 01:59:39.228899 28264 raft_consensus.cc:2454] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:39.228942 29355 raft_consensus.cc:2781] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:39.228915 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc0c5e7b20cd4fb8ac78ae2bff4f8187" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:39.228993 29355 raft_consensus.cc:482] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:39.229039 29355 raft_consensus.cc:3037] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.229032 27998 raft_consensus.cc:2454] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:39.229442 28399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc0c5e7b20cd4fb8ac78ae2bff4f8187" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:39.229569 28399 raft_consensus.cc:2454] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:39.229744 29487 raft_consensus.cc:2781] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:39.229832 29487 raft_consensus.cc:686] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Becoming Leader. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Running, Role: LEADER
I20240502 01:59:39.230044 29355 raft_consensus.cc:504] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.230039 29487 consensus_queue.cc:237] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.230669 29355 leader_election.cc:288] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 election: Requested vote from peers 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917)
I20240502 01:59:39.230975 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc0c5e7b20cd4fb8ac78ae2bff4f8187" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
I20240502 01:59:39.230967 28264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc0c5e7b20cd4fb8ac78ae2bff4f8187" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88"
I20240502 01:59:39.231076 28132 raft_consensus.cc:3037] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.231074 28264 raft_consensus.cc:3037] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.231977 28264 raft_consensus.cc:2454] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:39.231977 28132 raft_consensus.cc:2454] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:39.232105 28534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc0c5e7b20cd4fb8ac78ae2bff4f8187" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb"
I20240502 01:59:39.232218 28534 raft_consensus.cc:3037] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.232235 28399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc0c5e7b20cd4fb8ac78ae2bff4f8187" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1"
I20240502 01:59:39.232334 28399 raft_consensus.cc:3037] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.232717 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc0c5e7b20cd4fb8ac78ae2bff4f8187" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1"
I20240502 01:59:39.232833 27728 raft_consensus.cc:3037] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.233129 28534 raft_consensus.cc:2454] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:39.233237 28399 raft_consensus.cc:2454] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:39.233207 27575 catalog_manager.cc:5484] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197). New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:39.233453 27797 leader_election.cc:302] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 257826b7ad7e4abb8499b6687e8c83eb, 82e8cba6ed104c2c9869ea0365bbe482, 8ed4b4242123404f86485ec57dc34e88, a8c1908b1c554e7cbbb9bf9751b8ee98; no voters:
I20240502 01:59:39.233623 29355 raft_consensus.cc:2781] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:39.233673 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc0c5e7b20cd4fb8ac78ae2bff4f8187" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:39.233767 29355 raft_consensus.cc:686] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Becoming Leader. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Running, Role: LEADER
I20240502 01:59:39.233783 27998 raft_consensus.cc:3037] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.233798 27728 raft_consensus.cc:2454] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:39.234686 27998 raft_consensus.cc:2454] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:39.234604 29355 consensus_queue.cc:237] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.237000 27575 catalog_manager.cc:5484] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194). New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:39.274019 29355 raft_consensus.cc:482] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:39.274148 29355 raft_consensus.cc:504] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.274938 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e28491b849646a08325fb239f64542c" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1" is_pre_election: true
I20240502 01:59:39.275100 28264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e28491b849646a08325fb239f64542c" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88" is_pre_election: true
I20240502 01:59:39.275249 28264 raft_consensus.cc:2454] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:39.275296 29355 leader_election.cc:288] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:39.275511 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e28491b849646a08325fb239f64542c" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:39.275285 27728 raft_consensus.cc:2454] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:39.275664 27998 raft_consensus.cc:2454] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:39.275925 28399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e28491b849646a08325fb239f64542c" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:39.276022 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e28491b849646a08325fb239f64542c" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:39.276057 28399 raft_consensus.cc:2454] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:39.276140 28132 raft_consensus.cc:2454] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:39.276170 28534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e28491b849646a08325fb239f64542c" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb" is_pre_election: true
I20240502 01:59:39.276298 28534 raft_consensus.cc:2454] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:39.276397 27795 leader_election.cc:302] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 82e8cba6ed104c2c9869ea0365bbe482, 86e11777d9d744d0a5a8139c99e89f4f, 8ed4b4242123404f86485ec57dc34e88, a8c1908b1c554e7cbbb9bf9751b8ee98; no voters:
I20240502 01:59:39.276552 29355 raft_consensus.cc:2781] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:39.276594 29355 raft_consensus.cc:482] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:39.276628 29355 raft_consensus.cc:3037] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.277614 29355 raft_consensus.cc:504] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.278342 27728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e28491b849646a08325fb239f64542c" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1"
I20240502 01:59:39.278374 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e28491b849646a08325fb239f64542c" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:39.278424 28264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e28491b849646a08325fb239f64542c" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88"
I20240502 01:59:39.278473 27998 raft_consensus.cc:3037] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.278539 28264 raft_consensus.cc:3037] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.278566 27728 raft_consensus.cc:3037] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.279428 28264 raft_consensus.cc:2454] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:39.279419 27998 raft_consensus.cc:2454] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:39.279668 27728 raft_consensus.cc:2454] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:39.280027 27797 leader_election.cc:302] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 86e11777d9d744d0a5a8139c99e89f4f, 8ed4b4242123404f86485ec57dc34e88, a8c1908b1c554e7cbbb9bf9751b8ee98, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:39.280193 29132 raft_consensus.cc:2781] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:39.280175 28399 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e28491b849646a08325fb239f64542c" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1"
I20240502 01:59:39.280180 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e28491b849646a08325fb239f64542c" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
I20240502 01:59:39.280263 29132 raft_consensus.cc:686] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Becoming Leader. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Running, Role: LEADER
I20240502 01:59:39.280283 28399 raft_consensus.cc:3037] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.280295 28132 raft_consensus.cc:3037] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.280426 29132 consensus_queue.cc:237] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.281208 28399 raft_consensus.cc:2454] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:39.281318 28132 raft_consensus.cc:2454] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:39.282186 29355 leader_election.cc:288] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 election: Requested vote from peers da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:39.282392 28534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e28491b849646a08325fb239f64542c" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb"
I20240502 01:59:39.282497 28534 raft_consensus.cc:3037] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.282737 27575 catalog_manager.cc:5484] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194). New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:39.283318 28534 raft_consensus.cc:2454] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
W20240502 01:59:39.402400 29534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:39.402630 29534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:39.405747 29534 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_4'
I20240502 01:59:39.488255 28534 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.488715 29355 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.488823 27998 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.489255 29355 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.490823 28535 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.490867 28399 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.491335 29487 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.492995 27996 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.493471 29486 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.493791 29486 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.495229 28132 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.495721 29354 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.495847 28264 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.496752 27728 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.497452 29355 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.498004 28400 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.498289 29355 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.499779 28131 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.500730 28535 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.501155 29276 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.502154 27727 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.504244 29487 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.504575 29132 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.505697 27997 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.506163 28133 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.506386 29355 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.506729 28400 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.507360 28265 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.507517 27862 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.507704 29354 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.508016 29354 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.508787 29355 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.509074 29355 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.509900 29276 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:39.517833 27726 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:39.519810 29357 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 190.685 ms
time per row: 0.0953425 ms
I20240502 01:59:39.642887 27573 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55090:
name: "rebalance_test_table_5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 7
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20240502 01:59:39.643517 27573 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_5 in case of a server failure: 8 tablet servers would be needed, 7 are available. Consider bringing up more tablet servers.
I20240502 01:59:39.655133 28515 tablet_service.cc:1467] Processing CreateTablet for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.655172 28514 tablet_service.cc:1467] Processing CreateTablet for tablet e1bd5156bcca44438438c6ca78facd35 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.655529 28513 tablet_service.cc:1467] Processing CreateTablet for tablet 3b192861d915430e8f027be85d7d00b6 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.656193 28380 tablet_service.cc:1467] Processing CreateTablet for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.656374 28379 tablet_service.cc:1467] Processing CreateTablet for tablet 3b192861d915430e8f027be85d7d00b6 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.656430 27978 tablet_service.cc:1467] Processing CreateTablet for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.656522 28380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.656659 28379 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b192861d915430e8f027be85d7d00b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.656688 27978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.658963 29507 tablet_bootstrap.cc:492] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
I20240502 01:59:39.659081 27706 tablet_service.cc:1467] Processing CreateTablet for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.659353 27706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.659858 29507 tablet_bootstrap.cc:654] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.661649 29505 tablet_bootstrap.cc:492] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:39.661873 28381 tablet_service.cc:1467] Processing CreateTablet for tablet e1bd5156bcca44438438c6ca78facd35 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.662138 28381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1bd5156bcca44438438c6ca78facd35. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.662405 29507 tablet_bootstrap.cc:492] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:39.662490 29507 ts_tablet_manager.cc:1367] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20240502 01:59:39.662596 29505 tablet_bootstrap.cc:654] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.662940 29507 raft_consensus.cc:348] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.663064 29507 raft_consensus.cc:374] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.663108 29507 raft_consensus.cc:729] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.663254 29507 consensus_queue.cc:260] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.663592 29507 ts_tablet_manager.cc:1398] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:39.664283 27708 tablet_service.cc:1467] Processing CreateTablet for tablet 3b192861d915430e8f027be85d7d00b6 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.664466 27708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b192861d915430e8f027be85d7d00b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.666208 29503 tablet_bootstrap.cc:492] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
I20240502 01:59:39.665949 27707 tablet_service.cc:1467] Processing CreateTablet for tablet e1bd5156bcca44438438c6ca78facd35 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.666654 27707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1bd5156bcca44438438c6ca78facd35. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.666993 29503 tablet_bootstrap.cc:654] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.668033 29503 tablet_bootstrap.cc:492] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:39.668123 29503 ts_tablet_manager.cc:1367] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:39.668594 29503 raft_consensus.cc:348] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.668736 29503 raft_consensus.cc:374] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.668771 29503 raft_consensus.cc:729] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.668911 29503 consensus_queue.cc:260] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.668957 28244 tablet_service.cc:1467] Processing CreateTablet for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.669121 28515 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.669220 29503 ts_tablet_manager.cc:1398] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.669237 28244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.669386 29503 tablet_bootstrap.cc:492] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
I20240502 01:59:39.671252 29503 tablet_bootstrap.cc:654] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.671653 28110 tablet_service.cc:1467] Processing CreateTablet for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.671931 28110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.672235 27841 tablet_service.cc:1467] Processing CreateTablet for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.672477 27841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.673172 27842 tablet_service.cc:1467] Processing CreateTablet for tablet e1bd5156bcca44438438c6ca78facd35 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.673408 27842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1bd5156bcca44438438c6ca78facd35. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.673421 29505 tablet_bootstrap.cc:492] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:39.673499 29505 ts_tablet_manager.cc:1367] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.001s
I20240502 01:59:39.673929 29505 raft_consensus.cc:348] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.674046 29516 tablet_bootstrap.cc:492] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:39.674072 29505 raft_consensus.cc:374] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.674103 29505 raft_consensus.cc:729] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.674221 29505 consensus_queue.cc:260] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.674530 29505 ts_tablet_manager.cc:1398] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.674750 29505 tablet_bootstrap.cc:492] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:39.674765 27977 tablet_service.cc:1467] Processing CreateTablet for tablet e1bd5156bcca44438438c6ca78facd35 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.674893 29516 tablet_bootstrap.cc:654] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.675051 27977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1bd5156bcca44438438c6ca78facd35. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.675554 29505 tablet_bootstrap.cc:654] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.675689 27843 tablet_service.cc:1467] Processing CreateTablet for tablet 3b192861d915430e8f027be85d7d00b6 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.675935 27843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b192861d915430e8f027be85d7d00b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.676640 29506 tablet_bootstrap.cc:492] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
I20240502 01:59:39.676882 27978 tablet_service.cc:1467] Processing CreateTablet for tablet 3b192861d915430e8f027be85d7d00b6 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.677111 27978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b192861d915430e8f027be85d7d00b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.677338 29507 tablet_bootstrap.cc:492] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
I20240502 01:59:39.677471 29506 tablet_bootstrap.cc:654] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.678215 29507 tablet_bootstrap.cc:654] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.678185 28245 tablet_service.cc:1467] Processing CreateTablet for tablet 3b192861d915430e8f027be85d7d00b6 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.678454 28245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b192861d915430e8f027be85d7d00b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.679265 29506 tablet_bootstrap.cc:492] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:39.679342 29506 ts_tablet_manager.cc:1367] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:59:39.679781 29506 raft_consensus.cc:348] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.679895 29506 raft_consensus.cc:374] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.679927 29506 raft_consensus.cc:729] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.680042 29506 consensus_queue.cc:260] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.680334 29506 ts_tablet_manager.cc:1398] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.680510 29506 tablet_bootstrap.cc:492] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
I20240502 01:59:39.680660 29513 tablet_bootstrap.cc:492] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:39.680938 28113 tablet_service.cc:1467] Processing CreateTablet for tablet 3b192861d915430e8f027be85d7d00b6 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.681183 28113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b192861d915430e8f027be85d7d00b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.681375 29506 tablet_bootstrap.cc:654] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.681468 29513 tablet_bootstrap.cc:654] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.682447 28112 tablet_service.cc:1467] Processing CreateTablet for tablet e1bd5156bcca44438438c6ca78facd35 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.682689 28112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1bd5156bcca44438438c6ca78facd35. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.683136 29505 tablet_bootstrap.cc:492] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:39.683225 29505 ts_tablet_manager.cc:1367] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20240502 01:59:39.683707 29505 raft_consensus.cc:348] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.683844 29505 raft_consensus.cc:374] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.683877 29505 raft_consensus.cc:729] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.683854 28246 tablet_service.cc:1467] Processing CreateTablet for tablet e1bd5156bcca44438438c6ca78facd35 (DEFAULT_TABLE table=rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:39.684055 29516 tablet_bootstrap.cc:492] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:39.684000 29505 consensus_queue.cc:260] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.684073 28246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1bd5156bcca44438438c6ca78facd35. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.684135 29516 ts_tablet_manager.cc:1367] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20240502 01:59:39.684372 29505 ts_tablet_manager.cc:1398] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.684530 29505 tablet_bootstrap.cc:492] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:39.684576 29516 raft_consensus.cc:348] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.684682 29516 raft_consensus.cc:374] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.684713 29516 raft_consensus.cc:729] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.684827 29516 consensus_queue.cc:260] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.685137 29516 ts_tablet_manager.cc:1398] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.685292 29516 tablet_bootstrap.cc:492] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:39.685448 29505 tablet_bootstrap.cc:654] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.685492 28514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1bd5156bcca44438438c6ca78facd35. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.686528 29504 tablet_bootstrap.cc:492] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:39.686885 29507 tablet_bootstrap.cc:492] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:39.686976 29507 ts_tablet_manager.cc:1367] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20240502 01:59:39.687364 29504 tablet_bootstrap.cc:654] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.687420 29507 raft_consensus.cc:348] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.687579 29507 raft_consensus.cc:374] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.687613 29507 raft_consensus.cc:729] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.687772 28513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b192861d915430e8f027be85d7d00b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:39.687752 29507 consensus_queue.cc:260] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.688066 29507 ts_tablet_manager.cc:1398] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.688223 29507 tablet_bootstrap.cc:492] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
I20240502 01:59:39.688398 29504 tablet_bootstrap.cc:492] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:39.688472 29504 ts_tablet_manager.cc:1367] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:39.688905 29504 raft_consensus.cc:348] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.689024 29504 raft_consensus.cc:374] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.689054 29504 raft_consensus.cc:729] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.689146 29507 tablet_bootstrap.cc:654] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.689163 29504 consensus_queue.cc:260] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.689268 29516 tablet_bootstrap.cc:654] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.689424 29504 ts_tablet_manager.cc:1398] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.689582 29504 tablet_bootstrap.cc:492] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:39.690445 29505 tablet_bootstrap.cc:492] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:39.690454 29504 tablet_bootstrap.cc:654] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.690531 29505 ts_tablet_manager.cc:1367] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240502 01:59:39.690673 29506 tablet_bootstrap.cc:492] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:39.690747 29506 ts_tablet_manager.cc:1367] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20240502 01:59:39.691138 29506 raft_consensus.cc:348] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.691133 29505 raft_consensus.cc:348] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.691252 29506 raft_consensus.cc:374] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.691252 29505 raft_consensus.cc:374] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.691285 29506 raft_consensus.cc:729] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.691285 29505 raft_consensus.cc:729] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.691408 29506 consensus_queue.cc:260] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.691414 29505 consensus_queue.cc:260] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.691903 29506 ts_tablet_manager.cc:1398] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.692059 29506 tablet_bootstrap.cc:492] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
I20240502 01:59:39.692847 29504 tablet_bootstrap.cc:492] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:39.692930 29504 ts_tablet_manager.cc:1367] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:59:39.692968 29506 tablet_bootstrap.cc:654] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.693183 29505 ts_tablet_manager.cc:1398] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:59:39.693359 29504 raft_consensus.cc:348] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.693482 29504 raft_consensus.cc:374] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.693516 29504 raft_consensus.cc:729] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.693650 29504 consensus_queue.cc:260] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.693909 29516 tablet_bootstrap.cc:492] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:39.693921 29504 ts_tablet_manager.cc:1398] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.694032 29516 ts_tablet_manager.cc:1367] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20240502 01:59:39.694090 29504 tablet_bootstrap.cc:492] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:39.694514 29516 raft_consensus.cc:348] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.694630 29516 raft_consensus.cc:374] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.694672 29516 raft_consensus.cc:729] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.694792 29516 consensus_queue.cc:260] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.694972 29504 tablet_bootstrap.cc:654] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.695148 29516 ts_tablet_manager.cc:1398] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.695297 29516 tablet_bootstrap.cc:492] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:39.695299 29513 tablet_bootstrap.cc:492] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:39.695394 29513 ts_tablet_manager.cc:1367] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20240502 01:59:39.695895 29513 raft_consensus.cc:348] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.696019 29513 raft_consensus.cc:374] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.696061 29513 raft_consensus.cc:729] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.696135 29516 tablet_bootstrap.cc:654] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.696208 29513 consensus_queue.cc:260] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.696543 29513 ts_tablet_manager.cc:1398] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.697036 29504 tablet_bootstrap.cc:492] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:39.697121 29504 ts_tablet_manager.cc:1367] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:59:39.697520 29504 raft_consensus.cc:348] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.697644 29504 raft_consensus.cc:374] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.697680 29504 raft_consensus.cc:729] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.697803 29504 consensus_queue.cc:260] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.698098 29504 ts_tablet_manager.cc:1398] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.699242 29503 tablet_bootstrap.cc:492] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:39.699358 29503 ts_tablet_manager.cc:1367] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20240502 01:59:39.699563 29513 tablet_bootstrap.cc:492] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:39.700012 29503 raft_consensus.cc:348] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.700135 29503 raft_consensus.cc:374] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.700166 29503 raft_consensus.cc:729] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.700295 29503 consensus_queue.cc:260] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.700635 29503 ts_tablet_manager.cc:1398] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.700850 29503 tablet_bootstrap.cc:492] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
I20240502 01:59:39.701332 29513 tablet_bootstrap.cc:654] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.701777 29503 tablet_bootstrap.cc:654] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.702512 29507 tablet_bootstrap.cc:492] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:39.702608 29507 ts_tablet_manager.cc:1367] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20240502 01:59:39.702986 29516 tablet_bootstrap.cc:492] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:39.703035 29503 tablet_bootstrap.cc:492] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:39.703080 29516 ts_tablet_manager.cc:1367] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20240502 01:59:39.703125 29503 ts_tablet_manager.cc:1367] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:39.703130 29507 raft_consensus.cc:348] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.703259 29507 raft_consensus.cc:374] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.703296 29507 raft_consensus.cc:729] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.703433 29507 consensus_queue.cc:260] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.703554 29516 raft_consensus.cc:348] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.703590 29503 raft_consensus.cc:348] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.703685 29516 raft_consensus.cc:374] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.703699 29503 raft_consensus.cc:374] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.703730 29516 raft_consensus.cc:729] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.703732 29503 raft_consensus.cc:729] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.703868 29516 consensus_queue.cc:260] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.703873 29503 consensus_queue.cc:260] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.704178 29516 ts_tablet_manager.cc:1398] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.704186 29503 ts_tablet_manager.cc:1398] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.705367 29507 ts_tablet_manager.cc:1398] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:59:39.705909 29506 tablet_bootstrap.cc:492] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:39.706036 29506 ts_tablet_manager.cc:1367] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.002s
I20240502 01:59:39.706300 29352 raft_consensus.cc:482] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:39.706418 29352 raft_consensus.cc:504] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.706568 29506 raft_consensus.cc:348] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.706676 29506 raft_consensus.cc:374] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.706707 29506 raft_consensus.cc:729] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.706825 29506 consensus_queue.cc:260] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.707149 29352 leader_election.cc:288] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:39.707226 29506 ts_tablet_manager.cc:1398] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.707258 29513 tablet_bootstrap.cc:492] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:39.707340 29513 ts_tablet_manager.cc:1367] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20240502 01:59:39.707657 28533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b192861d915430e8f027be85d7d00b6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb" is_pre_election: true
I20240502 01:59:39.707788 28533 raft_consensus.cc:2454] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:39.707749 29513 raft_consensus.cc:348] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.707870 29513 raft_consensus.cc:374] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.707913 29513 raft_consensus.cc:729] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.708029 29513 consensus_queue.cc:260] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.708145 28401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b192861d915430e8f027be85d7d00b6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:39.708261 28401 raft_consensus.cc:2454] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:39.708287 29513 ts_tablet_manager.cc:1398] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:39.708460 29513 tablet_bootstrap.cc:492] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:39.708593 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b192861d915430e8f027be85d7d00b6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:39.708727 27998 raft_consensus.cc:2454] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:39.709318 29513 tablet_bootstrap.cc:654] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:39.710443 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b192861d915430e8f027be85d7d00b6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:39.710520 27862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b192861d915430e8f027be85d7d00b6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" is_pre_election: true
I20240502 01:59:39.710582 28132 raft_consensus.cc:2454] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:39.710642 27862 raft_consensus.cc:2454] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:39.710786 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b192861d915430e8f027be85d7d00b6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88" is_pre_election: true
I20240502 01:59:39.710937 28265 raft_consensus.cc:2454] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:39.711268 27661 leader_election.cc:302] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, 82e8cba6ed104c2c9869ea0365bbe482, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:39.711711 29497 raft_consensus.cc:2781] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:39.711776 29497 raft_consensus.cc:482] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:39.711815 29497 raft_consensus.cc:3037] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.712669 29513 tablet_bootstrap.cc:492] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:39.712775 29513 ts_tablet_manager.cc:1367] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20240502 01:59:39.712929 29497 raft_consensus.cc:504] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.713238 29513 raft_consensus.cc:348] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.713346 29513 raft_consensus.cc:374] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:39.713380 29513 raft_consensus.cc:729] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:39.713493 29513 consensus_queue.cc:260] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.713584 29497 leader_election.cc:288] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [CANDIDATE]: Term 1 election: Requested vote from peers a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:39.713824 29513 ts_tablet_manager.cc:1398] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:39.714056 27862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b192861d915430e8f027be85d7d00b6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98"
I20240502 01:59:39.714169 27862 raft_consensus.cc:3037] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.714396 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b192861d915430e8f027be85d7d00b6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
I20240502 01:59:39.714493 28132 raft_consensus.cc:3037] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.715126 27862 raft_consensus.cc:2454] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:39.715447 28132 raft_consensus.cc:2454] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:39.715772 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b192861d915430e8f027be85d7d00b6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88"
I20240502 01:59:39.715878 28265 raft_consensus.cc:3037] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.716367 28401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b192861d915430e8f027be85d7d00b6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1"
I20240502 01:59:39.716477 28401 raft_consensus.cc:3037] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.716881 28265 raft_consensus.cc:2454] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:39.717185 27661 leader_election.cc:302] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 82e8cba6ed104c2c9869ea0365bbe482, 8ed4b4242123404f86485ec57dc34e88, a8c1908b1c554e7cbbb9bf9751b8ee98, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:39.717408 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b192861d915430e8f027be85d7d00b6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:39.717533 27998 raft_consensus.cc:3037] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.717531 28401 raft_consensus.cc:2454] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:39.717828 29497 raft_consensus.cc:2781] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:39.717914 29497 raft_consensus.cc:686] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Becoming Leader. State: Replica: da58b5341d344efd833502f214e69ff1, State: Running, Role: LEADER
I20240502 01:59:39.718135 29497 consensus_queue.cc:237] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.718534 27998 raft_consensus.cc:2454] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:39.718940 28533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b192861d915430e8f027be85d7d00b6" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb"
I20240502 01:59:39.719094 28533 raft_consensus.cc:3037] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.720147 28533 raft_consensus.cc:2454] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:39.720351 27571 catalog_manager.cc:5484] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 reported cstate change: term changed from 0 to 1, leader changed from <none> to da58b5341d344efd833502f214e69ff1 (127.10.133.193). New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:39.727342 29354 raft_consensus.cc:482] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:39.727474 29354 raft_consensus.cc:504] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.728230 29354 leader_election.cc:288] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:39.728245 27725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1bd5156bcca44438438c6ca78facd35" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1" is_pre_election: true
I20240502 01:59:39.728327 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1bd5156bcca44438438c6ca78facd35" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:39.728358 27725 raft_consensus.cc:2454] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:39.728355 28401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1bd5156bcca44438438c6ca78facd35" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:39.728466 27998 raft_consensus.cc:2454] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:39.728471 28401 raft_consensus.cc:2454] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:39.728839 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1bd5156bcca44438438c6ca78facd35" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:39.728933 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1bd5156bcca44438438c6ca78facd35" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88" is_pre_election: true
I20240502 01:59:39.728971 28132 raft_consensus.cc:2454] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:39.729069 28265 raft_consensus.cc:2454] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:39.729099 27798 leader_election.cc:302] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 86e11777d9d744d0a5a8139c99e89f4f, a8c1908b1c554e7cbbb9bf9751b8ee98, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:39.729084 28533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1bd5156bcca44438438c6ca78facd35" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb" is_pre_election: true
I20240502 01:59:39.729199 28533 raft_consensus.cc:2454] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 0.
I20240502 01:59:39.729241 29354 raft_consensus.cc:2781] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:39.729285 29354 raft_consensus.cc:482] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:39.729323 29354 raft_consensus.cc:3037] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.730155 29354 raft_consensus.cc:504] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.730675 29354 leader_election.cc:288] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 election: Requested vote from peers da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:39.730829 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1bd5156bcca44438438c6ca78facd35" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:39.730883 28401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1bd5156bcca44438438c6ca78facd35" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1"
I20240502 01:59:39.730958 27998 raft_consensus.cc:3037] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.730975 28401 raft_consensus.cc:3037] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.731153 27725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1bd5156bcca44438438c6ca78facd35" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1"
I20240502 01:59:39.731145 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1bd5156bcca44438438c6ca78facd35" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88"
I20240502 01:59:39.731251 28265 raft_consensus.cc:3037] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.731251 27725 raft_consensus.cc:3037] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.731859 28401 raft_consensus.cc:2454] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:39.731859 27998 raft_consensus.cc:2454] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:39.732187 27725 raft_consensus.cc:2454] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:39.732187 28265 raft_consensus.cc:2454] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:39.732455 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1bd5156bcca44438438c6ca78facd35" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
I20240502 01:59:39.732544 28533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1bd5156bcca44438438c6ca78facd35" candidate_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb"
I20240502 01:59:39.732591 28132 raft_consensus.cc:3037] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.732625 27797 leader_election.cc:302] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 86e11777d9d744d0a5a8139c99e89f4f, a8c1908b1c554e7cbbb9bf9751b8ee98, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:39.732659 28533 raft_consensus.cc:3037] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.732797 29354 raft_consensus.cc:2781] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:39.732904 29354 raft_consensus.cc:686] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Becoming Leader. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Running, Role: LEADER
I20240502 01:59:39.733036 29354 consensus_queue.cc:237] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:39.733505 28132 raft_consensus.cc:2454] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:39.733654 28533 raft_consensus.cc:2454] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8c1908b1c554e7cbbb9bf9751b8ee98 in term 1.
I20240502 01:59:39.735227 27571 catalog_manager.cc:5484] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194). New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:39.763751 29040 raft_consensus.cc:482] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:39.763897 29040 raft_consensus.cc:504] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.765417 29040 leader_election.cc:288] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629), a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917)
I20240502 01:59:39.770768 28401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86eb15ad9b1b4ee6ab734cdbb972d5d3" candidate_uuid: "82e8cba6ed104c2c9869ea0365bbe482" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:39.770934 28401 raft_consensus.cc:2454] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82e8cba6ed104c2c9869ea0365bbe482 in term 0.
I20240502 01:59:39.771718 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86eb15ad9b1b4ee6ab734cdbb972d5d3" candidate_uuid: "82e8cba6ed104c2c9869ea0365bbe482" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88" is_pre_election: true
I20240502 01:59:39.771848 28265 raft_consensus.cc:2454] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82e8cba6ed104c2c9869ea0365bbe482 in term 0.
I20240502 01:59:39.773025 28533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86eb15ad9b1b4ee6ab734cdbb972d5d3" candidate_uuid: "82e8cba6ed104c2c9869ea0365bbe482" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb" is_pre_election: true
I20240502 01:59:39.773175 28533 raft_consensus.cc:2454] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82e8cba6ed104c2c9869ea0365bbe482 in term 0.
I20240502 01:59:39.773697 27862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86eb15ad9b1b4ee6ab734cdbb972d5d3" candidate_uuid: "82e8cba6ed104c2c9869ea0365bbe482" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" is_pre_election: true
I20240502 01:59:39.773773 28067 leader_election.cc:302] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, 82e8cba6ed104c2c9869ea0365bbe482, 8ed4b4242123404f86485ec57dc34e88; no voters:
I20240502 01:59:39.773856 27862 raft_consensus.cc:2454] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82e8cba6ed104c2c9869ea0365bbe482 in term 0.
I20240502 01:59:39.774091 29040 raft_consensus.cc:2781] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:39.774156 29040 raft_consensus.cc:482] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:39.774195 29040 raft_consensus.cc:3037] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.774398 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86eb15ad9b1b4ee6ab734cdbb972d5d3" candidate_uuid: "82e8cba6ed104c2c9869ea0365bbe482" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:39.774518 27998 raft_consensus.cc:2454] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82e8cba6ed104c2c9869ea0365bbe482 in term 0.
I20240502 01:59:39.775342 29040 raft_consensus.cc:504] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.776031 29040 leader_election.cc:288] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [CANDIDATE]: Term 1 election: Requested vote from peers 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629), a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917)
I20240502 01:59:39.776182 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86eb15ad9b1b4ee6ab734cdbb972d5d3" candidate_uuid: "82e8cba6ed104c2c9869ea0365bbe482" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88"
I20240502 01:59:39.776202 28401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86eb15ad9b1b4ee6ab734cdbb972d5d3" candidate_uuid: "82e8cba6ed104c2c9869ea0365bbe482" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1"
I20240502 01:59:39.776309 28265 raft_consensus.cc:3037] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.776307 28401 raft_consensus.cc:3037] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.776508 28533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86eb15ad9b1b4ee6ab734cdbb972d5d3" candidate_uuid: "82e8cba6ed104c2c9869ea0365bbe482" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb"
I20240502 01:59:39.776618 28533 raft_consensus.cc:3037] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.776644 27725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86eb15ad9b1b4ee6ab734cdbb972d5d3" candidate_uuid: "82e8cba6ed104c2c9869ea0365bbe482" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1" is_pre_election: true
I20240502 01:59:39.776805 27725 raft_consensus.cc:2454] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82e8cba6ed104c2c9869ea0365bbe482 in term 0.
I20240502 01:59:39.777248 28401 raft_consensus.cc:2454] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82e8cba6ed104c2c9869ea0365bbe482 in term 1.
I20240502 01:59:39.777248 28265 raft_consensus.cc:2454] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82e8cba6ed104c2c9869ea0365bbe482 in term 1.
I20240502 01:59:39.777316 27727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86eb15ad9b1b4ee6ab734cdbb972d5d3" candidate_uuid: "82e8cba6ed104c2c9869ea0365bbe482" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1"
I20240502 01:59:39.777417 27727 raft_consensus.cc:3037] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.777639 28533 raft_consensus.cc:2454] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82e8cba6ed104c2c9869ea0365bbe482 in term 1.
I20240502 01:59:39.777760 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86eb15ad9b1b4ee6ab734cdbb972d5d3" candidate_uuid: "82e8cba6ed104c2c9869ea0365bbe482" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:39.777869 27998 raft_consensus.cc:3037] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.777879 27862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86eb15ad9b1b4ee6ab734cdbb972d5d3" candidate_uuid: "82e8cba6ed104c2c9869ea0365bbe482" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98"
I20240502 01:59:39.778033 27862 raft_consensus.cc:3037] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:39.778048 28067 leader_election.cc:302] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, 82e8cba6ed104c2c9869ea0365bbe482, 8ed4b4242123404f86485ec57dc34e88; no voters:
I20240502 01:59:39.778472 27727 raft_consensus.cc:2454] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82e8cba6ed104c2c9869ea0365bbe482 in term 1.
I20240502 01:59:39.778590 29040 raft_consensus.cc:2781] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:39.778798 27998 raft_consensus.cc:2454] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82e8cba6ed104c2c9869ea0365bbe482 in term 1.
I20240502 01:59:39.778816 29040 raft_consensus.cc:686] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEADER]: Becoming Leader. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Running, Role: LEADER
I20240502 01:59:39.778923 27862 raft_consensus.cc:2454] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82e8cba6ed104c2c9869ea0365bbe482 in term 1.
I20240502 01:59:39.779130 29040 consensus_queue.cc:237] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:39.781834 27573 catalog_manager.cc:5484] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196). New cstate: current_term: 1 leader_uuid: "82e8cba6ed104c2c9869ea0365bbe482" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } }
W20240502 01:59:39.911828 29624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:39.912052 29624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:39.915072 29624 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_5'
I20240502 01:59:40.018514 27998 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.019625 27862 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.020381 29622 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.020802 29622 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.021445 28401 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.021559 28533 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.022032 28265 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.022081 28400 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.022359 28264 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.022432 29352 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.023012 29352 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.023782 29352 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.023948 27727 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.024523 28534 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.025074 28264 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.025578 29356 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.026163 27863 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.026803 27997 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.026909 28401 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.027256 29354 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.028048 28533 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.029700 29497 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.029945 29497 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.031706 29132 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.032119 28132 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.038460 28132 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.039222 27996 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.039920 29497 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.042309 29622 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.042424 27727 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.042565 29356 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.042698 29622 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.043085 29622 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.043387 29622 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.043606 29357 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.046114 29357 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
INSERT report
rows total: 2000
time total: 187.804 ms
time per row: 0.0939018 ms
I20240502 01:59:40.181071 27571 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55090:
name: "rebalance_test_table_6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 7
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20240502 01:59:40.181653 27571 catalog_manager.cc:6843] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table rebalance_test_table_6 in case of a server failure: 8 tablet servers would be needed, 7 are available. Consider bringing up more tablet servers.
I20240502 01:59:40.189467 28513 tablet_service.cc:1467] Processing CreateTablet for tablet dc925cbedd00454dbaa0e6b5e38b94d7 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.189776 28513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc925cbedd00454dbaa0e6b5e38b94d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.190289 27707 tablet_service.cc:1467] Processing CreateTablet for tablet dc925cbedd00454dbaa0e6b5e38b94d7 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.190595 27707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc925cbedd00454dbaa0e6b5e38b94d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.191404 28246 tablet_service.cc:1467] Processing CreateTablet for tablet dc925cbedd00454dbaa0e6b5e38b94d7 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.191699 28246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc925cbedd00454dbaa0e6b5e38b94d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.192286 28112 tablet_service.cc:1467] Processing CreateTablet for tablet dc925cbedd00454dbaa0e6b5e38b94d7 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.192548 28112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc925cbedd00454dbaa0e6b5e38b94d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.192965 29505 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:40.193835 29505 tablet_bootstrap.cc:654] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.193971 29513 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:40.194651 28381 tablet_service.cc:1467] Processing CreateTablet for tablet f7ccc60565e9447b8ab77927061813e5 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.194727 29504 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:40.194782 29513 tablet_bootstrap.cc:654] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.194981 28381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ccc60565e9447b8ab77927061813e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.195418 28380 tablet_service.cc:1467] Processing CreateTablet for tablet dc925cbedd00454dbaa0e6b5e38b94d7 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.195569 29504 tablet_bootstrap.cc:654] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.195672 28380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc925cbedd00454dbaa0e6b5e38b94d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.197131 29503 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
I20240502 01:59:40.197438 29516 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:40.197944 29503 tablet_bootstrap.cc:654] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.198292 29516 tablet_bootstrap.cc:654] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.201836 27977 tablet_service.cc:1467] Processing CreateTablet for tablet f7ccc60565e9447b8ab77927061813e5 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.201925 28112 tablet_service.cc:1467] Processing CreateTablet for tablet f7ccc60565e9447b8ab77927061813e5 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.202147 27977 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ccc60565e9447b8ab77927061813e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.202108 27841 tablet_service.cc:1467] Processing CreateTablet for tablet dc925cbedd00454dbaa0e6b5e38b94d7 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.202183 28112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ccc60565e9447b8ab77927061813e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.202353 27841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc925cbedd00454dbaa0e6b5e38b94d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.202551 27707 tablet_service.cc:1467] Processing CreateTablet for tablet f7ccc60565e9447b8ab77927061813e5 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.202773 27707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ccc60565e9447b8ab77927061813e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.204250 27708 tablet_service.cc:1467] Processing CreateTablet for tablet 916eed3f573b445e8ac1384f13139479 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.201836 27978 tablet_service.cc:1467] Processing CreateTablet for tablet dc925cbedd00454dbaa0e6b5e38b94d7 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.204504 27708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 916eed3f573b445e8ac1384f13139479. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.204561 27978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc925cbedd00454dbaa0e6b5e38b94d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.204667 27843 tablet_service.cc:1467] Processing CreateTablet for tablet f7ccc60565e9447b8ab77927061813e5 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.204910 27843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ccc60565e9447b8ab77927061813e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.204871 28246 tablet_service.cc:1467] Processing CreateTablet for tablet f7ccc60565e9447b8ab77927061813e5 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.205102 28246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ccc60565e9447b8ab77927061813e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.206513 29507 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
I20240502 01:59:40.206825 29506 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
I20240502 01:59:40.207259 29507 tablet_bootstrap.cc:654] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.207470 28513 tablet_service.cc:1467] Processing CreateTablet for tablet f7ccc60565e9447b8ab77927061813e5 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.207612 29506 tablet_bootstrap.cc:654] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.207737 28513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ccc60565e9447b8ab77927061813e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.210377 29504 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:40.210464 29504 ts_tablet_manager.cc:1367] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20240502 01:59:40.210942 29504 raft_consensus.cc:348] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.211056 29504 raft_consensus.cc:374] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.211091 29504 raft_consensus.cc:729] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.211210 28246 tablet_service.cc:1467] Processing CreateTablet for tablet 916eed3f573b445e8ac1384f13139479 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.211207 29504 consensus_queue.cc:260] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.211464 28246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 916eed3f573b445e8ac1384f13139479. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.211526 29504 ts_tablet_manager.cc:1398] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:40.211918 29504 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:40.212049 27978 tablet_service.cc:1467] Processing CreateTablet for tablet 916eed3f573b445e8ac1384f13139479 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.212285 27978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 916eed3f573b445e8ac1384f13139479. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.212786 29504 tablet_bootstrap.cc:654] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.213335 27843 tablet_service.cc:1467] Processing CreateTablet for tablet 916eed3f573b445e8ac1384f13139479 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.213562 27843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 916eed3f573b445e8ac1384f13139479. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.214102 28112 tablet_service.cc:1467] Processing CreateTablet for tablet 916eed3f573b445e8ac1384f13139479 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.214180 29504 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:40.214249 29504 ts_tablet_manager.cc:1367] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:40.214354 28112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 916eed3f573b445e8ac1384f13139479. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.214697 29504 raft_consensus.cc:348] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:40.214804 29504 raft_consensus.cc:374] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.214833 29504 raft_consensus.cc:729] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.214938 29504 consensus_queue.cc:260] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:40.215444 29504 ts_tablet_manager.cc:1398] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:40.216751 28380 tablet_service.cc:1467] Processing CreateTablet for tablet 916eed3f573b445e8ac1384f13139479 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.217027 28380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 916eed3f573b445e8ac1384f13139479. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.216996 28513 tablet_service.cc:1467] Processing CreateTablet for tablet 916eed3f573b445e8ac1384f13139479 (DEFAULT_TABLE table=rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20240502 01:59:40.217198 28513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 916eed3f573b445e8ac1384f13139479. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:40.217198 29505 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:40.217294 29505 ts_tablet_manager.cc:1367] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.001s
I20240502 01:59:40.217682 29505 raft_consensus.cc:348] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.217803 29505 raft_consensus.cc:374] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.217851 29505 raft_consensus.cc:729] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.217965 29505 consensus_queue.cc:260] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.218304 29505 ts_tablet_manager.cc:1398] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:40.219275 29505 tablet_bootstrap.cc:492] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:40.219724 29504 tablet_bootstrap.cc:492] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb: Bootstrap starting.
I20240502 01:59:40.220221 29505 tablet_bootstrap.cc:654] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.220727 29504 tablet_bootstrap.cc:654] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.221757 29504 tablet_bootstrap.cc:492] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb: No bootstrap required, opened a new log
I20240502 01:59:40.221776 29505 tablet_bootstrap.cc:492] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:40.221859 29504 ts_tablet_manager.cc:1367] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:40.221999 29505 ts_tablet_manager.cc:1367] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:59:40.222326 29504 raft_consensus.cc:348] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.222445 29504 raft_consensus.cc:374] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.222476 29504 raft_consensus.cc:729] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.222653 29516 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:40.222591 29504 consensus_queue.cc:260] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.222741 29516 ts_tablet_manager.cc:1367] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
I20240502 01:59:40.222838 29503 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:40.222904 29504 ts_tablet_manager.cc:1398] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:40.222945 29503 ts_tablet_manager.cc:1367] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20240502 01:59:40.223250 29507 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:40.223179 29516 raft_consensus.cc:348] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.223299 29516 raft_consensus.cc:374] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.223331 29516 raft_consensus.cc:729] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.223336 29507 ts_tablet_manager.cc:1367] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20240502 01:59:40.223445 29516 consensus_queue.cc:260] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.223433 29503 raft_consensus.cc:348] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:40.223551 29503 raft_consensus.cc:374] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.223583 29503 raft_consensus.cc:729] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.223754 29516 ts_tablet_manager.cc:1398] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:40.223703 29503 consensus_queue.cc:260] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:40.223789 29507 raft_consensus.cc:348] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:40.223904 29507 raft_consensus.cc:374] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.223927 29516 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:40.223937 29507 raft_consensus.cc:729] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.223973 29506 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:40.224018 29503 ts_tablet_manager.cc:1398] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:40.224048 29506 ts_tablet_manager.cc:1367] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20240502 01:59:40.224064 29507 consensus_queue.cc:260] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:40.224184 29503 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
I20240502 01:59:40.224339 29507 ts_tablet_manager.cc:1398] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:40.224498 29507 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
I20240502 01:59:40.224473 29506 raft_consensus.cc:348] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.224591 29506 raft_consensus.cc:374] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.224624 29506 raft_consensus.cc:729] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.224799 29516 tablet_bootstrap.cc:654] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.224753 29506 consensus_queue.cc:260] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.225039 29503 tablet_bootstrap.cc:654] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.225082 29506 ts_tablet_manager.cc:1398] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:40.225256 29506 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
I20240502 01:59:40.225399 29507 tablet_bootstrap.cc:654] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.226585 29513 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:40.226672 29513 ts_tablet_manager.cc:1367] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.000s
I20240502 01:59:40.227003 29505 raft_consensus.cc:348] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.227159 29505 raft_consensus.cc:374] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.227097 29513 raft_consensus.cc:348] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.227217 29513 raft_consensus.cc:374] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.227226 29505 raft_consensus.cc:729] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.227273 29513 raft_consensus.cc:729] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.227403 29513 consensus_queue.cc:260] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.227414 29505 consensus_queue.cc:260] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.227689 29513 ts_tablet_manager.cc:1398] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:40.227800 29505 ts_tablet_manager.cc:1398] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20240502 01:59:40.227875 29513 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:40.227977 29505 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:40.228552 29513 tablet_bootstrap.cc:654] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.228896 29505 tablet_bootstrap.cc:654] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.229944 29505 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1: No bootstrap required, opened a new log
I20240502 01:59:40.230237 29505 ts_tablet_manager.cc:1367] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20240502 01:59:40.230268 29507 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:40.230350 29507 ts_tablet_manager.cc:1367] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240502 01:59:40.230677 29505 raft_consensus.cc:348] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:40.230803 29505 raft_consensus.cc:374] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.230834 29505 raft_consensus.cc:729] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.230793 29507 raft_consensus.cc:348] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.230906 29507 raft_consensus.cc:374] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.230938 29507 raft_consensus.cc:729] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.231060 29507 consensus_queue.cc:260] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.231381 29507 ts_tablet_manager.cc:1398] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:40.231573 29507 tablet_bootstrap.cc:492] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f: Bootstrap starting.
I20240502 01:59:40.230993 29505 consensus_queue.cc:260] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:40.231664 29506 tablet_bootstrap.cc:654] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.232106 29505 ts_tablet_manager.cc:1398] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20240502 01:59:40.232442 29507 tablet_bootstrap.cc:654] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.233510 29513 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:40.233577 29513 ts_tablet_manager.cc:1367] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20240502 01:59:40.233947 29513 raft_consensus.cc:348] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:40.234102 29513 raft_consensus.cc:374] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.234138 29513 raft_consensus.cc:729] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.234269 29513 consensus_queue.cc:260] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:40.234476 29516 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:40.234565 29513 ts_tablet_manager.cc:1398] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:40.234575 29516 ts_tablet_manager.cc:1367] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20240502 01:59:40.234663 29503 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:40.234735 29513 tablet_bootstrap.cc:492] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:40.234789 29503 ts_tablet_manager.cc:1367] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20240502 01:59:40.235023 29516 raft_consensus.cc:348] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:40.235188 29516 raft_consensus.cc:374] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.235244 29516 raft_consensus.cc:729] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.235338 29503 raft_consensus.cc:348] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.235357 29516 consensus_queue.cc:260] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:40.235499 29503 raft_consensus.cc:374] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.235564 29503 raft_consensus.cc:729] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.235602 29513 tablet_bootstrap.cc:654] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.235673 29516 ts_tablet_manager.cc:1398] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:40.235759 29503 consensus_queue.cc:260] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.235852 29516 tablet_bootstrap.cc:492] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:40.236092 29503 ts_tablet_manager.cc:1398] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:40.236304 29503 tablet_bootstrap.cc:492] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1: Bootstrap starting.
I20240502 01:59:40.236725 29516 tablet_bootstrap.cc:654] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.237520 29503 tablet_bootstrap.cc:654] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.237783 29513 tablet_bootstrap.cc:492] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88: No bootstrap required, opened a new log
I20240502 01:59:40.237895 29513 ts_tablet_manager.cc:1367] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:59:40.238826 29506 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:40.238911 29506 ts_tablet_manager.cc:1367] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20240502 01:59:40.239065 29513 raft_consensus.cc:348] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.239192 29513 raft_consensus.cc:374] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.239226 29513 raft_consensus.cc:729] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.239329 29513 consensus_queue.cc:260] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.239390 29506 raft_consensus.cc:348] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:40.239493 29506 raft_consensus.cc:374] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.239533 29506 raft_consensus.cc:729] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.239657 29513 ts_tablet_manager.cc:1398] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:40.239671 29506 consensus_queue.cc:260] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:40.239960 29506 ts_tablet_manager.cc:1398] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:40.240125 29506 tablet_bootstrap.cc:492] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98: Bootstrap starting.
I20240502 01:59:40.240703 29507 tablet_bootstrap.cc:492] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f: No bootstrap required, opened a new log
I20240502 01:59:40.240792 29507 ts_tablet_manager.cc:1367] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20240502 01:59:40.241039 29506 tablet_bootstrap.cc:654] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98: Neither blocks nor log segments found. Creating new log.
I20240502 01:59:40.241248 29507 raft_consensus.cc:348] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.241364 29507 raft_consensus.cc:374] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.241413 29507 raft_consensus.cc:729] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.241544 29507 consensus_queue.cc:260] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.241858 29507 ts_tablet_manager.cc:1398] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:40.243517 29516 tablet_bootstrap.cc:492] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482: No bootstrap required, opened a new log
I20240502 01:59:40.243618 29516 ts_tablet_manager.cc:1367] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20240502 01:59:40.244031 29516 raft_consensus.cc:348] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.244155 29503 tablet_bootstrap.cc:492] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1: No bootstrap required, opened a new log
I20240502 01:59:40.244163 29516 raft_consensus.cc:374] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.244199 29516 raft_consensus.cc:729] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.244232 29503 ts_tablet_manager.cc:1367] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20240502 01:59:40.244638 29506 tablet_bootstrap.cc:492] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98: No bootstrap required, opened a new log
I20240502 01:59:40.244712 29506 ts_tablet_manager.cc:1367] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20240502 01:59:40.244665 29503 raft_consensus.cc:348] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.244794 29503 raft_consensus.cc:374] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.244827 29503 raft_consensus.cc:729] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12f527e76eff4669924a898d5029e3d1, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.244969 29503 consensus_queue.cc:260] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.245123 29506 raft_consensus.cc:348] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.245227 29506 raft_consensus.cc:374] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 01:59:40.245252 29506 raft_consensus.cc:729] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8c1908b1c554e7cbbb9bf9751b8ee98, State: Initialized, Role: FOLLOWER
I20240502 01:59:40.245272 29503 ts_tablet_manager.cc:1398] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:40.245369 29506 consensus_queue.cc:260] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.245654 29506 ts_tablet_manager.cc:1398] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:40.245817 29516 consensus_queue.cc:260] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.246593 29516 ts_tablet_manager.cc:1398] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:59:40.254336 29665 raft_consensus.cc:482] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:40.254426 29665 raft_consensus.cc:504] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.255818 29665 leader_election.cc:288] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:40.263383 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc925cbedd00454dbaa0e6b5e38b94d7" candidate_uuid: "86e11777d9d744d0a5a8139c99e89f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:40.263509 28132 raft_consensus.cc:2454] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e11777d9d744d0a5a8139c99e89f4f in term 0.
I20240502 01:59:40.265029 27725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc925cbedd00454dbaa0e6b5e38b94d7" candidate_uuid: "86e11777d9d744d0a5a8139c99e89f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1" is_pre_election: true
I20240502 01:59:40.265033 29497 raft_consensus.cc:482] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:40.265183 27725 raft_consensus.cc:2454] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e11777d9d744d0a5a8139c99e89f4f in term 0.
I20240502 01:59:40.265398 27862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc925cbedd00454dbaa0e6b5e38b94d7" candidate_uuid: "86e11777d9d744d0a5a8139c99e89f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" is_pre_election: true
I20240502 01:59:40.265480 28533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc925cbedd00454dbaa0e6b5e38b94d7" candidate_uuid: "86e11777d9d744d0a5a8139c99e89f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb" is_pre_election: true
I20240502 01:59:40.265515 27862 raft_consensus.cc:2454] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e11777d9d744d0a5a8139c99e89f4f in term 0.
I20240502 01:59:40.265632 28533 raft_consensus.cc:2454] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e11777d9d744d0a5a8139c99e89f4f in term 0.
I20240502 01:59:40.265995 27933 leader_election.cc:302] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 257826b7ad7e4abb8499b6687e8c83eb, 82e8cba6ed104c2c9869ea0365bbe482, 86e11777d9d744d0a5a8139c99e89f4f, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:40.265189 29497 raft_consensus.cc:504] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:40.266505 29665 raft_consensus.cc:2781] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:40.266566 29665 raft_consensus.cc:482] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:40.266602 29665 raft_consensus.cc:3037] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.266739 29497 leader_election.cc:288] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629), a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917)
I20240502 01:59:40.266852 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ccc60565e9447b8ab77927061813e5" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:40.266963 28132 raft_consensus.cc:2454] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:40.267352 28264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ccc60565e9447b8ab77927061813e5" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88" is_pre_election: true
I20240502 01:59:40.267472 28401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ccc60565e9447b8ab77927061813e5" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:40.267509 28264 raft_consensus.cc:2454] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:40.267594 28401 raft_consensus.cc:2454] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:40.267688 29665 raft_consensus.cc:504] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.267925 27661 leader_election.cc:302] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 82e8cba6ed104c2c9869ea0365bbe482, 8ed4b4242123404f86485ec57dc34e88, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:40.268187 28533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ccc60565e9447b8ab77927061813e5" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb" is_pre_election: true
I20240502 01:59:40.268311 28533 raft_consensus.cc:2454] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:40.268970 29497 raft_consensus.cc:2781] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:40.269028 29497 raft_consensus.cc:482] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:40.269068 29497 raft_consensus.cc:3037] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.270180 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ccc60565e9447b8ab77927061813e5" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:40.270213 29497 raft_consensus.cc:504] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:40.270323 27998 raft_consensus.cc:2454] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:40.271119 28401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ccc60565e9447b8ab77927061813e5" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1"
I20240502 01:59:40.271239 28401 raft_consensus.cc:3037] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.271298 29665 leader_election.cc:288] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [CANDIDATE]: Term 1 election: Requested vote from peers da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:40.271847 27862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ccc60565e9447b8ab77927061813e5" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" is_pre_election: true
I20240502 01:59:40.271998 27862 raft_consensus.cc:2454] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 0.
I20240502 01:59:40.272270 28401 raft_consensus.cc:2454] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:40.272557 28535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc925cbedd00454dbaa0e6b5e38b94d7" candidate_uuid: "86e11777d9d744d0a5a8139c99e89f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb"
I20240502 01:59:40.272665 28535 raft_consensus.cc:3037] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.272795 28132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc925cbedd00454dbaa0e6b5e38b94d7" candidate_uuid: "86e11777d9d744d0a5a8139c99e89f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
I20240502 01:59:40.273803 28535 raft_consensus.cc:2454] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e11777d9d744d0a5a8139c99e89f4f in term 1.
I20240502 01:59:40.273828 28132 raft_consensus.cc:3037] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.274358 27862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc925cbedd00454dbaa0e6b5e38b94d7" candidate_uuid: "86e11777d9d744d0a5a8139c99e89f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98"
I20240502 01:59:40.274484 27862 raft_consensus.cc:3037] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.274542 28130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ccc60565e9447b8ab77927061813e5" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
I20240502 01:59:40.274636 28130 raft_consensus.cc:3037] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.274962 28132 raft_consensus.cc:2454] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e11777d9d744d0a5a8139c99e89f4f in term 1.
I20240502 01:59:40.275609 27862 raft_consensus.cc:2454] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e11777d9d744d0a5a8139c99e89f4f in term 1.
I20240502 01:59:40.275780 28264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ccc60565e9447b8ab77927061813e5" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88"
I20240502 01:59:40.275919 28264 raft_consensus.cc:3037] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.276891 28264 raft_consensus.cc:2454] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:40.277164 27725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc925cbedd00454dbaa0e6b5e38b94d7" candidate_uuid: "86e11777d9d744d0a5a8139c99e89f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1"
I20240502 01:59:40.277290 27725 raft_consensus.cc:3037] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.277590 27930 leader_election.cc:302] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 257826b7ad7e4abb8499b6687e8c83eb, 82e8cba6ed104c2c9869ea0365bbe482, 86e11777d9d744d0a5a8139c99e89f4f, a8c1908b1c554e7cbbb9bf9751b8ee98; no voters:
I20240502 01:59:40.277784 29665 raft_consensus.cc:2781] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:40.277884 29665 raft_consensus.cc:686] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 LEADER]: Becoming Leader. State: Replica: 86e11777d9d744d0a5a8139c99e89f4f, State: Running, Role: LEADER
I20240502 01:59:40.278280 29665 consensus_queue.cc:237] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.278712 27725 raft_consensus.cc:2454] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e11777d9d744d0a5a8139c99e89f4f in term 1.
I20240502 01:59:40.279253 28533 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ccc60565e9447b8ab77927061813e5" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "257826b7ad7e4abb8499b6687e8c83eb"
I20240502 01:59:40.279369 28533 raft_consensus.cc:3037] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.280373 28533 raft_consensus.cc:2454] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:40.281384 27661 leader_election.cc:302] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, 8ed4b4242123404f86485ec57dc34e88, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:40.281672 29659 raft_consensus.cc:2781] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:40.281766 29659 raft_consensus.cc:686] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Becoming Leader. State: Replica: da58b5341d344efd833502f214e69ff1, State: Running, Role: LEADER
I20240502 01:59:40.281975 29659 consensus_queue.cc:237] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:40.282256 28130 raft_consensus.cc:2454] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:40.282244 27571 catalog_manager.cc:5484] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f reported cstate change: term changed from 0 to 1, leader changed from <none> to 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195). New cstate: current_term: 1 leader_uuid: "86e11777d9d744d0a5a8139c99e89f4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:40.282681 29497 leader_election.cc:288] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [CANDIDATE]: Term 1 election: Requested vote from peers 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629), a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917)
I20240502 01:59:40.283632 27862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ccc60565e9447b8ab77927061813e5" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98"
I20240502 01:59:40.283756 27862 raft_consensus.cc:3037] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.283960 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ccc60565e9447b8ab77927061813e5" candidate_uuid: "da58b5341d344efd833502f214e69ff1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:40.284056 27998 raft_consensus.cc:3037] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.284734 27862 raft_consensus.cc:2454] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:40.284720 28264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc925cbedd00454dbaa0e6b5e38b94d7" candidate_uuid: "86e11777d9d744d0a5a8139c99e89f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88" is_pre_election: true
I20240502 01:59:40.284744 28265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc925cbedd00454dbaa0e6b5e38b94d7" candidate_uuid: "86e11777d9d744d0a5a8139c99e89f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88"
I20240502 01:59:40.284852 28264 raft_consensus.cc:2454] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86e11777d9d744d0a5a8139c99e89f4f in term 0.
I20240502 01:59:40.285022 27998 raft_consensus.cc:2454] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da58b5341d344efd833502f214e69ff1 in term 1.
I20240502 01:59:40.285547 28400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc925cbedd00454dbaa0e6b5e38b94d7" candidate_uuid: "86e11777d9d744d0a5a8139c99e89f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1"
I20240502 01:59:40.285674 28400 raft_consensus.cc:3037] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.286298 27575 catalog_manager.cc:5484] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 reported cstate change: term changed from 0 to 1, leader changed from <none> to da58b5341d344efd833502f214e69ff1 (127.10.133.193). New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:40.286449 28401 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc925cbedd00454dbaa0e6b5e38b94d7" candidate_uuid: "86e11777d9d744d0a5a8139c99e89f4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:40.286761 28400 raft_consensus.cc:2454] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86e11777d9d744d0a5a8139c99e89f4f in term 1.
I20240502 01:59:40.339013 29122 raft_consensus.cc:482] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20240502 01:59:40.339134 29122 raft_consensus.cc:504] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.339913 29122 leader_election.cc:288] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553)
I20240502 01:59:40.340088 27862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "916eed3f573b445e8ac1384f13139479" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" is_pre_election: true
I20240502 01:59:40.340088 27725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "916eed3f573b445e8ac1384f13139479" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1" is_pre_election: true
I20240502 01:59:40.340222 27725 raft_consensus.cc:2454] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:40.340221 27862 raft_consensus.cc:2454] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:40.340276 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "916eed3f573b445e8ac1384f13139479" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f" is_pre_election: true
I20240502 01:59:40.340430 27998 raft_consensus.cc:2454] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:40.340636 28400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "916eed3f573b445e8ac1384f13139479" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1" is_pre_election: true
I20240502 01:59:40.340778 28400 raft_consensus.cc:2454] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:40.340898 28469 leader_election.cc:302] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 257826b7ad7e4abb8499b6687e8c83eb, 86e11777d9d744d0a5a8139c99e89f4f, a8c1908b1c554e7cbbb9bf9751b8ee98, da58b5341d344efd833502f214e69ff1; no voters:
I20240502 01:59:40.341090 29122 raft_consensus.cc:2781] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20240502 01:59:40.341141 29122 raft_consensus.cc:482] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20240502 01:59:40.341193 29122 raft_consensus.cc:3037] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.341199 28264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "916eed3f573b445e8ac1384f13139479" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88" is_pre_election: true
I20240502 01:59:40.341333 28264 raft_consensus.cc:2454] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:40.341307 28130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "916eed3f573b445e8ac1384f13139479" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482" is_pre_election: true
I20240502 01:59:40.341462 28130 raft_consensus.cc:2454] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 0.
I20240502 01:59:40.342325 29122 raft_consensus.cc:504] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.342962 27862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "916eed3f573b445e8ac1384f13139479" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98"
I20240502 01:59:40.343011 27725 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "916eed3f573b445e8ac1384f13139479" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da58b5341d344efd833502f214e69ff1"
I20240502 01:59:40.343086 27862 raft_consensus.cc:3037] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.343104 27725 raft_consensus.cc:3037] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.343093 29122 leader_election.cc:288] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 election: Requested vote from peers a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731), da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835), 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917), 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921), 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567), 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553)
I20240502 01:59:40.343122 27998 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "916eed3f573b445e8ac1384f13139479" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86e11777d9d744d0a5a8139c99e89f4f"
I20240502 01:59:40.343246 27998 raft_consensus.cc:3037] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.343451 28400 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "916eed3f573b445e8ac1384f13139479" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12f527e76eff4669924a898d5029e3d1"
I20240502 01:59:40.343545 28400 raft_consensus.cc:3037] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.344017 27725 raft_consensus.cc:2454] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:40.344017 27862 raft_consensus.cc:2454] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:40.344244 27998 raft_consensus.cc:2454] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:40.344348 28264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "916eed3f573b445e8ac1384f13139479" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ed4b4242123404f86485ec57dc34e88"
I20240502 01:59:40.344466 28264 raft_consensus.cc:3037] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.344460 28400 raft_consensus.cc:2454] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:40.344907 28468 leader_election.cc:302] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 7 voters: 4 yes votes; 0 no votes. yes voters: 12f527e76eff4669924a898d5029e3d1, 257826b7ad7e4abb8499b6687e8c83eb, 86e11777d9d744d0a5a8139c99e89f4f, a8c1908b1c554e7cbbb9bf9751b8ee98; no voters:
I20240502 01:59:40.345109 29122 raft_consensus.cc:2781] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Leader election won for term 1
I20240502 01:59:40.345114 28130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "916eed3f573b445e8ac1384f13139479" candidate_uuid: "257826b7ad7e4abb8499b6687e8c83eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e8cba6ed104c2c9869ea0365bbe482"
I20240502 01:59:40.345248 28130 raft_consensus.cc:3037] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.345407 29122 raft_consensus.cc:686] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Becoming Leader. State: Replica: 257826b7ad7e4abb8499b6687e8c83eb, State: Running, Role: LEADER
I20240502 01:59:40.345471 28264 raft_consensus.cc:2454] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:40.345795 29122 consensus_queue.cc:237] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:40.346226 28130 raft_consensus.cc:2454] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 257826b7ad7e4abb8499b6687e8c83eb in term 1.
I20240502 01:59:40.348242 27575 catalog_manager.cc:5484] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: term changed from 0 to 1, leader changed from <none> to 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199). New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } }
W20240502 01:59:40.475622 29723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:40.475906 29723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:40.479481 29723 flags.cc:425] Enabled experimental flag: --enable_multi_tenancy=false
Using table 'rebalance_test_table_6'
I20240502 01:59:40.568100 28264 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.568670 28130 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.568924 28533 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.569131 29482 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.569108 29665 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.569200 27725 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.569693 29665 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.569841 29045 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.571008 28400 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.571362 27862 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.572821 29045 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.573112 29045 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.576578 28264 raft_consensus.cc:3037] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 0 FOLLOWER]: Advancing to term 1
I20240502 01:59:40.577661 28264 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.578521 29665 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.586833 27998 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.587237 28400 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.587291 27863 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.587786 29762 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.588181 29482 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.588348 29762 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.588533 27727 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.588912 28132 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.588963 29482 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.589461 29482 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.625959 27997 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.626708 29659 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.633121 27862 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.633718 28264 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.633754 28130 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.633791 28400 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.634308 29657 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.634452 29659 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.634549 28533 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20240502 01:59:40.634560 29497 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.634984 29657 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.638574 29657 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20240502 01:59:40.700927 29367 mvcc.cc:205] Tried to move back new op lower bound from 7023063779831128064 to 7023063778438311936. Current Snapshot: MvccSnapshot[applied={T|T < 7023063779831128064}]
INSERT report
rows total: 2000
time total: 233.824 ms
time per row: 0.116912 ms
I20240502 01:59:40.757608 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.200:45585
--local_ip_for_outbound_sockets=127.10.133.200
--tserver_master_addrs=127.10.133.254:40911
--webserver_port=35349
--webserver_interface=127.10.133.200
--builtin_ntp_servers=127.10.133.212:44201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20240502 01:59:40.870440 29795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:40.870651 29795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:40.870693 29795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:40.873764 29795 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:40.873822 29795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:40.873888 29795 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.200
I20240502 01:59:40.877669 29795 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:44201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.200:45585
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/info.pb
--webserver_interface=127.10.133.200
--webserver_port=35349
--tserver_master_addrs=127.10.133.254:40911
--never_fsync=true
--heap_profile_path=/tmp/kudu.29795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.200
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:40.878554 29795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:40.879702 29795 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:40.888564 29803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:40.889251 29800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:40.889777 29801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:40.890630 29795 server_base.cc:1034] running on GCE node
I20240502 01:59:40.891005 29795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:40.891580 29795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:40.892733 29795 hybrid_clock.cc:648] HybridClock initialized: now 1714615180892715 us; error 31 us; skew 500 ppm
I20240502 01:59:40.894677 29795 webserver.cc:460] Webserver started at http://127.10.133.200:35349/ using document root <none> and password file <none>
I20240502 01:59:40.895220 29795 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:40.895298 29795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:40.899000 29795 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.004s
I20240502 01:59:40.901059 29809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:40.902048 29795 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20240502 01:59:40.902156 29795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
uuid: "0003837e2d88424093594ed169d82cd2"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:40.902621 29795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:40.927475 29795 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:40.928085 29795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:40.928233 29795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:40.928752 29795 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:40.929694 29795 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:40.929742 29795 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:40.929800 29795 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:40.929826 29795 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:40.940793 29795 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.200:45585
I20240502 01:59:40.941892 29924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.200:45585 every 8 connection(s)
I20240502 01:59:40.942220 29795 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/data/info.pb
I20240502 01:59:40.943588 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 29795
I20240502 01:59:40.944082 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.201:40597
--local_ip_for_outbound_sockets=127.10.133.201
--tserver_master_addrs=127.10.133.254:40911
--webserver_port=46711
--webserver_interface=127.10.133.201
--builtin_ntp_servers=127.10.133.212:44201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:59:40.953023 29925 heartbeater.cc:347] Connected to a master server at 127.10.133.254:40911
I20240502 01:59:40.953243 29925 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:40.953758 29925 heartbeater.cc:511] Master 127.10.133.254:40911 requested a full tablet report, sending...
I20240502 01:59:40.955022 27570 ts_manager.cc:194] Re-registered known tserver with Master: 0003837e2d88424093594ed169d82cd2 (127.10.133.200:45585)
I20240502 01:59:40.955886 27570 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.200:56549
W20240502 01:59:41.063750 29928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:41.063969 29928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:41.064013 29928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:41.067220 29928 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:41.067289 29928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:41.067356 29928 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.201
I20240502 01:59:41.071146 29928 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:44201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.201:40597
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data/info.pb
--webserver_interface=127.10.133.201
--webserver_port=46711
--tserver_master_addrs=127.10.133.254:40911
--never_fsync=true
--heap_profile_path=/tmp/kudu.29928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.201
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:41.071988 29928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:41.073258 29928 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:41.082195 29934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:41.082743 29933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:41.083333 29936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:41.084113 29928 server_base.cc:1034] running on GCE node
I20240502 01:59:41.084575 29928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:41.085165 29928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:41.086328 29928 hybrid_clock.cc:648] HybridClock initialized: now 1714615181086290 us; error 39 us; skew 500 ppm
I20240502 01:59:41.088502 29928 webserver.cc:460] Webserver started at http://127.10.133.201:46711/ using document root <none> and password file <none>
I20240502 01:59:41.089044 29928 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:41.089164 29928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:41.093012 29928 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20240502 01:59:41.095350 29942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:41.096539 29928 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240502 01:59:41.096711 29928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal
uuid: "7332064716f04e84ba81c1f2b70821f9"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:41.097260 29928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:41.134027 29928 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:41.134752 29928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:41.134912 29928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:41.135485 29928 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:41.136498 29928 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:41.136554 29928 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:41.136607 29928 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:41.136636 29928 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:41.160873 29928 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.201:40597
I20240502 01:59:41.160930 30056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.201:40597 every 8 connection(s)
I20240502 01:59:41.162159 29928 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/data/info.pb
I20240502 01:59:41.171686 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 29928
I20240502 01:59:41.172166 10775 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
/tmp/dist-test-taskVdqkLT/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/wal
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/logs
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.133.202:45645
--local_ip_for_outbound_sockets=127.10.133.202
--tserver_master_addrs=127.10.133.254:40911
--webserver_port=33215
--webserver_interface=127.10.133.202
--builtin_ntp_servers=127.10.133.212:44201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20240502 01:59:41.173599 30058 heartbeater.cc:347] Connected to a master server at 127.10.133.254:40911
I20240502 01:59:41.173807 30058 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:41.174418 30058 heartbeater.cc:511] Master 127.10.133.254:40911 requested a full tablet report, sending...
I20240502 01:59:41.175590 27570 ts_manager.cc:194] Re-registered known tserver with Master: 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201:40597)
I20240502 01:59:41.176416 27570 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.201:43839
W20240502 01:59:41.292265 30061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 01:59:41.292493 30061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 01:59:41.292543 30061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 01:59:41.295986 30061 flags.cc:425] Enabled experimental flag: --raft_prepare_replacement_before_eviction=true
W20240502 01:59:41.296052 30061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 01:59:41.296145 30061 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.133.202
I20240502 01:59:41.299973 30061 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.133.212:44201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/data
--fs_wal_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.133.202:45645
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/data/info.pb
--webserver_interface=127.10.133.202
--webserver_port=33215
--tserver_master_addrs=127.10.133.254:40911
--never_fsync=true
--heap_profile_path=/tmp/kudu.30061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.133.202
--log_dir=/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 0d95304fa46ee5d96bcaa934c7660369f2860e06
build type DEBUG
built by None at 02 May 2024 01:43:14 UTC on 1a15035a6830
build id 81
I20240502 01:59:41.300834 30061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 01:59:41.301951 30061 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 01:59:41.310700 30068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:41.311380 30071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 01:59:41.311985 30069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 01:59:41.312626 30061 server_base.cc:1034] running on GCE node
I20240502 01:59:41.312969 30061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 01:59:41.313469 30061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 01:59:41.314616 30061 hybrid_clock.cc:648] HybridClock initialized: now 1714615181314601 us; error 31 us; skew 500 ppm
I20240502 01:59:41.316483 30061 webserver.cc:460] Webserver started at http://127.10.133.202:33215/ using document root <none> and password file <none>
I20240502 01:59:41.317073 30061 fs_manager.cc:359] Metadata directory not provided
I20240502 01:59:41.317152 30061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 01:59:41.320497 30061 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:41.322364 30077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:41.323300 30061 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:41.323402 30061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/data,/tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/wal
uuid: "845294d663994245b540c006dca93b7d"
format_stamp: "Formatted at 2024-05-02 01:59:32 on dist-test-slave-dr9f"
I20240502 01:59:41.323783 30061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/wal
metadata directory: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/wal
1 data directories: /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 01:59:41.338397 30061 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 01:59:41.338958 30061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 01:59:41.339103 30061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 01:59:41.339615 30061 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 01:59:41.340451 30061 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 01:59:41.340497 30061 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:41.340554 30061 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 01:59:41.340580 30061 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 01:59:41.349478 30061 rpc_server.cc:307] RPC server started. Bound to: 127.10.133.202:45645
I20240502 01:59:41.349505 30191 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.133.202:45645 every 8 connection(s)
I20240502 01:59:41.350559 30061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/data/info.pb
I20240502 01:59:41.358520 10775 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVdqkLT/build/debug/bin/kudu as pid 30061
I20240502 01:59:41.359015 30192 heartbeater.cc:347] Connected to a master server at 127.10.133.254:40911
I20240502 01:59:41.359215 30192 heartbeater.cc:464] Registering TS with master...
I20240502 01:59:41.359784 30192 heartbeater.cc:511] Master 127.10.133.254:40911 requested a full tablet report, sending...
I20240502 01:59:41.361058 27570 ts_manager.cc:194] Re-registered known tserver with Master: 845294d663994245b540c006dca93b7d (127.10.133.202:45645)
I20240502 01:59:41.361699 27570 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.133.202:38651
I20240502 01:59:41.577251 29852 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:41.587846 29987 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:41.592108 28380 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:59:41.601655 27978 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:41.601863 27843 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:41.602597 30124 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:41.606047 28513 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:59:41.614972 27707 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:41.625885 28246 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:59:41.632575 28112 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:41.753942 29852 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:41.755677 28380 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:59:41.765933 28112 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:41.770722 27978 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:41.776563 28246 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:59:41.777751 29987 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:41.780650 30124 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:41.792584 27843 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:41.805040 27707 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:41.821050 28513 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:59:41.939251 28513 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:59:41.942253 28380 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:59:41.943446 29987 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:41.956575 30124 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:41.957643 28112 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:41.957880 29925 heartbeater.cc:503] Master 127.10.133.254:40911 was elected leader, sending a full tablet report...
I20240502 01:59:41.968402 29852 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:41.969349 27843 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:41.969553 28246 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:59:41.999490 27978 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:42.001241 27707 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:42.039788 28533 consensus_queue.cc:237] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:42.041445 28264 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.041780 28130 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.041954 28401 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.042047 27727 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.042331 30343 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.042631 27862 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.042657 27997 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.042656 30345 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.043103 30062 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.043305 30345 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.043501 30346 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.043766 30343 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.046526 30062 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.047011 28264 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.047147 27727 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.047488 27997 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.049490 28401 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.050896 27572 catalog_manager.cc:5484] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.051710 27863 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.052708 28130 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.062496 28533 consensus_queue.cc:237] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:42.064622 27727 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.064805 28401 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.064828 27863 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.065342 30062 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.065687 27997 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.065802 30346 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.066185 30346 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.066323 28130 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.067186 30344 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.068233 28264 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.068264 30355 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.068560 30355 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.069284 30344 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.069415 27997 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.072146 28264 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.072278 27579 catalog_manager.cc:5484] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f reported cstate change: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.072872 27863 consensus_queue.cc:237] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:42.073208 27565 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 916eed3f573b445e8ac1384f13139479 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:42.073962 28401 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.075122 28400 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.075294 27997 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.076438 30368 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20240502 01:59:42.076939 28467 consensus_peers.cc:485] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb -> Peer 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201:40597): Couldn't send request to peer 7332064716f04e84ba81c1f2b70821f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 916eed3f573b445e8ac1384f13139479. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:42.077092 30369 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.077471 28130 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.078437 28533 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.078478 27727 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.078729 29355 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.079828 29355 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.080926 27863 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.081760 28130 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.081965 28264 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.082396 27727 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.083643 30294 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.083943 30294 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.088914 30294 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.089217 28264 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.091166 27997 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.092396 27727 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.092439 27578 catalog_manager.cc:5484] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.094098 28130 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.099689 27863 consensus_queue.cc:237] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:42.101792 27727 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.102234 30368 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.102458 28130 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.103031 27997 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.103359 28535 consensus_queue.cc:237] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:42.103654 29355 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.104210 29355 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.104926 28264 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.105574 27862 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.105857 27727 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.105856 28132 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.106364 28400 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.106503 27997 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.106421 30355 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.106822 30343 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.106971 30346 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.107095 28264 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.107220 30346 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.107443 30062 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.108940 30368 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.109671 30343 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.109952 30371 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.110427 28130 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.112062 27564 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 798ef14558d44d01911b4c8453c2b126 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:42.112401 28533 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.112565 27727 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.112802 30368 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.113445 28533 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.114980 28533 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.115157 27579 catalog_manager.cc:5484] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:42.117792 28399 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.118624 30355 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.119108 27862 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.119226 28399 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.120355 27727 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.121397 30369 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.121649 27998 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.122193 28399 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.122931 28264 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.123595 28399 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.125519 27570 catalog_manager.cc:5484] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.126386 28265 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.132036 27997 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.132835 28533 consensus_queue.cc:237] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:42.133030 28132 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.135169 28132 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.135301 27727 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.135612 30062 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.135943 30343 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.136039 28265 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.136292 28399 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.136626 30355 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.136770 27997 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.136905 30355 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.137295 30355 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.139832 30062 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.141357 28265 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.142202 27565 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet fea2267a27de4324948a5549eb399267 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:42.142577 28400 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
W20240502 01:59:42.144531 27795 consensus_peers.cc:485] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 -> Peer 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201:40597): Couldn't send request to peer 7332064716f04e84ba81c1f2b70821f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 798ef14558d44d01911b4c8453c2b126. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:42.145429 27862 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.145889 27997 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.146448 30346 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.146392 27579 catalog_manager.cc:5484] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
W20240502 01:59:42.147593 28468 consensus_peers.cc:485] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb -> Peer 0003837e2d88424093594ed169d82cd2 (127.10.133.200:45585): Couldn't send request to peer 0003837e2d88424093594ed169d82cd2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fea2267a27de4324948a5549eb399267. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:42.147542 27862 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.148216 27727 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.155474 28132 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.163404 28535 consensus_queue.cc:237] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:42.165237 28132 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.165417 28400 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.165407 27997 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.165601 28265 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.165735 27862 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.165922 30347 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.166230 27727 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.166232 30062 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.166376 30347 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.166527 30354 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.166841 30345 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.169088 30347 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.169749 30345 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.170109 28132 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.170395 27862 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.173036 28265 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.175714 27571 catalog_manager.cc:5484] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:42.175788 27997 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.178308 30058 heartbeater.cc:503] Master 127.10.133.254:40911 was elected leader, sending a full tablet report...
I20240502 01:59:42.179431 28535 consensus_queue.cc:237] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:42.182484 27862 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.182657 28132 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
W20240502 01:59:42.182723 28468 consensus_peers.cc:485] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb -> Peer 0003837e2d88424093594ed169d82cd2 (127.10.133.200:45585): Couldn't send request to peer 0003837e2d88424093594ed169d82cd2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13a5600dc379460b9c433ffdaa0b3d02. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:42.182955 30343 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.183046 28264 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.183064 30345 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.183835 30343 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.183883 27998 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.184525 28399 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.185024 30343 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.185851 28399 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.186161 27728 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.186323 30345 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.186749 30343 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.188345 30345 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.188652 27997 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.190632 27565 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 13a5600dc379460b9c433ffdaa0b3d02 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:42.191296 28399 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.191414 27728 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.191803 27578 catalog_manager.cc:5484] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f reported cstate change: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.192095 27862 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.194430 28132 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.194900 28264 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.198668 27728 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.201956 27728 consensus_queue.cc:237] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } }
I20240502 01:59:42.203685 28535 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.203711 27997 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.203842 27862 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.204138 28264 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.204152 28132 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.204227 30411 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.204340 28399 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.204583 29790 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.204768 30409 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.204939 30412 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.205121 29657 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.205718 30410 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.207827 30411 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } }
I20240502 01:59:42.208084 28399 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } }
I20240502 01:59:42.208153 28264 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } }
I20240502 01:59:42.210103 27862 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } }
I20240502 01:59:42.210438 28535 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } }
I20240502 01:59:42.211158 27579 catalog_manager.cc:5484] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } }
I20240502 01:59:42.211154 28132 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } }
I20240502 01:59:42.215646 27997 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } }
I20240502 01:59:42.218611 27728 consensus_queue.cc:237] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:42.220355 28399 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.220672 28132 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.220678 28264 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.220785 30409 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.220955 28535 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.221563 29657 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.221843 29657 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.222409 29657 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.222482 27862 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.223209 27997 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.223421 30409 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.223920 30410 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.225323 30411 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.225973 27862 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.225973 27998 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.226802 28132 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.227312 28399 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.227748 27565 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 77e62ec43c8d442b9846f05439ac7a99 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:42.229317 27578 catalog_manager.cc:5484] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:42.230455 28533 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
W20240502 01:59:42.234686 27662 consensus_peers.cc:485] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 -> Peer 0003837e2d88424093594ed169d82cd2 (127.10.133.200:45585): Couldn't send request to peer 0003837e2d88424093594ed169d82cd2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77e62ec43c8d442b9846f05439ac7a99. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:42.234547 28264 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.235321 28399 consensus_queue.cc:237] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:42.237538 27998 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.237598 27862 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.238031 29768 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.238255 30336 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.238919 28533 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.239349 28264 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.239447 27728 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.239673 28132 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.239842 30430 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.240238 30430 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.240406 30429 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.240585 30336 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.242502 30430 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:42.242924 28264 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:42.243435 27998 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:42.244406 27862 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:42.244871 27728 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:42.246743 27575 catalog_manager.cc:5484] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:42.250116 28533 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:42.250118 28132 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:42.253530 28399 consensus_queue.cc:237] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:42.255837 27998 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.256290 28132 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.256346 27862 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.256449 28264 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.256953 29768 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.257318 29768 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.257625 28533 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.257906 27728 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.258021 30445 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.258184 30431 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.258809 30432 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.260015 30432 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.261793 30432 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.263955 28533 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.263971 27728 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.266604 27579 catalog_manager.cc:5484] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
W20240502 01:59:42.267378 28333 consensus_peers.cc:485] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 -> Peer 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201:40597): Couldn't send request to peer 7332064716f04e84ba81c1f2b70821f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b2133628f3584c8c900e569d8f45d3a9. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:42.267882 27566 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet b2133628f3584c8c900e569d8f45d3a9 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:42.267712 28264 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.270463 27862 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.272045 27998 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.272209 27863 consensus_queue.cc:237] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:42.274581 28533 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.274690 28130 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.274840 27998 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.274993 30371 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.275177 30368 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.275430 30370 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.277514 28399 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.278577 30368 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.281487 30368 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.281913 28130 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.283882 27998 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.284406 28399 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.285795 27578 catalog_manager.cc:5484] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:42.286522 27728 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.287122 30370 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.287753 28264 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.287679 28130 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.288130 30370 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.290653 27728 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.293524 28264 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.296066 27863 consensus_queue.cc:237] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:42.298225 28130 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.298266 28264 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.298669 28399 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.298652 30371 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.298758 28533 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.299008 27728 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.299122 30371 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.299430 30368 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.299778 28533 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.300854 30368 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.301900 30371 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.304692 30371 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
W20240502 01:59:42.304870 27796 consensus_peers.cc:485] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 -> Peer 0003837e2d88424093594ed169d82cd2 (127.10.133.200:45585): Couldn't send request to peer 0003837e2d88424093594ed169d82cd2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e1bd5156bcca44438438c6ca78facd35. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:42.305160 27998 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.305181 27863 consensus_queue.cc:237] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:42.305550 30459 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.306957 28264 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.306984 28132 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.306833 28399 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.307432 28400 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.307348 28130 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.308032 27996 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.308308 27997 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.308504 30294 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.309069 30368 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.309417 30368 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.309789 28535 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.310256 27727 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.310463 28264 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.310559 27728 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.310719 29355 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.311025 29355 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.311196 27574 catalog_manager.cc:5484] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 reported cstate change: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.312268 30370 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.314222 27564 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet e1bd5156bcca44438438c6ca78facd35 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:42.317871 28533 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.319795 30368 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:42.320314 28399 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:42.321655 27998 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:42.321961 27728 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:42.321961 28130 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:42.324811 27575 catalog_manager.cc:5484] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:42.326869 28264 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:42.326917 28535 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:42.329288 27863 consensus_queue.cc:237] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:42.331346 28399 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.331701 27728 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.331935 28130 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.331995 28535 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.331974 30369 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.332192 28264 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.332363 30461 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.332525 30459 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.332917 30371 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.333087 30369 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20240502 01:59:42.333557 27796 consensus_peers.cc:485] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 -> Peer 0003837e2d88424093594ed169d82cd2 (127.10.133.200:45585): Couldn't send request to peer 0003837e2d88424093594ed169d82cd2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 98464434decb46a9810c228f92a41732. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:42.334548 27998 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.334925 30368 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.335633 30459 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.336102 28399 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.336388 28264 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.337164 28535 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.338194 27564 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 98464434decb46a9810c228f92a41732 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:42.338649 27578 catalog_manager.cc:5484] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.338824 28130 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.342355 27998 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.345031 27728 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:42.346554 28399 consensus_queue.cc:237] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:42.348268 28535 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.348835 27728 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.348945 27998 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.349403 27863 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.349645 30430 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.349824 30336 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.350150 30430 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.350304 30336 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.350531 28130 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.351009 30336 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.353159 30430 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.353775 27863 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.355700 28130 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.356171 28264 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:42.356611 30445 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:42.356603 27998 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.356950 27578 catalog_manager.cc:5484] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.357352 27728 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.358476 28265 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.364044 30192 heartbeater.cc:503] Master 127.10.133.254:40911 was elected leader, sending a full tablet report...
I20240502 01:59:42.364790 28399 consensus_queue.cc:237] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:42.365828 28535 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:42.366827 27863 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.367142 28130 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
W20240502 01:59:42.367542 28333 consensus_peers.cc:485] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 -> Peer 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201:40597): Couldn't send request to peer 7332064716f04e84ba81c1f2b70821f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3b56295cbe014d6894812ee0a64bc513. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:42.367643 30336 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.367954 30431 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.368605 27728 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.369407 27998 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.369781 28264 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.369833 30431 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.370294 30431 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.370673 28535 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:42.371126 30432 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.372983 30445 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.375121 30432 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:42.375152 27566 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 3b56295cbe014d6894812ee0a64bc513 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:42.375077 28130 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.376449 27996 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.376600 28535 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.378984 28265 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.379089 27575 catalog_manager.cc:5484] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.381850 27728 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.391367 27863 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:42.540769 30525 ts_tablet_manager.cc:902] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2: Initiating tablet copy from peer 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:42.541575 30525 tablet_copy_client.cc:308] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.199:35629
I20240502 01:59:42.545428 28555 tablet_copy_service.cc:140] P 257826b7ad7e4abb8499b6687e8c83eb: Received BeginTabletCopySession request for tablet fea2267a27de4324948a5549eb399267 from peer 0003837e2d88424093594ed169d82cd2 ({username='slave'} at 127.10.133.200:60711)
I20240502 01:59:42.545576 28555 tablet_copy_service.cc:161] P 257826b7ad7e4abb8499b6687e8c83eb: Beginning new tablet copy session on tablet fea2267a27de4324948a5549eb399267 from peer 0003837e2d88424093594ed169d82cd2 at {username='slave'} at 127.10.133.200:60711: session id = 0003837e2d88424093594ed169d82cd2-fea2267a27de4324948a5549eb399267
I20240502 01:59:42.546905 28555 tablet_copy_source_session.cc:205] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:42.550312 30525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fea2267a27de4324948a5549eb399267. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:42.556576 30525 tablet_copy_client.cc:783] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:42.556797 30525 tablet_copy_client.cc:647] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:42.558454 30525 tablet_copy_client.cc:523] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:42.560016 30525 tablet_bootstrap.cc:492] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2: Bootstrap starting.
I20240502 01:59:42.565694 30525 log.cc:824] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:42.581410 30532 ts_tablet_manager.cc:902] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9: Initiating tablet copy from peer a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731)
I20240502 01:59:42.582208 30532 tablet_copy_client.cc:308] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37731
I20240502 01:59:42.589351 27885 tablet_copy_service.cc:140] P a8c1908b1c554e7cbbb9bf9751b8ee98: Received BeginTabletCopySession request for tablet 798ef14558d44d01911b4c8453c2b126 from peer 7332064716f04e84ba81c1f2b70821f9 ({username='slave'} at 127.10.133.201:33397)
I20240502 01:59:42.589512 27885 tablet_copy_service.cc:161] P a8c1908b1c554e7cbbb9bf9751b8ee98: Beginning new tablet copy session on tablet 798ef14558d44d01911b4c8453c2b126 from peer 7332064716f04e84ba81c1f2b70821f9 at {username='slave'} at 127.10.133.201:33397: session id = 7332064716f04e84ba81c1f2b70821f9-798ef14558d44d01911b4c8453c2b126
I20240502 01:59:42.590881 27885 tablet_copy_source_session.cc:205] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:42.592855 30525 tablet_bootstrap.cc:492] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:42.593214 30525 tablet_bootstrap.cc:492] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2: Bootstrap complete.
I20240502 01:59:42.593513 30525 ts_tablet_manager.cc:1367] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2: Time spent bootstrapping tablet: real 0.034s user 0.032s sys 0.000s
I20240502 01:59:42.594666 30532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 798ef14558d44d01911b4c8453c2b126. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:42.595981 30525 raft_consensus.cc:348] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:42.596210 30525 raft_consensus.cc:729] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0003837e2d88424093594ed169d82cd2, State: Initialized, Role: LEARNER
I20240502 01:59:42.596488 30525 consensus_queue.cc:260] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:42.597277 30525 ts_tablet_manager.cc:1398] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2: Time spent starting tablet: real 0.004s user 0.006s sys 0.000s
I20240502 01:59:42.597973 28555 tablet_copy_service.cc:342] P 257826b7ad7e4abb8499b6687e8c83eb: Request end of tablet copy session 0003837e2d88424093594ed169d82cd2-fea2267a27de4324948a5549eb399267 received from {username='slave'} at 127.10.133.200:60711
I20240502 01:59:42.598104 28555 tablet_copy_service.cc:433] P 257826b7ad7e4abb8499b6687e8c83eb: ending tablet copy session 0003837e2d88424093594ed169d82cd2-fea2267a27de4324948a5549eb399267 on tablet fea2267a27de4324948a5549eb399267 with peer 0003837e2d88424093594ed169d82cd2
I20240502 01:59:42.600975 30532 tablet_copy_client.cc:783] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:42.601188 30532 tablet_copy_client.cc:647] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:42.603128 30532 tablet_copy_client.cc:523] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:42.604672 30532 tablet_bootstrap.cc:492] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap starting.
I20240502 01:59:42.610251 30532 log.cc:824] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:42.624475 30540 ts_tablet_manager.cc:902] T 916eed3f573b445e8ac1384f13139479 P 7332064716f04e84ba81c1f2b70821f9: Initiating tablet copy from peer 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:42.625054 30540 tablet_copy_client.cc:308] T 916eed3f573b445e8ac1384f13139479 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.199:35629
I20240502 01:59:42.628561 28555 tablet_copy_service.cc:140] P 257826b7ad7e4abb8499b6687e8c83eb: Received BeginTabletCopySession request for tablet 916eed3f573b445e8ac1384f13139479 from peer 7332064716f04e84ba81c1f2b70821f9 ({username='slave'} at 127.10.133.201:60003)
I20240502 01:59:42.628657 28555 tablet_copy_service.cc:161] P 257826b7ad7e4abb8499b6687e8c83eb: Beginning new tablet copy session on tablet 916eed3f573b445e8ac1384f13139479 from peer 7332064716f04e84ba81c1f2b70821f9 at {username='slave'} at 127.10.133.201:60003: session id = 7332064716f04e84ba81c1f2b70821f9-916eed3f573b445e8ac1384f13139479
I20240502 01:59:42.629393 28555 tablet_copy_source_session.cc:205] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:42.630220 30540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 916eed3f573b445e8ac1384f13139479. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:42.632402 30540 tablet_copy_client.cc:783] T 916eed3f573b445e8ac1384f13139479 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:42.632568 30540 tablet_copy_client.cc:647] T 916eed3f573b445e8ac1384f13139479 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:42.633131 30532 tablet_bootstrap.cc:492] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:42.633477 30532 tablet_bootstrap.cc:492] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap complete.
I20240502 01:59:42.633667 30540 tablet_copy_client.cc:523] T 916eed3f573b445e8ac1384f13139479 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:42.633850 30532 ts_tablet_manager.cc:1367] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9: Time spent bootstrapping tablet: real 0.029s user 0.029s sys 0.001s
I20240502 01:59:42.634778 30540 tablet_bootstrap.cc:492] T 916eed3f573b445e8ac1384f13139479 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap starting.
I20240502 01:59:42.636494 30532 raft_consensus.cc:348] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:42.636813 30532 raft_consensus.cc:729] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7332064716f04e84ba81c1f2b70821f9, State: Initialized, Role: LEARNER
I20240502 01:59:42.637179 30532 consensus_queue.cc:260] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:42.638145 30532 ts_tablet_manager.cc:1398] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 01:59:42.640010 27885 tablet_copy_service.cc:342] P a8c1908b1c554e7cbbb9bf9751b8ee98: Request end of tablet copy session 7332064716f04e84ba81c1f2b70821f9-798ef14558d44d01911b4c8453c2b126 received from {username='slave'} at 127.10.133.201:33397
I20240502 01:59:42.640111 27885 tablet_copy_service.cc:433] P a8c1908b1c554e7cbbb9bf9751b8ee98: ending tablet copy session 7332064716f04e84ba81c1f2b70821f9-798ef14558d44d01911b4c8453c2b126 on tablet 798ef14558d44d01911b4c8453c2b126 with peer 7332064716f04e84ba81c1f2b70821f9
I20240502 01:59:42.649516 30525 ts_tablet_manager.cc:902] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2: Initiating tablet copy from peer 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:42.649973 30525 tablet_copy_client.cc:308] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.199:35629
I20240502 01:59:42.650482 28555 tablet_copy_service.cc:140] P 257826b7ad7e4abb8499b6687e8c83eb: Received BeginTabletCopySession request for tablet 13a5600dc379460b9c433ffdaa0b3d02 from peer 0003837e2d88424093594ed169d82cd2 ({username='slave'} at 127.10.133.200:60711)
I20240502 01:59:42.650583 28555 tablet_copy_service.cc:161] P 257826b7ad7e4abb8499b6687e8c83eb: Beginning new tablet copy session on tablet 13a5600dc379460b9c433ffdaa0b3d02 from peer 0003837e2d88424093594ed169d82cd2 at {username='slave'} at 127.10.133.200:60711: session id = 0003837e2d88424093594ed169d82cd2-13a5600dc379460b9c433ffdaa0b3d02
I20240502 01:59:42.651400 28555 tablet_copy_source_session.cc:205] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:42.652994 30525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13a5600dc379460b9c433ffdaa0b3d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:42.655265 30525 tablet_copy_client.cc:783] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:42.656167 30525 tablet_copy_client.cc:647] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:42.657687 30525 tablet_copy_client.cc:523] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:42.659024 30525 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2: Bootstrap starting.
I20240502 01:59:42.667001 30540 tablet_bootstrap.cc:492] T 916eed3f573b445e8ac1384f13139479 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:42.667367 30540 tablet_bootstrap.cc:492] T 916eed3f573b445e8ac1384f13139479 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap complete.
I20240502 01:59:42.667587 30540 ts_tablet_manager.cc:1367] T 916eed3f573b445e8ac1384f13139479 P 7332064716f04e84ba81c1f2b70821f9: Time spent bootstrapping tablet: real 0.033s user 0.021s sys 0.007s
I20240502 01:59:42.668511 30540 raft_consensus.cc:348] T 916eed3f573b445e8ac1384f13139479 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:42.668946 30540 raft_consensus.cc:729] T 916eed3f573b445e8ac1384f13139479 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7332064716f04e84ba81c1f2b70821f9, State: Initialized, Role: LEARNER
I20240502 01:59:42.669117 30540 consensus_queue.cc:260] T 916eed3f573b445e8ac1384f13139479 P 7332064716f04e84ba81c1f2b70821f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:42.669469 30540 ts_tablet_manager.cc:1398] T 916eed3f573b445e8ac1384f13139479 P 7332064716f04e84ba81c1f2b70821f9: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20240502 01:59:42.670203 28555 tablet_copy_service.cc:342] P 257826b7ad7e4abb8499b6687e8c83eb: Request end of tablet copy session 7332064716f04e84ba81c1f2b70821f9-916eed3f573b445e8ac1384f13139479 received from {username='slave'} at 127.10.133.201:60003
I20240502 01:59:42.670280 28555 tablet_copy_service.cc:433] P 257826b7ad7e4abb8499b6687e8c83eb: ending tablet copy session 7332064716f04e84ba81c1f2b70821f9-916eed3f573b445e8ac1384f13139479 on tablet 916eed3f573b445e8ac1384f13139479 with peer 7332064716f04e84ba81c1f2b70821f9
I20240502 01:59:42.684685 30588 ts_tablet_manager.cc:902] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2: Initiating tablet copy from peer da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835)
I20240502 01:59:42.685140 30525 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:42.685431 30525 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2: Bootstrap complete.
I20240502 01:59:42.685555 30588 tablet_copy_client.cc:308] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:40835
I20240502 01:59:42.685624 30525 ts_tablet_manager.cc:1367] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2: Time spent bootstrapping tablet: real 0.027s user 0.021s sys 0.000s
I20240502 01:59:42.686292 30525 raft_consensus.cc:348] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:42.686434 30525 raft_consensus.cc:729] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0003837e2d88424093594ed169d82cd2, State: Initialized, Role: LEARNER
I20240502 01:59:42.686582 30525 consensus_queue.cc:260] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:42.687008 30525 ts_tablet_manager.cc:1398] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2: Time spent starting tablet: real 0.001s user 0.005s sys 0.000s
I20240502 01:59:42.688614 28555 tablet_copy_service.cc:342] P 257826b7ad7e4abb8499b6687e8c83eb: Request end of tablet copy session 0003837e2d88424093594ed169d82cd2-13a5600dc379460b9c433ffdaa0b3d02 received from {username='slave'} at 127.10.133.200:60711
I20240502 01:59:42.688704 28555 tablet_copy_service.cc:433] P 257826b7ad7e4abb8499b6687e8c83eb: ending tablet copy session 0003837e2d88424093594ed169d82cd2-13a5600dc379460b9c433ffdaa0b3d02 on tablet 13a5600dc379460b9c433ffdaa0b3d02 with peer 0003837e2d88424093594ed169d82cd2
I20240502 01:59:42.690946 27749 tablet_copy_service.cc:140] P da58b5341d344efd833502f214e69ff1: Received BeginTabletCopySession request for tablet 77e62ec43c8d442b9846f05439ac7a99 from peer 0003837e2d88424093594ed169d82cd2 ({username='slave'} at 127.10.133.200:44783)
I20240502 01:59:42.691073 27749 tablet_copy_service.cc:161] P da58b5341d344efd833502f214e69ff1: Beginning new tablet copy session on tablet 77e62ec43c8d442b9846f05439ac7a99 from peer 0003837e2d88424093594ed169d82cd2 at {username='slave'} at 127.10.133.200:44783: session id = 0003837e2d88424093594ed169d82cd2-77e62ec43c8d442b9846f05439ac7a99
I20240502 01:59:42.692602 27749 tablet_copy_source_session.cc:205] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:42.693797 30588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77e62ec43c8d442b9846f05439ac7a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:42.696159 30588 tablet_copy_client.cc:783] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:42.696323 30588 tablet_copy_client.cc:647] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:42.697594 30588 tablet_copy_client.cc:523] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:42.698982 30588 tablet_bootstrap.cc:492] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2: Bootstrap starting.
I20240502 01:59:42.718585 30588 tablet_bootstrap.cc:492] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:42.718801 30588 tablet_bootstrap.cc:492] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2: Bootstrap complete.
I20240502 01:59:42.718940 30588 ts_tablet_manager.cc:1367] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2: Time spent bootstrapping tablet: real 0.020s user 0.016s sys 0.003s
I20240502 01:59:42.719301 30588 raft_consensus.cc:348] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:42.719435 30588 raft_consensus.cc:729] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0003837e2d88424093594ed169d82cd2, State: Initialized, Role: LEARNER
I20240502 01:59:42.719533 30588 consensus_queue.cc:260] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:42.719790 30588 ts_tablet_manager.cc:1398] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:42.720314 27749 tablet_copy_service.cc:342] P da58b5341d344efd833502f214e69ff1: Request end of tablet copy session 0003837e2d88424093594ed169d82cd2-77e62ec43c8d442b9846f05439ac7a99 received from {username='slave'} at 127.10.133.200:44783
I20240502 01:59:42.720402 27749 tablet_copy_service.cc:433] P da58b5341d344efd833502f214e69ff1: ending tablet copy session 0003837e2d88424093594ed169d82cd2-77e62ec43c8d442b9846f05439ac7a99 on tablet 77e62ec43c8d442b9846f05439ac7a99 with peer 0003837e2d88424093594ed169d82cd2
I20240502 01:59:42.752197 30540 ts_tablet_manager.cc:902] T b2133628f3584c8c900e569d8f45d3a9 P 7332064716f04e84ba81c1f2b70821f9: Initiating tablet copy from peer 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921)
I20240502 01:59:42.752669 30540 tablet_copy_client.cc:308] T b2133628f3584c8c900e569d8f45d3a9 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.198:44921
I20240502 01:59:42.756446 28421 tablet_copy_service.cc:140] P 12f527e76eff4669924a898d5029e3d1: Received BeginTabletCopySession request for tablet b2133628f3584c8c900e569d8f45d3a9 from peer 7332064716f04e84ba81c1f2b70821f9 ({username='slave'} at 127.10.133.201:56767)
I20240502 01:59:42.756583 28421 tablet_copy_service.cc:161] P 12f527e76eff4669924a898d5029e3d1: Beginning new tablet copy session on tablet b2133628f3584c8c900e569d8f45d3a9 from peer 7332064716f04e84ba81c1f2b70821f9 at {username='slave'} at 127.10.133.201:56767: session id = 7332064716f04e84ba81c1f2b70821f9-b2133628f3584c8c900e569d8f45d3a9
I20240502 01:59:42.758023 28421 tablet_copy_source_session.cc:205] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:42.759182 30540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b2133628f3584c8c900e569d8f45d3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:42.761240 30540 tablet_copy_client.cc:783] T b2133628f3584c8c900e569d8f45d3a9 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:42.761366 30540 tablet_copy_client.cc:647] T b2133628f3584c8c900e569d8f45d3a9 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:42.763054 30540 tablet_copy_client.cc:523] T b2133628f3584c8c900e569d8f45d3a9 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:42.763974 30540 tablet_bootstrap.cc:492] T b2133628f3584c8c900e569d8f45d3a9 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap starting.
I20240502 01:59:42.781765 30540 tablet_bootstrap.cc:492] T b2133628f3584c8c900e569d8f45d3a9 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:42.782063 30540 tablet_bootstrap.cc:492] T b2133628f3584c8c900e569d8f45d3a9 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap complete.
I20240502 01:59:42.782217 30540 ts_tablet_manager.cc:1367] T b2133628f3584c8c900e569d8f45d3a9 P 7332064716f04e84ba81c1f2b70821f9: Time spent bootstrapping tablet: real 0.018s user 0.015s sys 0.004s
I20240502 01:59:42.782596 30540 raft_consensus.cc:348] T b2133628f3584c8c900e569d8f45d3a9 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:42.782732 30540 raft_consensus.cc:729] T b2133628f3584c8c900e569d8f45d3a9 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7332064716f04e84ba81c1f2b70821f9, State: Initialized, Role: LEARNER
I20240502 01:59:42.782840 30540 consensus_queue.cc:260] T b2133628f3584c8c900e569d8f45d3a9 P 7332064716f04e84ba81c1f2b70821f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:42.783082 30540 ts_tablet_manager.cc:1398] T b2133628f3584c8c900e569d8f45d3a9 P 7332064716f04e84ba81c1f2b70821f9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:42.783699 28421 tablet_copy_service.cc:342] P 12f527e76eff4669924a898d5029e3d1: Request end of tablet copy session 7332064716f04e84ba81c1f2b70821f9-b2133628f3584c8c900e569d8f45d3a9 received from {username='slave'} at 127.10.133.201:56767
I20240502 01:59:42.783804 28421 tablet_copy_service.cc:433] P 12f527e76eff4669924a898d5029e3d1: ending tablet copy session 7332064716f04e84ba81c1f2b70821f9-b2133628f3584c8c900e569d8f45d3a9 on tablet b2133628f3584c8c900e569d8f45d3a9 with peer 7332064716f04e84ba81c1f2b70821f9
I20240502 01:59:42.825973 30588 ts_tablet_manager.cc:902] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2: Initiating tablet copy from peer a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731)
I20240502 01:59:42.826447 30588 tablet_copy_client.cc:308] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37731
I20240502 01:59:42.829777 27885 tablet_copy_service.cc:140] P a8c1908b1c554e7cbbb9bf9751b8ee98: Received BeginTabletCopySession request for tablet e1bd5156bcca44438438c6ca78facd35 from peer 0003837e2d88424093594ed169d82cd2 ({username='slave'} at 127.10.133.200:41621)
I20240502 01:59:42.829890 27885 tablet_copy_service.cc:161] P a8c1908b1c554e7cbbb9bf9751b8ee98: Beginning new tablet copy session on tablet e1bd5156bcca44438438c6ca78facd35 from peer 0003837e2d88424093594ed169d82cd2 at {username='slave'} at 127.10.133.200:41621: session id = 0003837e2d88424093594ed169d82cd2-e1bd5156bcca44438438c6ca78facd35
I20240502 01:59:42.830641 27885 tablet_copy_source_session.cc:205] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:42.831492 30588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1bd5156bcca44438438c6ca78facd35. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:42.833288 30588 tablet_copy_client.cc:783] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:42.833438 30588 tablet_copy_client.cc:647] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:42.834529 30588 tablet_copy_client.cc:523] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:42.835544 30588 tablet_bootstrap.cc:492] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2: Bootstrap starting.
I20240502 01:59:42.854846 30588 tablet_bootstrap.cc:492] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:42.855155 30588 tablet_bootstrap.cc:492] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2: Bootstrap complete.
I20240502 01:59:42.855332 30588 ts_tablet_manager.cc:1367] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2: Time spent bootstrapping tablet: real 0.020s user 0.015s sys 0.004s
I20240502 01:59:42.855726 30588 raft_consensus.cc:348] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:42.855842 30588 raft_consensus.cc:729] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0003837e2d88424093594ed169d82cd2, State: Initialized, Role: LEARNER
I20240502 01:59:42.855944 30588 consensus_queue.cc:260] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:42.856225 30588 ts_tablet_manager.cc:1398] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:42.856770 27885 tablet_copy_service.cc:342] P a8c1908b1c554e7cbbb9bf9751b8ee98: Request end of tablet copy session 0003837e2d88424093594ed169d82cd2-e1bd5156bcca44438438c6ca78facd35 received from {username='slave'} at 127.10.133.200:41621
I20240502 01:59:42.856858 27885 tablet_copy_service.cc:433] P a8c1908b1c554e7cbbb9bf9751b8ee98: ending tablet copy session 0003837e2d88424093594ed169d82cd2-e1bd5156bcca44438438c6ca78facd35 on tablet e1bd5156bcca44438438c6ca78facd35 with peer 0003837e2d88424093594ed169d82cd2
I20240502 01:59:42.899024 30540 ts_tablet_manager.cc:902] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9: Initiating tablet copy from peer 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921)
I20240502 01:59:42.899488 30540 tablet_copy_client.cc:308] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.198:44921
I20240502 01:59:42.899983 28421 tablet_copy_service.cc:140] P 12f527e76eff4669924a898d5029e3d1: Received BeginTabletCopySession request for tablet 3b56295cbe014d6894812ee0a64bc513 from peer 7332064716f04e84ba81c1f2b70821f9 ({username='slave'} at 127.10.133.201:56767)
I20240502 01:59:42.900094 28421 tablet_copy_service.cc:161] P 12f527e76eff4669924a898d5029e3d1: Beginning new tablet copy session on tablet 3b56295cbe014d6894812ee0a64bc513 from peer 7332064716f04e84ba81c1f2b70821f9 at {username='slave'} at 127.10.133.201:56767: session id = 7332064716f04e84ba81c1f2b70821f9-3b56295cbe014d6894812ee0a64bc513
I20240502 01:59:42.900830 28421 tablet_copy_source_session.cc:205] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:42.901679 30540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b56295cbe014d6894812ee0a64bc513. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:42.903719 30540 tablet_copy_client.cc:783] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:42.903873 30540 tablet_copy_client.cc:647] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:42.905617 30540 tablet_copy_client.cc:523] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:42.906883 30540 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap starting.
I20240502 01:59:42.927081 30540 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:42.927340 30540 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap complete.
I20240502 01:59:42.927515 30540 ts_tablet_manager.cc:1367] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9: Time spent bootstrapping tablet: real 0.021s user 0.020s sys 0.000s
I20240502 01:59:42.928004 30540 raft_consensus.cc:348] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:42.928123 30540 raft_consensus.cc:729] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7332064716f04e84ba81c1f2b70821f9, State: Initialized, Role: LEARNER
I20240502 01:59:42.928234 30540 consensus_queue.cc:260] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:42.928339 30588 ts_tablet_manager.cc:902] T 98464434decb46a9810c228f92a41732 P 0003837e2d88424093594ed169d82cd2: Initiating tablet copy from peer a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731)
I20240502 01:59:42.928556 30540 ts_tablet_manager.cc:1398] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:42.928833 30588 tablet_copy_client.cc:308] T 98464434decb46a9810c228f92a41732 P 0003837e2d88424093594ed169d82cd2: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37731
I20240502 01:59:42.929160 28421 tablet_copy_service.cc:342] P 12f527e76eff4669924a898d5029e3d1: Request end of tablet copy session 7332064716f04e84ba81c1f2b70821f9-3b56295cbe014d6894812ee0a64bc513 received from {username='slave'} at 127.10.133.201:56767
I20240502 01:59:42.929236 28421 tablet_copy_service.cc:433] P 12f527e76eff4669924a898d5029e3d1: ending tablet copy session 7332064716f04e84ba81c1f2b70821f9-3b56295cbe014d6894812ee0a64bc513 on tablet 3b56295cbe014d6894812ee0a64bc513 with peer 7332064716f04e84ba81c1f2b70821f9
I20240502 01:59:42.929817 27885 tablet_copy_service.cc:140] P a8c1908b1c554e7cbbb9bf9751b8ee98: Received BeginTabletCopySession request for tablet 98464434decb46a9810c228f92a41732 from peer 0003837e2d88424093594ed169d82cd2 ({username='slave'} at 127.10.133.200:41621)
I20240502 01:59:42.929919 27885 tablet_copy_service.cc:161] P a8c1908b1c554e7cbbb9bf9751b8ee98: Beginning new tablet copy session on tablet 98464434decb46a9810c228f92a41732 from peer 0003837e2d88424093594ed169d82cd2 at {username='slave'} at 127.10.133.200:41621: session id = 0003837e2d88424093594ed169d82cd2-98464434decb46a9810c228f92a41732
I20240502 01:59:42.930919 27885 tablet_copy_source_session.cc:205] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:42.931762 30588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98464434decb46a9810c228f92a41732. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:42.934037 30588 tablet_copy_client.cc:783] T 98464434decb46a9810c228f92a41732 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:42.934201 30588 tablet_copy_client.cc:647] T 98464434decb46a9810c228f92a41732 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:42.937765 30588 tablet_copy_client.cc:523] T 98464434decb46a9810c228f92a41732 P 0003837e2d88424093594ed169d82cd2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:42.939448 30588 tablet_bootstrap.cc:492] T 98464434decb46a9810c228f92a41732 P 0003837e2d88424093594ed169d82cd2: Bootstrap starting.
I20240502 01:59:42.960496 30588 tablet_bootstrap.cc:492] T 98464434decb46a9810c228f92a41732 P 0003837e2d88424093594ed169d82cd2: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:42.960775 30588 tablet_bootstrap.cc:492] T 98464434decb46a9810c228f92a41732 P 0003837e2d88424093594ed169d82cd2: Bootstrap complete.
I20240502 01:59:42.961187 30588 ts_tablet_manager.cc:1367] T 98464434decb46a9810c228f92a41732 P 0003837e2d88424093594ed169d82cd2: Time spent bootstrapping tablet: real 0.022s user 0.020s sys 0.001s
I20240502 01:59:42.961681 30588 raft_consensus.cc:348] T 98464434decb46a9810c228f92a41732 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:42.961815 30588 raft_consensus.cc:729] T 98464434decb46a9810c228f92a41732 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0003837e2d88424093594ed169d82cd2, State: Initialized, Role: LEARNER
I20240502 01:59:42.961920 30588 consensus_queue.cc:260] T 98464434decb46a9810c228f92a41732 P 0003837e2d88424093594ed169d82cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:42.961890 30010 raft_consensus.cc:1203] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:42.963780 30588 ts_tablet_manager.cc:1398] T 98464434decb46a9810c228f92a41732 P 0003837e2d88424093594ed169d82cd2: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20240502 01:59:42.964514 27885 tablet_copy_service.cc:342] P a8c1908b1c554e7cbbb9bf9751b8ee98: Request end of tablet copy session 0003837e2d88424093594ed169d82cd2-98464434decb46a9810c228f92a41732 received from {username='slave'} at 127.10.133.200:41621
I20240502 01:59:42.964607 27885 tablet_copy_service.cc:433] P a8c1908b1c554e7cbbb9bf9751b8ee98: ending tablet copy session 0003837e2d88424093594ed169d82cd2-98464434decb46a9810c228f92a41732 on tablet 98464434decb46a9810c228f92a41732 with peer 0003837e2d88424093594ed169d82cd2
I20240502 01:59:42.995200 29869 raft_consensus.cc:1203] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:43.059242 30010 raft_consensus.cc:1203] T 916eed3f573b445e8ac1384f13139479 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:43.133358 30010 raft_consensus.cc:1203] T b2133628f3584c8c900e569d8f45d3a9 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:43.159049 29869 raft_consensus.cc:1203] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:43.214529 29869 raft_consensus.cc:1203] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:43.376303 29869 raft_consensus.cc:1203] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:43.393499 30010 raft_consensus.cc:1203] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:43.450381 30062 raft_consensus.cc:1050] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb: attempting to promote NON_VOTER 0003837e2d88424093594ed169d82cd2 to VOTER
I20240502 01:59:43.450942 30062 consensus_queue.cc:237] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:43.453058 28132 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.453212 28399 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.454095 29869 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.454092 30343 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.454520 27727 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.454849 30347 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.455260 30347 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.455319 27863 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.456205 30062 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.456739 30729 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.457397 28265 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.458917 30729 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.459630 27996 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.462729 30729 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.466766 30343 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.467440 28399 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.468400 28132 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.470863 27575 catalog_manager.cc:5484] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.472119 28265 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.472342 27727 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.473773 27863 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.474334 27996 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.478124 29869 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.489872 28534 consensus_queue.cc:237] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:43.491765 27863 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.491765 28399 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.492355 29869 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.492404 28265 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.492491 30728 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.493042 27996 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.493055 30062 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.493350 30731 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.493629 30062 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.495570 30347 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.496479 27727 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.496739 30729 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.497170 29869 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.498109 27996 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.500348 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet fea2267a27de4324948a5549eb399267 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:43.500679 30368 raft_consensus.cc:1050] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98: attempting to promote NON_VOTER 7332064716f04e84ba81c1f2b70821f9 to VOTER
I20240502 01:59:43.501065 30347 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.500928 27577 catalog_manager.cc:5484] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2 reported cstate change: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.501252 30368 consensus_queue.cc:237] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:43.502205 28399 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.503736 28400 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.504159 27998 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.504555 30369 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.505698 27728 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.505816 28132 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.506227 28264 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.506558 30010 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.506701 30369 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.507217 30369 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.507388 30459 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.507613 30369 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.507925 30459 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.509671 28265 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.512075 27727 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.512243 27863 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.514572 28534 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.515055 30459 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.518321 28112 tablet_service.cc:1514] Processing DeleteTablet for tablet fea2267a27de4324948a5549eb399267 with delete_type TABLET_DATA_TOMBSTONED (TS 82e8cba6ed104c2c9869ea0365bbe482 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:53288
I20240502 01:59:43.521327 28399 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.523484 30755 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.524713 27574 catalog_manager.cc:5484] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.525386 28264 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.529590 30771 tablet_replica.cc:330] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482: stopping tablet replica
I20240502 01:59:43.530017 30771 raft_consensus.cc:2229] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:43.530382 30771 raft_consensus.cc:2258] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:43.531841 28132 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.531862 30771 ts_tablet_manager.cc:1875] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:43.536471 30010 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.536375 30771 ts_tablet_manager.cc:1888] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:43.537111 30771 log.cc:1196] T fea2267a27de4324948a5549eb399267 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/fea2267a27de4324948a5549eb399267
I20240502 01:59:43.536867 27728 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.537705 27563 catalog_manager.cc:4830] TS 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553): tablet fea2267a27de4324948a5549eb399267 (table rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]) successfully deleted
I20240502 01:59:43.538924 29869 raft_consensus.cc:1203] T 98464434decb46a9810c228f92a41732 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:43.538935 27996 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.540691 28534 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.548537 27863 consensus_queue.cc:237] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:43.550164 28132 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.550212 30010 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.550630 30757 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.551012 30757 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.551122 28399 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.551744 30368 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.551857 27996 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.552469 28534 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.552762 30758 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.552917 27728 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.553128 30368 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.553319 30754 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.555737 30368 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.557507 27728 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.557592 28132 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.558074 28534 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.560425 27570 catalog_manager.cc:5484] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.560959 28399 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.563097 27564 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 798ef14558d44d01911b4c8453c2b126 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:43.564457 28246 tablet_service.cc:1514] Processing DeleteTablet for tablet 798ef14558d44d01911b4c8453c2b126 with delete_type TABLET_DATA_TOMBSTONED (TS 8ed4b4242123404f86485ec57dc34e88 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:45992
I20240502 01:59:43.565153 27996 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.566198 30782 tablet_replica.cc:330] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88: stopping tablet replica
I20240502 01:59:43.566778 30782 raft_consensus.cc:2229] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:43.567109 30782 raft_consensus.cc:2258] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:43.568243 30010 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.572239 30782 ts_tablet_manager.cc:1875] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:43.574162 30782 ts_tablet_manager.cc:1888] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:43.574302 30782 log.cc:1196] T 798ef14558d44d01911b4c8453c2b126 P 8ed4b4242123404f86485ec57dc34e88: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal/wals/798ef14558d44d01911b4c8453c2b126
I20240502 01:59:43.574904 27563 catalog_manager.cc:4830] TS 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567): tablet 798ef14558d44d01911b4c8453c2b126 (table rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]) successfully deleted
I20240502 01:59:43.606386 30343 raft_consensus.cc:1050] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb: attempting to promote NON_VOTER 7332064716f04e84ba81c1f2b70821f9 to VOTER
I20240502 01:59:43.606848 30343 consensus_queue.cc:237] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:43.608785 27863 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.608891 27996 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.608999 28132 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.609364 30729 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.609627 27728 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.609900 28399 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.610225 28264 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.610313 30729 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.610652 30729 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.610792 30010 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.611126 30729 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.611526 30343 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.612027 30729 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.612190 30347 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.612828 30336 raft_consensus.cc:1050] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1: attempting to promote NON_VOTER 7332064716f04e84ba81c1f2b70821f9 to VOTER
I20240502 01:59:43.613303 30336 consensus_queue.cc:237] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:43.615298 30010 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.615808 28265 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.615860 27998 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.615913 30804 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.616192 28130 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.616335 30804 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.616742 30802 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.616815 28534 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.617017 30432 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.617590 27728 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.618160 30445 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.619004 27863 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.619179 30729 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.619395 30803 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.620179 30803 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.621398 27862 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.622282 30010 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.622499 27572 catalog_manager.cc:5484] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:43.623139 27727 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.623495 28264 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.626799 28399 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.628450 27996 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.628716 30804 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.631943 28264 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.631960 30010 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.632175 27572 catalog_manager.cc:5484] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:43.632746 27996 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.633554 28130 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.635397 30410 raft_consensus.cc:1050] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1: attempting to promote NON_VOTER 0003837e2d88424093594ed169d82cd2 to VOTER
I20240502 01:59:43.635986 30410 consensus_queue.cc:237] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:43.638181 28535 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.638180 28400 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.638726 28264 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.638777 28130 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.638931 30819 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.639027 27863 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.639426 30427 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.640287 27728 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.641654 30669 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.641749 27996 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.641861 30410 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.642215 29869 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.642355 28132 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.643034 27863 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.644191 30816 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.644538 30816 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.644872 30816 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.645108 28534 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.645694 28533 consensus_queue.cc:237] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:43.648051 27728 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.648133 30010 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.648418 30062 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.648636 30727 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.648690 28264 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.650941 27862 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.651172 28130 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.651520 27996 raft_consensus.cc:1261] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.651960 30815 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.652175 30729 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.652312 30062 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.652614 30347 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.652858 30727 consensus_queue.cc:1035] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.654103 28265 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.655198 30062 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.655503 27862 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.657168 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 916eed3f573b445e8ac1384f13139479 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:43.658188 28535 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.658584 30010 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.659240 28130 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.659617 28132 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.661442 27578 catalog_manager.cc:5484] T 916eed3f573b445e8ac1384f13139479 P 7332064716f04e84ba81c1f2b70821f9 reported cstate change: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.662434 28265 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.662559 27575 catalog_manager.cc:5484] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.664716 28400 consensus_queue.cc:237] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:43.665100 27728 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.665931 29869 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.666128 27996 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.667038 30010 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.667747 30336 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.667833 27996 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.668285 28264 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.668501 27863 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.668478 27998 raft_consensus.cc:2932] T 916eed3f573b445e8ac1384f13139479 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.669034 30336 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.669220 30445 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.669631 28533 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.670660 30445 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.671188 30445 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.671851 27728 raft_consensus.cc:1261] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.672221 30445 consensus_queue.cc:1035] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.672394 28380 tablet_service.cc:1514] Processing DeleteTablet for tablet 916eed3f573b445e8ac1384f13139479 with delete_type TABLET_DATA_TOMBSTONED (TS 12f527e76eff4669924a898d5029e3d1 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:33400
I20240502 01:59:43.674160 30801 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.674170 27862 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.675279 27728 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.676618 27863 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.676859 30010 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.676859 28264 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.678501 27566 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet b2133628f3584c8c900e569d8f45d3a9 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:43.678736 27996 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.679383 27572 catalog_manager.cc:5484] T b2133628f3584c8c900e569d8f45d3a9 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:43.680771 28535 raft_consensus.cc:2932] T b2133628f3584c8c900e569d8f45d3a9 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.681663 30827 tablet_replica.cc:330] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1: stopping tablet replica
I20240502 01:59:43.682034 30827 raft_consensus.cc:2229] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:43.682294 30827 raft_consensus.cc:2258] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:43.683590 30827 ts_tablet_manager.cc:1875] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:43.685396 28112 tablet_service.cc:1514] Processing DeleteTablet for tablet b2133628f3584c8c900e569d8f45d3a9 with delete_type TABLET_DATA_TOMBSTONED (TS 82e8cba6ed104c2c9869ea0365bbe482 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:53288
I20240502 01:59:43.685622 30771 tablet_replica.cc:330] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482: stopping tablet replica
I20240502 01:59:43.685755 30771 raft_consensus.cc:2229] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:43.685951 30771 raft_consensus.cc:2258] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:43.686471 30827 ts_tablet_manager.cc:1888] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:43.686554 30827 log.cc:1196] T 916eed3f573b445e8ac1384f13139479 P 12f527e76eff4669924a898d5029e3d1: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal/wals/916eed3f573b445e8ac1384f13139479
I20240502 01:59:43.686794 30771 ts_tablet_manager.cc:1875] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:43.688920 30771 ts_tablet_manager.cc:1888] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:43.688997 30771 log.cc:1196] T b2133628f3584c8c900e569d8f45d3a9 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/b2133628f3584c8c900e569d8f45d3a9
I20240502 01:59:43.689486 27563 catalog_manager.cc:4830] TS 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553): tablet b2133628f3584c8c900e569d8f45d3a9 (table rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]) successfully deleted
I20240502 01:59:43.690347 27566 catalog_manager.cc:4830] TS 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921): tablet 916eed3f573b445e8ac1384f13139479 (table rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]) successfully deleted
I20240502 01:59:43.728458 30727 raft_consensus.cc:1050] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb: attempting to promote NON_VOTER 0003837e2d88424093594ed169d82cd2 to VOTER
I20240502 01:59:43.728940 30727 consensus_queue.cc:237] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:43.730646 28132 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.730661 28264 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.730777 28400 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.731040 29869 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.731343 30730 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.731488 27996 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.731700 30729 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.731843 30347 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.732049 27862 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.732136 27728 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.732190 30730 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.732472 30728 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.733028 30728 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.734037 30730 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.735807 30730 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.736276 28132 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.736881 28400 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.738890 27862 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.739130 27574 catalog_manager.cc:5484] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:43.739742 29869 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.740629 27996 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.743646 28264 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.745361 27728 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.749137 28535 consensus_queue.cc:237] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:43.750730 29869 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.751335 28264 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.751415 28132 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.751873 27862 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.751858 30727 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.752197 30727 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.752498 30727 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.753327 30347 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.753813 27996 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.754352 30347 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.755429 30347 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.755698 27862 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.757572 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 13a5600dc379460b9c433ffdaa0b3d02 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:43.758913 27728 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.758862 27998 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.759055 27575 catalog_manager.cc:5484] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.759732 28264 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.760972 30728 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.762004 28380 tablet_service.cc:1514] Processing DeleteTablet for tablet 13a5600dc379460b9c433ffdaa0b3d02 with delete_type TABLET_DATA_TOMBSTONED (TS 12f527e76eff4669924a898d5029e3d1 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:33400
I20240502 01:59:43.762432 30827 tablet_replica.cc:330] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1: stopping tablet replica
I20240502 01:59:43.762615 30827 raft_consensus.cc:2229] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:43.762430 27728 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.762791 30827 raft_consensus.cc:2258] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:43.764745 28130 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.766861 29869 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:43.767298 30827 ts_tablet_manager.cc:1875] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:43.769474 30827 ts_tablet_manager.cc:1888] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:43.769549 30827 log.cc:1196] T 13a5600dc379460b9c433ffdaa0b3d02 P 12f527e76eff4669924a898d5029e3d1: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal/wals/13a5600dc379460b9c433ffdaa0b3d02
I20240502 01:59:43.770246 27566 catalog_manager.cc:4830] TS 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921): tablet 13a5600dc379460b9c433ffdaa0b3d02 (table rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]) successfully deleted
I20240502 01:59:43.803830 27728 consensus_queue.cc:237] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:43.805922 28535 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:43.806423 30816 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:43.806591 28400 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:43.807227 28264 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:43.807461 30817 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:43.807770 30815 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:43.809345 28132 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:43.809758 30815 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:43.810149 27998 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:43.810158 27862 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:43.810678 30816 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:43.811051 30816 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:43.812567 30817 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:43.813510 27862 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:43.814278 28264 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:43.817067 27574 catalog_manager.cc:5484] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:43.817231 28533 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:43.820142 28399 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:43.821306 28132 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:43.823506 27998 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:43.828563 27728 consensus_queue.cc:237] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:43.831141 28399 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:43.831395 28264 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:43.831729 28132 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:43.831914 30818 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:43.832895 27862 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:43.833824 30815 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:43.834084 30410 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:43.834741 30427 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:43.837131 28533 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:43.836970 30818 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:43.838224 30427 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:43.839227 28132 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:43.839427 28533 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:43.839529 27862 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:43.842372 27565 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 110a6faea0904da9970934cb2aba94c6 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:43.842262 27579 catalog_manager.cc:5484] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:43.843298 27998 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:43.850208 30819 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:43.850128 28399 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:43.851927 28264 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
W20240502 01:59:43.852435 27662 consensus_peers.cc:485] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 -> Peer 845294d663994245b540c006dca93b7d (127.10.133.202:45645): Couldn't send request to peer 845294d663994245b540c006dca93b7d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 110a6faea0904da9970934cb2aba94c6. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:43.853925 27998 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:43.935770 30336 raft_consensus.cc:1050] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1: attempting to promote NON_VOTER 7332064716f04e84ba81c1f2b70821f9 to VOTER
I20240502 01:59:43.936239 30336 consensus_queue.cc:237] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:43.938495 27862 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.938910 30803 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.939671 27998 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.940045 28264 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.940596 28132 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.940850 30010 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.941308 30801 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.941632 30801 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.942795 27728 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.943264 30432 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.943706 30432 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.946210 28533 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.947670 30803 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.948957 30801 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.954938 30803 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.957319 30010 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.957716 27862 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.958752 27574 catalog_manager.cc:5484] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:43.960860 27998 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.963089 28132 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.964461 27728 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.964732 28533 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.968580 28264 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.973719 28399 consensus_queue.cc:237] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:43.975528 27998 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.975625 27862 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.976109 28264 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.976348 28533 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.976356 30336 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.976719 30336 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.977378 30800 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.979044 30800 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.980561 27728 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.981019 30756 raft_consensus.cc:1050] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98: attempting to promote NON_VOTER 0003837e2d88424093594ed169d82cd2 to VOTER
I20240502 01:59:43.981045 30010 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:43.981249 30800 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.981561 30800 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:43.981561 30756 consensus_queue.cc:237] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:43.984093 28535 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.984257 28399 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.984853 30755 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.984850 30804 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.986737 29869 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.987082 27566 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 3b56295cbe014d6894812ee0a64bc513 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:43.987644 28265 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.988269 28132 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.988665 30755 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.989933 30756 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.990211 30755 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.990437 27863 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.990424 27572 catalog_manager.cc:5484] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:43.990800 27728 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.991148 30755 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.992552 27998 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.993038 30755 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.992987 27727 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.993471 28264 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:43.993860 30755 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:43.996847 30010 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:43.997290 28112 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b56295cbe014d6894812ee0a64bc513 with delete_type TABLET_DATA_TOMBSTONED (TS 82e8cba6ed104c2c9869ea0365bbe482 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:53288
I20240502 01:59:43.997494 30771 tablet_replica.cc:330] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: stopping tablet replica
I20240502 01:59:43.997610 30771 raft_consensus.cc:2229] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:43.997802 30771 raft_consensus.cc:2258] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:44.000919 27998 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:44.002409 30368 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.004429 28399 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.004634 29869 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.006215 28132 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.006263 28533 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:44.008308 27998 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.008625 28264 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.008772 27570 catalog_manager.cc:5484] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 reported cstate change: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.009851 28535 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.018944 30771 ts_tablet_manager.cc:1875] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:44.021083 30771 ts_tablet_manager.cc:1888] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:44.021153 30771 log.cc:1196] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/3b56295cbe014d6894812ee0a64bc513
I20240502 01:59:44.021607 27563 catalog_manager.cc:4830] TS 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553): tablet 3b56295cbe014d6894812ee0a64bc513 (table rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]) successfully deleted
I20240502 01:59:44.022423 27728 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.025666 27862 consensus_queue.cc:237] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:44.027902 29869 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:44.027902 28265 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:44.028024 28132 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:44.028463 28533 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:44.028435 30459 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:44.028591 30754 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:44.028792 30369 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:44.029306 30369 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:44.029511 27728 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:44.029915 30369 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:44.030143 27998 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:44.030583 30755 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:44.032063 30755 raft_consensus.cc:1050] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98: attempting to promote NON_VOTER 0003837e2d88424093594ed169d82cd2 to VOTER
I20240502 01:59:44.032565 30755 consensus_queue.cc:237] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:44.032572 30369 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.032980 27996 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.034922 28399 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:44.035419 28535 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:44.035517 28130 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:44.035985 28264 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:44.036006 27727 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:44.036398 29869 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:44.036507 27996 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:44.037042 30757 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:44.037243 30914 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:44.037201 27572 catalog_manager.cc:5484] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f reported cstate change: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.038395 30756 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:44.038547 30459 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:44.038838 30754 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:44.039005 30368 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:44.039474 30758 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:44.039440 28132 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.044543 28380 tablet_service.cc:1514] Processing DeleteTablet for tablet e1bd5156bcca44438438c6ca78facd35 with delete_type TABLET_DATA_TOMBSTONED (TS 12f527e76eff4669924a898d5029e3d1 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:33400
I20240502 01:59:44.044778 30827 tablet_replica.cc:330] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1: stopping tablet replica
I20240502 01:59:44.044939 30827 raft_consensus.cc:2229] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:44.044728 28535 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.045127 30827 raft_consensus.cc:2258] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:44.045850 30827 ts_tablet_manager.cc:1875] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:44.047277 27564 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet e1bd5156bcca44438438c6ca78facd35 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:44.048314 30827 ts_tablet_manager.cc:1888] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:44.048380 30827 log.cc:1196] T e1bd5156bcca44438438c6ca78facd35 P 12f527e76eff4669924a898d5029e3d1: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal/wals/e1bd5156bcca44438438c6ca78facd35
I20240502 01:59:44.049005 30757 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.049757 29869 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.051170 27566 catalog_manager.cc:4830] TS 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921): tablet e1bd5156bcca44438438c6ca78facd35 (table rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]) successfully deleted
I20240502 01:59:44.051342 28400 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.053519 28265 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.055521 27572 catalog_manager.cc:5484] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.056686 28130 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.059700 29869 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.062487 27996 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.063856 28399 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.065616 28264 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.067119 27727 consensus_queue.cc:237] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:44.068136 28535 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.068816 27728 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.070307 27862 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:44.071554 28132 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:44.072467 30815 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:44.072762 30427 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:44.073925 28399 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:44.074128 27996 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:44.074498 30815 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:44.074617 30427 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:44.076082 27727 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.077934 30819 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.078372 28535 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:44.079015 29869 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:44.079068 30427 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:44.080442 30410 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:44.080545 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 77e62ec43c8d442b9846f05439ac7a99 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:44.081004 28130 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.081682 27862 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.082162 27996 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.083819 28399 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.085448 27572 catalog_manager.cc:5484] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 reported cstate change: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.085813 28535 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.088178 27862 consensus_queue.cc:237] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:44.090116 28399 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:44.090647 30369 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:44.090884 27727 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:44.091117 28533 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:44.091488 29870 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:44.092381 27996 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:44.092764 30756 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:44.092963 30369 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:44.093912 28246 tablet_service.cc:1514] Processing DeleteTablet for tablet 77e62ec43c8d442b9846f05439ac7a99 with delete_type TABLET_DATA_TOMBSTONED (TS 8ed4b4242123404f86485ec57dc34e88 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:45992
I20240502 01:59:44.094838 30369 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:44.095120 30756 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:44.095420 30922 tablet_replica.cc:330] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88: stopping tablet replica
I20240502 01:59:44.095580 30922 raft_consensus.cc:2229] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:44.095703 28130 raft_consensus.cc:1261] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:44.095893 30922 raft_consensus.cc:2258] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:44.096069 30369 consensus_queue.cc:1035] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:44.096640 30922 ts_tablet_manager.cc:1875] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:44.084353 29869 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.098939 30922 ts_tablet_manager.cc:1888] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:44.099018 30922 log.cc:1196] T 77e62ec43c8d442b9846f05439ac7a99 P 8ed4b4242123404f86485ec57dc34e88: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal/wals/77e62ec43c8d442b9846f05439ac7a99
I20240502 01:59:44.099548 27563 catalog_manager.cc:4830] TS 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567): tablet 77e62ec43c8d442b9846f05439ac7a99 (table rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]) successfully deleted
I20240502 01:59:44.100292 30369 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.100782 28400 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.101331 27728 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.103443 27575 catalog_manager.cc:5484] T 98464434decb46a9810c228f92a41732 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.104003 27564 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 98464434decb46a9810c228f92a41732 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:44.105939 27996 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.106473 28246 tablet_service.cc:1514] Processing DeleteTablet for tablet 98464434decb46a9810c228f92a41732 with delete_type TABLET_DATA_TOMBSTONED (TS 8ed4b4242123404f86485ec57dc34e88 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:45992
I20240502 01:59:44.106973 29869 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.107975 30922 tablet_replica.cc:330] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88: stopping tablet replica
I20240502 01:59:44.108152 30922 raft_consensus.cc:2229] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:44.108440 30922 raft_consensus.cc:2258] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:44.110673 28533 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.113386 30922 ts_tablet_manager.cc:1875] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:44.115114 30922 ts_tablet_manager.cc:1888] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:44.115185 30922 log.cc:1196] T 98464434decb46a9810c228f92a41732 P 8ed4b4242123404f86485ec57dc34e88: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal/wals/98464434decb46a9810c228f92a41732
I20240502 01:59:44.115703 27563 catalog_manager.cc:4830] TS 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567): tablet 98464434decb46a9810c228f92a41732 (table rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]) successfully deleted
I20240502 01:59:44.123510 28132 raft_consensus.cc:2932] T 98464434decb46a9810c228f92a41732 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:44.130870 28264 consensus_queue.cc:237] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:44.132568 27996 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.132591 28132 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.132746 27862 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.132886 28533 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.132942 28400 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.133293 27728 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.133363 30930 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.133608 30931 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.134913 30932 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.135249 30577 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.135401 30848 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.135815 30930 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.138306 30848 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.138823 27728 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.141240 28132 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.141671 27572 catalog_manager.cc:5484] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:44.141728 28533 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.143111 28400 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.149442 28264 consensus_queue.cc:237] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:44.151146 28132 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.151162 27728 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.151516 30930 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.151647 30577 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.152312 27996 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.153431 28400 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.154250 27996 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.154762 30848 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.154896 28533 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.155038 30848 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.155280 30848 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.156771 27863 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.157332 30930 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.158277 27863 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.158624 30932 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.158923 28400 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.160841 27863 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.160950 27728 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.161049 28533 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.166905 27578 catalog_manager.cc:5484] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.167551 27563 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 9ee07ceb106a46778d215684d8fac8da with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:44.167939 28132 consensus_queue.cc:237] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:44.168144 28130 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.173758 27996 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.174172 27863 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.174217 30439 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.174577 28400 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.174577 30439 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.174912 30439 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.175419 27728 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.175503 28533 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.177567 28264 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.178301 27996 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
W20240502 01:59:44.178469 28200 consensus_peers.cc:485] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 -> Peer 845294d663994245b540c006dca93b7d (127.10.133.202:45645): Couldn't send request to peer 845294d663994245b540c006dca93b7d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ee07ceb106a46778d215684d8fac8da. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:44.180230 30439 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.180424 30952 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.180867 30439 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.181265 30439 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.183203 27862 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.183974 27574 catalog_manager.cc:5484] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "82e8cba6ed104c2c9869ea0365bbe482" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:44.185889 28400 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.186120 27996 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.186733 27728 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.190575 28533 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.191872 28132 consensus_queue.cc:237] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:44.191833 28264 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.195436 28400 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.196437 28533 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.196604 27862 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.196576 30439 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.196882 30439 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.197204 27728 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.197510 27996 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.198017 30439 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.198195 30952 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.198856 28264 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.199824 30952 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.200621 30439 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.201109 30952 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.201418 28533 consensus_queue.cc:237] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:44.201654 27862 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.203562 28265 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.203610 27862 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.203877 27996 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.203969 30730 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.204632 27579 catalog_manager.cc:5484] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New cstate: current_term: 1 leader_uuid: "82e8cba6ed104c2c9869ea0365bbe482" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.204895 30728 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.205627 27728 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.206158 28264 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.206792 28132 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.206924 30729 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.207299 27563 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
W20240502 01:59:44.207374 28066 consensus_peers.cc:485] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 -> Peer 845294d663994245b540c006dca93b7d (127.10.133.202:45645): Couldn't send request to peer 845294d663994245b540c006dca93b7d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86eb15ad9b1b4ee6ab734cdbb972d5d3. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:44.207832 30730 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.207933 28399 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.208158 30730 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.208720 28400 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.209025 28533 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.209198 30728 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.211541 27727 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.213961 30728 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.214253 27996 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.216794 27862 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.216939 28132 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.216939 27727 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.218235 28399 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.219301 27996 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.221431 27575 catalog_manager.cc:5484] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.223853 28264 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.226786 28533 consensus_queue.cc:237] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:44.228713 28132 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.228858 28399 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.229243 30728 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.229621 27996 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.230360 30343 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.230713 30343 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.230741 28265 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.230894 27727 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.231253 30728 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.231545 30729 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.232699 27862 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.233755 30729 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.234632 30728 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.235181 28132 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.237159 28399 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.237457 27565 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 0883c95dc88f4fb4a7a715c23fb7f078 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:44.237705 27727 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.238350 27996 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.239207 27574 catalog_manager.cc:5484] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:44.240391 27862 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
W20240502 01:59:44.243144 28468 consensus_peers.cc:485] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb -> Peer 845294d663994245b540c006dca93b7d (127.10.133.202:45645): Couldn't send request to peer 845294d663994245b540c006dca93b7d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0883c95dc88f4fb4a7a715c23fb7f078. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:44.243466 28264 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.327200 31018 ts_tablet_manager.cc:902] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: Initiating tablet copy from peer da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835)
I20240502 01:59:44.328017 31018 tablet_copy_client.cc:308] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:40835
I20240502 01:59:44.331254 27749 tablet_copy_service.cc:140] P da58b5341d344efd833502f214e69ff1: Received BeginTabletCopySession request for tablet 110a6faea0904da9970934cb2aba94c6 from peer 845294d663994245b540c006dca93b7d ({username='slave'} at 127.10.133.202:52171)
I20240502 01:59:44.331352 27749 tablet_copy_service.cc:161] P da58b5341d344efd833502f214e69ff1: Beginning new tablet copy session on tablet 110a6faea0904da9970934cb2aba94c6 from peer 845294d663994245b540c006dca93b7d at {username='slave'} at 127.10.133.202:52171: session id = 845294d663994245b540c006dca93b7d-110a6faea0904da9970934cb2aba94c6
I20240502 01:59:44.332190 27749 tablet_copy_source_session.cc:205] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:44.335279 31018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 110a6faea0904da9970934cb2aba94c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:44.341686 31018 tablet_copy_client.cc:783] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:44.341933 31018 tablet_copy_client.cc:647] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:44.343297 31018 tablet_copy_client.cc:523] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:44.344851 31018 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: Bootstrap starting.
I20240502 01:59:44.350405 31018 log.cc:824] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: Log is configured to *not* fsync() on all Append() calls
I20240502 01:59:44.373034 31018 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:44.373499 31018 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: Bootstrap complete.
I20240502 01:59:44.373822 31018 ts_tablet_manager.cc:1367] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: Time spent bootstrapping tablet: real 0.029s user 0.026s sys 0.004s
I20240502 01:59:44.376019 31018 raft_consensus.cc:348] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:44.376233 31018 raft_consensus.cc:729] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 845294d663994245b540c006dca93b7d, State: Initialized, Role: LEARNER
I20240502 01:59:44.376530 31018 consensus_queue.cc:260] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:44.377318 31018 ts_tablet_manager.cc:1398] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20240502 01:59:44.377895 27749 tablet_copy_service.cc:342] P da58b5341d344efd833502f214e69ff1: Request end of tablet copy session 845294d663994245b540c006dca93b7d-110a6faea0904da9970934cb2aba94c6 received from {username='slave'} at 127.10.133.202:52171
I20240502 01:59:44.377997 27749 tablet_copy_service.cc:433] P da58b5341d344efd833502f214e69ff1: ending tablet copy session 845294d663994245b540c006dca93b7d-110a6faea0904da9970934cb2aba94c6 on tablet 110a6faea0904da9970934cb2aba94c6 with peer 845294d663994245b540c006dca93b7d
I20240502 01:59:44.502388 27862 consensus_queue.cc:237] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:44.504532 27996 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.504758 27727 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.504954 30914 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.505210 28533 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.505553 30914 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.505668 28399 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.506139 30914 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.506639 28132 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.506767 28264 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.507179 30914 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.507372 30369 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.507580 30754 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.508997 30757 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.509479 28399 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.509860 28533 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.511371 27727 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.512270 27996 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.512441 27572 catalog_manager.cc:5484] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:44.516201 27862 consensus_queue.cc:237] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:44.517720 28399 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.518241 30754 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.518369 27998 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.519143 30754 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.519275 28533 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.519804 30754 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20240502 01:59:44.520862 27795 consensus_peers.cc:485] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 -> Peer 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201:40597): Couldn't send request to peer 7332064716f04e84ba81c1f2b70821f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dc0c5e7b20cd4fb8ac78ae2bff4f8187. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:44.520879 28264 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.521142 27727 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.521569 30754 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.522855 28265 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.524407 30369 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:44.524773 28399 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:44.525972 30369 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.527077 27564 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:44.526985 28265 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:44.527516 27998 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:44.529037 27572 catalog_manager.cc:5484] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:44.529103 28533 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:44.530354 28130 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.530912 27727 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:44.531914 30459 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.532796 28130 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:44.534404 28130 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:44.539981 27727 consensus_queue.cc:237] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:44.541632 28399 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.541632 28533 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.541685 27998 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.542063 30815 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.542165 28265 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.542204 30410 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.542582 30410 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.542682 27862 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.543112 30410 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.544241 30819 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.544615 28130 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.545209 30410 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.546002 30818 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:44.546577 27862 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:44.546898 28533 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:44.549393 27579 catalog_manager.cc:5484] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:44.549623 28130 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:44.550467 27998 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:44.552997 28400 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:44.554970 31018 ts_tablet_manager.cc:902] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d: Initiating tablet copy from peer 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567)
I20240502 01:59:44.555471 31018 tablet_copy_client.cc:308] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.197:46567
I20240502 01:59:44.558595 28265 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:44.560328 28288 tablet_copy_service.cc:140] P 8ed4b4242123404f86485ec57dc34e88: Received BeginTabletCopySession request for tablet 9ee07ceb106a46778d215684d8fac8da from peer 845294d663994245b540c006dca93b7d ({username='slave'} at 127.10.133.202:34859)
I20240502 01:59:44.560460 28288 tablet_copy_service.cc:161] P 8ed4b4242123404f86485ec57dc34e88: Beginning new tablet copy session on tablet 9ee07ceb106a46778d215684d8fac8da from peer 845294d663994245b540c006dca93b7d at {username='slave'} at 127.10.133.202:34859: session id = 845294d663994245b540c006dca93b7d-9ee07ceb106a46778d215684d8fac8da
I20240502 01:59:44.562083 28288 tablet_copy_source_session.cc:205] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:44.563007 27862 consensus_queue.cc:237] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:44.563124 27727 consensus_queue.cc:237] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:44.563432 31018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ee07ceb106a46778d215684d8fac8da. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:44.564666 28533 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.565496 28399 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.565604 30755 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.565755 27998 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.566190 28265 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.566424 30755 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.566615 30756 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.566736 28132 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.566864 31018 tablet_copy_client.cc:783] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:44.567035 31018 tablet_copy_client.cc:647] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:44.567624 27998 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.567643 28535 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.568017 30817 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.568128 30669 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.568750 28400 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.569079 28130 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.569293 30817 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.569411 27727 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:44.569746 27862 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
W20240502 01:59:44.569788 27662 consensus_peers.cc:485] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 -> Peer 845294d663994245b540c006dca93b7d (127.10.133.202:45645): Couldn't send request to peer 845294d663994245b540c006dca93b7d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3b192861d915430e8f027be85d7d00b6. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:44.570127 30756 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.570128 30669 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.570701 28265 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.570923 30756 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.571190 30669 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.571516 30669 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.571744 30756 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.572717 31018 tablet_copy_client.cc:523] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:44.574154 31018 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d: Bootstrap starting.
I20240502 01:59:44.575459 30755 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:44.576881 28400 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:44.577333 30817 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.577970 28264 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:44.578596 28132 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:44.579911 27565 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 3b192861d915430e8f027be85d7d00b6 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:44.580740 27575 catalog_manager.cc:5484] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:44.581611 28535 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.581645 27863 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.582399 27998 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.580741 27572 catalog_manager.cc:5484] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:44.587494 28130 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.588842 27862 consensus_queue.cc:237] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:44.590088 28399 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:44.590286 28265 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
W20240502 01:59:44.593827 27795 consensus_peers.cc:485] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 -> Peer 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201:40597): Couldn't send request to peer 7332064716f04e84ba81c1f2b70821f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e28491b849646a08325fb239f64542c. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:44.594247 28130 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.594904 28399 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.595254 28265 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.595331 30758 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.595546 30756 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.595841 30758 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:44.598742 27998 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.598917 30755 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:44.599486 30756 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.599375 28130 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:44.600248 27998 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:44.600793 27564 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 8e28491b849646a08325fb239f64542c with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:44.601392 28399 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:44.602362 28535 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.602631 28265 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:44.603204 30755 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.603680 27579 catalog_manager.cc:5484] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482 reported cstate change: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:44.603946 28535 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:44.605499 28535 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:44.607479 27998 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:44.610889 27728 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:44.612046 30758 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:44.612758 27728 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:44.614698 27728 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:44.626175 31073 ts_tablet_manager.cc:902] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d: Initiating tablet copy from peer 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553)
I20240502 01:59:44.626713 31073 tablet_copy_client.cc:308] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.196:41553
I20240502 01:59:44.631382 28154 tablet_copy_service.cc:140] P 82e8cba6ed104c2c9869ea0365bbe482: Received BeginTabletCopySession request for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3 from peer 845294d663994245b540c006dca93b7d ({username='slave'} at 127.10.133.202:49983)
I20240502 01:59:44.631531 28154 tablet_copy_service.cc:161] P 82e8cba6ed104c2c9869ea0365bbe482: Beginning new tablet copy session on tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3 from peer 845294d663994245b540c006dca93b7d at {username='slave'} at 127.10.133.202:49983: session id = 845294d663994245b540c006dca93b7d-86eb15ad9b1b4ee6ab734cdbb972d5d3
I20240502 01:59:44.632910 28154 tablet_copy_source_session.cc:205] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:44.634218 31073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:44.637001 31073 tablet_copy_client.cc:783] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:44.637352 31073 tablet_copy_client.cc:647] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:44.639899 31073 tablet_copy_client.cc:523] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:44.641491 31073 tablet_bootstrap.cc:492] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d: Bootstrap starting.
I20240502 01:59:44.645349 31018 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:44.645592 31018 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d: Bootstrap complete.
I20240502 01:59:44.645767 31018 ts_tablet_manager.cc:1367] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d: Time spent bootstrapping tablet: real 0.072s user 0.025s sys 0.000s
I20240502 01:59:44.646467 31018 raft_consensus.cc:348] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:44.646610 31018 raft_consensus.cc:729] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 845294d663994245b540c006dca93b7d, State: Initialized, Role: LEARNER
I20240502 01:59:44.646703 31018 consensus_queue.cc:260] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:44.646996 31018 ts_tablet_manager.cc:1398] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 01:59:44.647624 28288 tablet_copy_service.cc:342] P 8ed4b4242123404f86485ec57dc34e88: Request end of tablet copy session 845294d663994245b540c006dca93b7d-9ee07ceb106a46778d215684d8fac8da received from {username='slave'} at 127.10.133.202:34859
I20240502 01:59:44.647735 28288 tablet_copy_service.cc:433] P 8ed4b4242123404f86485ec57dc34e88: ending tablet copy session 845294d663994245b540c006dca93b7d-9ee07ceb106a46778d215684d8fac8da on tablet 9ee07ceb106a46778d215684d8fac8da with peer 845294d663994245b540c006dca93b7d
I20240502 01:59:44.666397 31073 tablet_bootstrap.cc:492] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:44.666736 31073 tablet_bootstrap.cc:492] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d: Bootstrap complete.
I20240502 01:59:44.666957 31073 ts_tablet_manager.cc:1367] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d: Time spent bootstrapping tablet: real 0.026s user 0.019s sys 0.004s
I20240502 01:59:44.667479 31073 raft_consensus.cc:348] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:44.667626 31073 raft_consensus.cc:729] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 845294d663994245b540c006dca93b7d, State: Initialized, Role: LEARNER
I20240502 01:59:44.667760 31073 consensus_queue.cc:260] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:44.668115 31073 ts_tablet_manager.cc:1398] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:44.670240 28154 tablet_copy_service.cc:342] P 82e8cba6ed104c2c9869ea0365bbe482: Request end of tablet copy session 845294d663994245b540c006dca93b7d-86eb15ad9b1b4ee6ab734cdbb972d5d3 received from {username='slave'} at 127.10.133.202:49983
I20240502 01:59:44.670331 28154 tablet_copy_service.cc:433] P 82e8cba6ed104c2c9869ea0365bbe482: ending tablet copy session 845294d663994245b540c006dca93b7d-86eb15ad9b1b4ee6ab734cdbb972d5d3 on tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3 with peer 845294d663994245b540c006dca93b7d
I20240502 01:59:44.838964 31073 ts_tablet_manager.cc:902] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d: Initiating tablet copy from peer 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:44.839473 31073 tablet_copy_client.cc:308] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.199:35629
I20240502 01:59:44.842682 28555 tablet_copy_service.cc:140] P 257826b7ad7e4abb8499b6687e8c83eb: Received BeginTabletCopySession request for tablet 0883c95dc88f4fb4a7a715c23fb7f078 from peer 845294d663994245b540c006dca93b7d ({username='slave'} at 127.10.133.202:57109)
I20240502 01:59:44.842777 28555 tablet_copy_service.cc:161] P 257826b7ad7e4abb8499b6687e8c83eb: Beginning new tablet copy session on tablet 0883c95dc88f4fb4a7a715c23fb7f078 from peer 845294d663994245b540c006dca93b7d at {username='slave'} at 127.10.133.202:57109: session id = 845294d663994245b540c006dca93b7d-0883c95dc88f4fb4a7a715c23fb7f078
I20240502 01:59:44.843459 28555 tablet_copy_source_session.cc:205] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:44.844276 31073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0883c95dc88f4fb4a7a715c23fb7f078. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:44.846069 31073 tablet_copy_client.cc:783] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:44.846217 31073 tablet_copy_client.cc:647] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:44.847237 31073 tablet_copy_client.cc:523] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:44.848217 31073 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d: Bootstrap starting.
I20240502 01:59:44.866168 31073 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:44.866436 31073 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d: Bootstrap complete.
I20240502 01:59:44.866612 31073 ts_tablet_manager.cc:1367] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d: Time spent bootstrapping tablet: real 0.018s user 0.019s sys 0.000s
I20240502 01:59:44.867002 31073 raft_consensus.cc:348] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:44.867142 31073 raft_consensus.cc:729] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 845294d663994245b540c006dca93b7d, State: Initialized, Role: LEARNER
I20240502 01:59:44.867262 31073 consensus_queue.cc:260] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:44.867539 31073 ts_tablet_manager.cc:1398] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:44.868182 28555 tablet_copy_service.cc:342] P 257826b7ad7e4abb8499b6687e8c83eb: Request end of tablet copy session 845294d663994245b540c006dca93b7d-0883c95dc88f4fb4a7a715c23fb7f078 received from {username='slave'} at 127.10.133.202:57109
I20240502 01:59:44.868253 28555 tablet_copy_service.cc:433] P 257826b7ad7e4abb8499b6687e8c83eb: ending tablet copy session 845294d663994245b540c006dca93b7d-0883c95dc88f4fb4a7a715c23fb7f078 on tablet 0883c95dc88f4fb4a7a715c23fb7f078 with peer 845294d663994245b540c006dca93b7d
I20240502 01:59:44.884905 30146 raft_consensus.cc:1203] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:45.013108 30146 raft_consensus.cc:1203] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:45.026232 31073 ts_tablet_manager.cc:902] T 3b192861d915430e8f027be85d7d00b6 P 845294d663994245b540c006dca93b7d: Initiating tablet copy from peer da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835)
I20240502 01:59:45.026723 31073 tablet_copy_client.cc:308] T 3b192861d915430e8f027be85d7d00b6 P 845294d663994245b540c006dca93b7d: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:40835
I20240502 01:59:45.027191 27749 tablet_copy_service.cc:140] P da58b5341d344efd833502f214e69ff1: Received BeginTabletCopySession request for tablet 3b192861d915430e8f027be85d7d00b6 from peer 845294d663994245b540c006dca93b7d ({username='slave'} at 127.10.133.202:52171)
I20240502 01:59:45.027293 27749 tablet_copy_service.cc:161] P da58b5341d344efd833502f214e69ff1: Beginning new tablet copy session on tablet 3b192861d915430e8f027be85d7d00b6 from peer 845294d663994245b540c006dca93b7d at {username='slave'} at 127.10.133.202:52171: session id = 845294d663994245b540c006dca93b7d-3b192861d915430e8f027be85d7d00b6
I20240502 01:59:45.028146 27749 tablet_copy_source_session.cc:205] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:45.028894 31073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b192861d915430e8f027be85d7d00b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:45.030661 31073 tablet_copy_client.cc:783] T 3b192861d915430e8f027be85d7d00b6 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:45.030802 31073 tablet_copy_client.cc:647] T 3b192861d915430e8f027be85d7d00b6 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:45.031836 31073 tablet_copy_client.cc:523] T 3b192861d915430e8f027be85d7d00b6 P 845294d663994245b540c006dca93b7d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:45.032809 31073 tablet_bootstrap.cc:492] T 3b192861d915430e8f027be85d7d00b6 P 845294d663994245b540c006dca93b7d: Bootstrap starting.
I20240502 01:59:45.050626 31073 tablet_bootstrap.cc:492] T 3b192861d915430e8f027be85d7d00b6 P 845294d663994245b540c006dca93b7d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:45.050877 31073 tablet_bootstrap.cc:492] T 3b192861d915430e8f027be85d7d00b6 P 845294d663994245b540c006dca93b7d: Bootstrap complete.
I20240502 01:59:45.051033 31073 ts_tablet_manager.cc:1367] T 3b192861d915430e8f027be85d7d00b6 P 845294d663994245b540c006dca93b7d: Time spent bootstrapping tablet: real 0.018s user 0.018s sys 0.000s
I20240502 01:59:45.051455 31073 raft_consensus.cc:348] T 3b192861d915430e8f027be85d7d00b6 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:45.051582 31073 raft_consensus.cc:729] T 3b192861d915430e8f027be85d7d00b6 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 845294d663994245b540c006dca93b7d, State: Initialized, Role: LEARNER
I20240502 01:59:45.051668 31073 consensus_queue.cc:260] T 3b192861d915430e8f027be85d7d00b6 P 845294d663994245b540c006dca93b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:45.051911 31073 ts_tablet_manager.cc:1398] T 3b192861d915430e8f027be85d7d00b6 P 845294d663994245b540c006dca93b7d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:45.052381 27749 tablet_copy_service.cc:342] P da58b5341d344efd833502f214e69ff1: Request end of tablet copy session 845294d663994245b540c006dca93b7d-3b192861d915430e8f027be85d7d00b6 received from {username='slave'} at 127.10.133.202:52171
I20240502 01:59:45.052464 27749 tablet_copy_service.cc:433] P da58b5341d344efd833502f214e69ff1: ending tablet copy session 845294d663994245b540c006dca93b7d-3b192861d915430e8f027be85d7d00b6 on tablet 3b192861d915430e8f027be85d7d00b6 with peer 845294d663994245b540c006dca93b7d
I20240502 01:59:45.053628 31155 ts_tablet_manager.cc:902] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9: Initiating tablet copy from peer a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731)
I20240502 01:59:45.054157 31155 tablet_copy_client.cc:308] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37731
I20240502 01:59:45.054652 27885 tablet_copy_service.cc:140] P a8c1908b1c554e7cbbb9bf9751b8ee98: Received BeginTabletCopySession request for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 from peer 7332064716f04e84ba81c1f2b70821f9 ({username='slave'} at 127.10.133.201:33397)
I20240502 01:59:45.054749 27885 tablet_copy_service.cc:161] P a8c1908b1c554e7cbbb9bf9751b8ee98: Beginning new tablet copy session on tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 from peer 7332064716f04e84ba81c1f2b70821f9 at {username='slave'} at 127.10.133.201:33397: session id = 7332064716f04e84ba81c1f2b70821f9-dc0c5e7b20cd4fb8ac78ae2bff4f8187
I20240502 01:59:45.055433 27885 tablet_copy_source_session.cc:205] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:45.056227 31155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:45.058055 31155 tablet_copy_client.cc:783] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:45.058202 31155 tablet_copy_client.cc:647] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:45.059412 31155 tablet_copy_client.cc:523] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:45.060720 31155 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap starting.
I20240502 01:59:45.066566 30146 raft_consensus.cc:1203] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:45.083166 31155 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:45.083448 31155 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap complete.
I20240502 01:59:45.083833 31155 ts_tablet_manager.cc:1367] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9: Time spent bootstrapping tablet: real 0.023s user 0.023s sys 0.000s
I20240502 01:59:45.084240 31155 raft_consensus.cc:348] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:45.084358 31155 raft_consensus.cc:729] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7332064716f04e84ba81c1f2b70821f9, State: Initialized, Role: LEARNER
I20240502 01:59:45.084477 31155 consensus_queue.cc:260] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:45.084805 31155 ts_tablet_manager.cc:1398] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:45.085263 27885 tablet_copy_service.cc:342] P a8c1908b1c554e7cbbb9bf9751b8ee98: Request end of tablet copy session 7332064716f04e84ba81c1f2b70821f9-dc0c5e7b20cd4fb8ac78ae2bff4f8187 received from {username='slave'} at 127.10.133.201:33397
I20240502 01:59:45.085352 27885 tablet_copy_service.cc:433] P a8c1908b1c554e7cbbb9bf9751b8ee98: ending tablet copy session 7332064716f04e84ba81c1f2b70821f9-dc0c5e7b20cd4fb8ac78ae2bff4f8187 on tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 with peer 7332064716f04e84ba81c1f2b70821f9
I20240502 01:59:45.098039 31155 ts_tablet_manager.cc:902] T 8e28491b849646a08325fb239f64542c P 7332064716f04e84ba81c1f2b70821f9: Initiating tablet copy from peer a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731)
I20240502 01:59:45.098574 31155 tablet_copy_client.cc:308] T 8e28491b849646a08325fb239f64542c P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37731
I20240502 01:59:45.099009 27885 tablet_copy_service.cc:140] P a8c1908b1c554e7cbbb9bf9751b8ee98: Received BeginTabletCopySession request for tablet 8e28491b849646a08325fb239f64542c from peer 7332064716f04e84ba81c1f2b70821f9 ({username='slave'} at 127.10.133.201:33397)
I20240502 01:59:45.099123 27885 tablet_copy_service.cc:161] P a8c1908b1c554e7cbbb9bf9751b8ee98: Beginning new tablet copy session on tablet 8e28491b849646a08325fb239f64542c from peer 7332064716f04e84ba81c1f2b70821f9 at {username='slave'} at 127.10.133.201:33397: session id = 7332064716f04e84ba81c1f2b70821f9-8e28491b849646a08325fb239f64542c
I20240502 01:59:45.100090 27885 tablet_copy_source_session.cc:205] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:45.100908 31155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e28491b849646a08325fb239f64542c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:45.102707 31155 tablet_copy_client.cc:783] T 8e28491b849646a08325fb239f64542c P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:45.102960 31155 tablet_copy_client.cc:647] T 8e28491b849646a08325fb239f64542c P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:45.104053 31155 tablet_copy_client.cc:523] T 8e28491b849646a08325fb239f64542c P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:45.105276 31155 tablet_bootstrap.cc:492] T 8e28491b849646a08325fb239f64542c P 7332064716f04e84ba81c1f2b70821f9: Bootstrap starting.
I20240502 01:59:45.128651 31155 tablet_bootstrap.cc:492] T 8e28491b849646a08325fb239f64542c P 7332064716f04e84ba81c1f2b70821f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:45.128912 31155 tablet_bootstrap.cc:492] T 8e28491b849646a08325fb239f64542c P 7332064716f04e84ba81c1f2b70821f9: Bootstrap complete.
I20240502 01:59:45.129088 31155 ts_tablet_manager.cc:1367] T 8e28491b849646a08325fb239f64542c P 7332064716f04e84ba81c1f2b70821f9: Time spent bootstrapping tablet: real 0.024s user 0.018s sys 0.004s
I20240502 01:59:45.129498 31155 raft_consensus.cc:348] T 8e28491b849646a08325fb239f64542c P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:45.129618 31155 raft_consensus.cc:729] T 8e28491b849646a08325fb239f64542c P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7332064716f04e84ba81c1f2b70821f9, State: Initialized, Role: LEARNER
I20240502 01:59:45.129863 31155 consensus_queue.cc:260] T 8e28491b849646a08325fb239f64542c P 7332064716f04e84ba81c1f2b70821f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:45.130228 31155 ts_tablet_manager.cc:1398] T 8e28491b849646a08325fb239f64542c P 7332064716f04e84ba81c1f2b70821f9: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20240502 01:59:45.130661 27885 tablet_copy_service.cc:342] P a8c1908b1c554e7cbbb9bf9751b8ee98: Request end of tablet copy session 7332064716f04e84ba81c1f2b70821f9-8e28491b849646a08325fb239f64542c received from {username='slave'} at 127.10.133.201:33397
I20240502 01:59:45.130745 27885 tablet_copy_service.cc:433] P a8c1908b1c554e7cbbb9bf9751b8ee98: ending tablet copy session 7332064716f04e84ba81c1f2b70821f9-8e28491b849646a08325fb239f64542c on tablet 8e28491b849646a08325fb239f64542c with peer 7332064716f04e84ba81c1f2b70821f9
I20240502 01:59:45.367015 30146 raft_consensus.cc:1203] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:45.471387 30146 raft_consensus.cc:1203] T 3b192861d915430e8f027be85d7d00b6 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:45.500975 31162 raft_consensus.cc:1050] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88: attempting to promote NON_VOTER 845294d663994245b540c006dca93b7d to VOTER
I20240502 01:59:45.501520 31162 consensus_queue.cc:237] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:45.503525 28533 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.503573 27862 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.503747 27728 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.503943 28399 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.504000 27998 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.504098 30146 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.504606 31242 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.504703 28130 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.504834 31245 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.505012 30939 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.505226 31162 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.505486 31242 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.505630 31246 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.506628 30939 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.510154 30818 raft_consensus.cc:1050] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1: attempting to promote NON_VOTER 845294d663994245b540c006dca93b7d to VOTER
I20240502 01:59:45.510059 31245 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.510748 30818 consensus_queue.cc:237] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:45.511674 27728 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.511658 28533 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.514022 28130 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.514037 28399 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.515895 28400 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.516423 27998 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.516705 27578 catalog_manager.cc:5484] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.516464 30146 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.518136 27863 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.518448 27862 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.519667 30146 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.520076 28265 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.520723 27996 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.514022 28132 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.520860 31261 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20240502 01:59:45.522313 28533 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.522383 30818 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.522541 31258 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.522576 30010 raft_consensus.cc:1203] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:45.522717 30427 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.523064 30818 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.523217 31240 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.523671 31240 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.527611 30010 raft_consensus.cc:1203] T 8e28491b849646a08325fb239f64542c P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:45.529188 31240 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.530848 27862 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.530867 30146 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.531648 28265 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.534319 28265 consensus_queue.cc:237] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:45.534814 28400 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.535650 28533 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.535907 27579 catalog_manager.cc:5484] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.538194 27996 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.538913 28533 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.539036 31244 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.539852 28130 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.539986 27728 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.540429 31244 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.540517 30954 raft_consensus.cc:1050] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482: attempting to promote NON_VOTER 845294d663994245b540c006dca93b7d to VOTER
I20240502 01:59:45.540556 31246 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.541076 30954 consensus_queue.cc:237] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:45.542997 27862 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.543453 30146 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.544003 31243 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.544152 31246 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.544260 28263 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.544100 28130 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.544550 31243 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.545820 31161 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.546419 27727 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.546221 27996 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.546675 27563 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 9ee07ceb106a46778d215684d8fac8da with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:45.546646 28535 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.547082 27727 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.548966 27863 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.549222 30145 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.549714 31281 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.550164 31281 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.550163 27996 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.550230 28130 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.551075 27997 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.553001 28400 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.553273 30146 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.553550 28533 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.554163 30954 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.554522 30954 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.554908 30954 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.555042 27862 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.555236 30954 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.555563 30954 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.560596 30954 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.560653 27570 catalog_manager.cc:5484] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 6 to 7, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:45.561304 27727 consensus_queue.cc:237] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:45.563237 28399 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.563189 27863 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.563228 27998 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.563606 28263 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.564347 27862 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.564613 31272 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.565058 30145 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.565802 27998 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.567333 28263 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.567456 28535 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.568878 31258 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.569878 31258 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.570427 31240 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.570766 31257 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.570955 28533 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.571290 31257 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.573057 31240 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.573457 28380 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ee07ceb106a46778d215684d8fac8da with delete_type TABLET_DATA_TOMBSTONED (TS 12f527e76eff4669924a898d5029e3d1 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:33400
I20240502 01:59:45.573660 27575 catalog_manager.cc:5484] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 reported cstate change: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "82e8cba6ed104c2c9869ea0365bbe482" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:45.570788 27727 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.576381 30145 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.576870 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 110a6faea0904da9970934cb2aba94c6 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:45.578223 28535 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.578341 28401 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.581820 27571 catalog_manager.cc:5484] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.582180 31290 tablet_replica.cc:330] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1: stopping tablet replica
I20240502 01:59:45.582307 31290 raft_consensus.cc:2229] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:45.582473 31290 raft_consensus.cc:2258] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:45.582471 27862 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.583089 31290 ts_tablet_manager.cc:1875] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:45.585693 27998 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.587682 31290 ts_tablet_manager.cc:1888] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:45.587798 31290 log.cc:1196] T 9ee07ceb106a46778d215684d8fac8da P 12f527e76eff4669924a898d5029e3d1: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal/wals/9ee07ceb106a46778d215684d8fac8da
I20240502 01:59:45.588587 27566 catalog_manager.cc:4830] TS 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921): tablet 9ee07ceb106a46778d215684d8fac8da (table rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]) successfully deleted
I20240502 01:59:45.589609 28112 tablet_service.cc:1514] Processing DeleteTablet for tablet 110a6faea0904da9970934cb2aba94c6 with delete_type TABLET_DATA_TOMBSTONED (TS 82e8cba6ed104c2c9869ea0365bbe482 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:53288
I20240502 01:59:45.590164 28263 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.593461 28400 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.595204 30146 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.599136 28130 consensus_queue.cc:237] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:45.600986 27728 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.601037 28533 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.601356 31291 tablet_replica.cc:330] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482: stopping tablet replica
I20240502 01:59:45.601536 31291 raft_consensus.cc:2229] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:45.601974 28400 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.602123 30146 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.602293 31291 raft_consensus.cc:2258] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:45.602474 31280 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.603013 27862 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.603137 31291 ts_tablet_manager.cc:1875] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:45.603351 31281 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.603518 31279 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.603710 31282 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.603886 31275 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.605762 31291 ts_tablet_manager.cc:1888] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:45.605846 31291 log.cc:1196] T 110a6faea0904da9970934cb2aba94c6 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/110a6faea0904da9970934cb2aba94c6
I20240502 01:59:45.606395 27563 catalog_manager.cc:4830] TS 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553): tablet 110a6faea0904da9970934cb2aba94c6 (table rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]) successfully deleted
I20240502 01:59:45.607520 27998 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.607779 31282 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.608000 31279 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.608106 28533 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.608489 27862 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.609901 27998 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.610839 27728 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.611369 27563 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:45.611344 27572 catalog_manager.cc:5484] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New cstate: current_term: 1 leader_uuid: "82e8cba6ed104c2c9869ea0365bbe482" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.611721 28400 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.614921 28246 tablet_service.cc:1514] Processing DeleteTablet for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3 with delete_type TABLET_DATA_TOMBSTONED (TS 8ed4b4242123404f86485ec57dc34e88 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:45992
I20240502 01:59:45.615288 31296 tablet_replica.cc:330] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88: stopping tablet replica
I20240502 01:59:45.615451 31296 raft_consensus.cc:2229] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:45.615757 31296 raft_consensus.cc:2258] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:45.616221 30146 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.617166 31296 ts_tablet_manager.cc:1875] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:45.619446 31296 ts_tablet_manager.cc:1888] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:45.619577 31296 log.cc:1196] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 8ed4b4242123404f86485ec57dc34e88: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal/wals/86eb15ad9b1b4ee6ab734cdbb972d5d3
I20240502 01:59:45.620110 27563 catalog_manager.cc:4830] TS 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567): tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3 (table rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]) successfully deleted
I20240502 01:59:45.865034 27728 consensus_queue.cc:237] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } }
I20240502 01:59:45.866888 27998 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:45.866919 28533 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:45.867080 28400 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:45.867363 28130 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:45.867467 27862 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:45.867630 31257 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:45.868012 28263 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:45.868189 31256 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:45.868578 30818 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:45.869098 30818 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:45.869244 31256 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:45.869819 30818 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:45.871989 30818 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:45.872954 28533 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:45.873365 27862 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:45.874708 28130 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:45.875222 27998 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:45.876367 27574 catalog_manager.cc:5484] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:45.877931 28263 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:45.878494 28400 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } }
I20240502 01:59:45.882732 27728 consensus_queue.cc:237] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:45.885061 28533 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:45.885310 28130 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:45.885416 28263 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:45.885605 31258 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:45.886315 27862 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:45.886395 27998 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:45.886811 31258 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:45.887535 31261 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20240502 01:59:45.888231 27662 consensus_peers.cc:485] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 -> Peer 0003837e2d88424093594ed169d82cd2 (127.10.133.200:45585): Couldn't send request to peer 0003837e2d88424093594ed169d82cd2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7ccc60565e9447b8ab77927061813e5. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:45.888592 31259 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:45.888942 31259 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:45.890015 28400 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:45.890478 31258 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:45.891757 31259 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:45.892103 27862 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:45.894009 28400 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:45.894277 27565 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet f7ccc60565e9447b8ab77927061813e5 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:45.895757 27578 catalog_manager.cc:5484] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:45.897094 27998 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:45.898237 28533 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:45.900287 28130 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:45.902596 28263 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:45.935312 30758 raft_consensus.cc:1050] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98: attempting to promote NON_VOTER 7332064716f04e84ba81c1f2b70821f9 to VOTER
I20240502 01:59:45.935755 30758 consensus_queue.cc:237] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:45.937489 28130 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.937793 28533 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.937868 27728 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.938068 28400 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.938155 30010 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.938158 28263 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.938550 31368 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.938776 31366 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.938974 30758 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.939077 27998 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.939119 30755 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.939536 31366 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.939913 31240 raft_consensus.cc:1050] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1: attempting to promote NON_VOTER 845294d663994245b540c006dca93b7d to VOTER
I20240502 01:59:45.940034 31366 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.940341 31366 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.940469 31240 consensus_queue.cc:237] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:45.942353 28132 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.942890 31257 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.943531 28400 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.943997 27998 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.944013 31259 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.944396 28533 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.944809 31259 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.945042 27862 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.945447 30146 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.945717 30427 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.946075 30427 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.946276 31368 raft_consensus.cc:1050] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98: attempting to promote NON_VOTER 7332064716f04e84ba81c1f2b70821f9 to VOTER
I20240502 01:59:45.946385 30818 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.946805 31368 consensus_queue.cc:237] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:45.949043 30010 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.949091 28130 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.949414 28265 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.949447 30756 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.949535 28399 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.950163 27997 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.950248 30756 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.950376 30758 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.950520 31366 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.950917 31209 raft_consensus.cc:1050] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb: attempting to promote NON_VOTER 845294d663994245b540c006dca93b7d to VOTER
I20240502 01:59:45.951293 28264 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.951319 30758 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.951471 31209 consensus_queue.cc:237] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:45.951690 31240 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.953591 31368 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:45.953913 27996 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:45.954358 27727 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.954500 28533 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.954723 30758 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.955010 28399 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.955718 28265 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.956876 30347 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.957226 27578 catalog_manager.cc:5484] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f reported cstate change: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:45.958323 27862 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.958961 28131 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:45.959973 31240 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.960083 28264 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:45.961894 28130 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.962229 28533 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:45.962714 30146 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.963317 28535 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.964309 28399 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:45.964895 30347 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.964900 28400 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.966197 30755 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.966311 27997 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.967072 28130 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.967656 27728 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:45.967903 27725 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:45.968081 27577 catalog_manager.cc:5484] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.968627 30146 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.968688 27862 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.970402 31392 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.970937 30347 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.971244 30347 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.971539 30347 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.972718 31367 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:45.972879 30009 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:45.972926 28264 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.975003 28132 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:45.976284 27996 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:45.977615 30347 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:45.979056 27578 catalog_manager.cc:5484] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f reported cstate change: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:45.979175 28264 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:45.985569 27862 consensus_queue.cc:237] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:45.985530 30009 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:45.986214 27997 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.988219 28132 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.988229 30010 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.988309 28533 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.988656 31368 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.989099 27998 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.988981 28535 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:45.989183 28401 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:45.989614 30756 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.989920 30756 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.992060 30755 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.992244 31368 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:45.992256 28401 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:45.992587 31209 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.993665 30755 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:45.993965 30146 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.995733 28263 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.995891 27574 catalog_manager.cc:5484] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:45.996316 28399 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:45.998376 27564 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:45.998375 27863 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:45.999157 28533 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:45.999938 28132 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:46.000783 27575 catalog_manager.cc:5484] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:46.001787 27998 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:46.003595 28130 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:46.004081 27725 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:46.004380 27727 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:46.005926 27727 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:46.006525 31407 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:46.006662 28246 tablet_service.cc:1514] Processing DeleteTablet for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 with delete_type TABLET_DATA_TOMBSTONED (TS 8ed4b4242123404f86485ec57dc34e88 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:45992
I20240502 01:59:46.006896 31296 tablet_replica.cc:330] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: stopping tablet replica
I20240502 01:59:46.007050 31296 raft_consensus.cc:2229] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:46.007246 31296 raft_consensus.cc:2258] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:46.007962 27863 consensus_queue.cc:237] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:46.008090 27998 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:46.009510 28533 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:46.009397 30010 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:46.009792 28399 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:46.010032 28130 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:46.010232 27997 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:46.010365 30756 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:46.010711 30756 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:46.010885 31383 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:46.011130 27727 consensus_queue.cc:237] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:46.011696 27725 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:46.012058 30008 raft_consensus.cc:1261] T 8e28491b849646a08325fb239f64542c P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:46.012804 28535 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:46.013160 28399 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:46.013697 31240 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:46.013813 30818 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:46.014218 28263 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:46.014930 31240 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:46.015031 30146 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:46.015525 31240 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:46.016023 31368 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:46.017328 31366 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:46.017508 31240 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:46.018098 30755 consensus_queue.cc:1035] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:46.018822 28263 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:46.019135 28535 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:46.021687 30755 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:46.022053 27570 catalog_manager.cc:5484] T 3b192861d915430e8f027be85d7d00b6 P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:46.022135 30008 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:46.022377 27998 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:46.024140 27564 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 8e28491b849646a08325fb239f64542c with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:46.024147 31261 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:46.024098 28399 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:46.021705 27863 raft_consensus.cc:1261] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:46.025200 27998 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:46.025535 31261 consensus_queue.cc:1035] T 3b192861d915430e8f027be85d7d00b6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:46.025439 27725 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:46.026180 28401 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:46.027447 27862 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:46.027658 28533 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:46.029619 28535 consensus_queue.cc:237] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:46.029646 27997 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:46.032625 27728 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:46.032936 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 3b192861d915430e8f027be85d7d00b6 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:46.033172 28112 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b192861d915430e8f027be85d7d00b6 with delete_type TABLET_DATA_TOMBSTONED (TS 82e8cba6ed104c2c9869ea0365bbe482 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:53288
I20240502 01:59:46.033435 31291 tablet_replica.cc:330] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482: stopping tablet replica
I20240502 01:59:46.033581 31291 raft_consensus.cc:2229] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:46.033790 31291 raft_consensus.cc:2258] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:46.034191 30146 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:46.034516 31291 ts_tablet_manager.cc:1875] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:46.034484 27575 catalog_manager.cc:5484] T 8e28491b849646a08325fb239f64542c P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:46.035079 31390 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:46.035610 28263 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:46.035781 28400 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:46.036496 31390 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:46.036737 31291 ts_tablet_manager.cc:1888] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:46.036803 31291 log.cc:1196] T 3b192861d915430e8f027be85d7d00b6 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/3b192861d915430e8f027be85d7d00b6
I20240502 01:59:46.036952 31296 ts_tablet_manager.cc:1875] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:46.037757 31396 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:46.038275 27563 catalog_manager.cc:4830] TS 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553): tablet 3b192861d915430e8f027be85d7d00b6 (table rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]) successfully deleted
I20240502 01:59:46.038200 30146 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:46.039140 31296 ts_tablet_manager.cc:1888] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:46.039212 31296 log.cc:1196] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal/wals/dc0c5e7b20cd4fb8ac78ae2bff4f8187
I20240502 01:59:46.039211 31390 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:46.040405 27563 catalog_manager.cc:4830] TS 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567): tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 (table rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]) successfully deleted
I20240502 01:59:46.041136 27997 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:46.041069 28130 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:46.041739 27862 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:46.041788 28399 raft_consensus.cc:2932] T 3b192861d915430e8f027be85d7d00b6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:46.044323 31394 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:46.045758 31392 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:46.046175 27728 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:46.047634 28246 tablet_service.cc:1514] Processing DeleteTablet for tablet 8e28491b849646a08325fb239f64542c with delete_type TABLET_DATA_TOMBSTONED (TS 8ed4b4242123404f86485ec57dc34e88 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:45992
I20240502 01:59:46.048020 31296 tablet_replica.cc:330] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88: stopping tablet replica
I20240502 01:59:46.048154 31296 raft_consensus.cc:2229] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:46.048316 31296 raft_consensus.cc:2258] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:46.049804 31296 ts_tablet_manager.cc:1875] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:46.050748 27570 catalog_manager.cc:5484] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:46.051963 27727 raft_consensus.cc:2932] T 8e28491b849646a08325fb239f64542c P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:46.052165 31296 ts_tablet_manager.cc:1888] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:46.052229 31296 log.cc:1196] T 8e28491b849646a08325fb239f64542c P 8ed4b4242123404f86485ec57dc34e88: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-4/wal/wals/8e28491b849646a08325fb239f64542c
I20240502 01:59:46.052496 31395 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:46.053350 27563 catalog_manager.cc:4830] TS 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567): tablet 8e28491b849646a08325fb239f64542c (table rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]) successfully deleted
I20240502 01:59:46.053943 30146 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:46.054577 28112 tablet_service.cc:1514] Processing DeleteTablet for tablet 0883c95dc88f4fb4a7a715c23fb7f078 with delete_type TABLET_DATA_TOMBSTONED (TS 82e8cba6ed104c2c9869ea0365bbe482 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:53288
I20240502 01:59:46.054585 27862 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:46.056123 31291 tablet_replica.cc:330] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482: stopping tablet replica
I20240502 01:59:46.056273 31291 raft_consensus.cc:2229] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:46.056463 31291 raft_consensus.cc:2258] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:46.056677 27997 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:46.058209 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 0883c95dc88f4fb4a7a715c23fb7f078 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:46.060389 28263 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:46.061832 28399 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:46.064986 31291 ts_tablet_manager.cc:1875] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:46.066767 31291 ts_tablet_manager.cc:1888] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:46.066844 31291 log.cc:1196] T 0883c95dc88f4fb4a7a715c23fb7f078 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/0883c95dc88f4fb4a7a715c23fb7f078
I20240502 01:59:46.067375 27563 catalog_manager.cc:4830] TS 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553): tablet 0883c95dc88f4fb4a7a715c23fb7f078 (table rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]) successfully deleted
I20240502 01:59:46.368108 27997 consensus_queue.cc:237] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:46.369686 28535 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:46.369870 28399 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:46.370247 27862 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:46.370311 31447 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:46.370491 27728 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:46.370782 28263 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:46.370985 28131 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:46.371026 31447 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:46.371347 30066 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:46.371697 30066 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:46.372011 30066 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:46.372159 31447 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:46.374707 31447 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:46.376690 28131 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:46.376994 28399 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:46.378134 27728 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:46.379540 27577 catalog_manager.cc:5484] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "86e11777d9d744d0a5a8139c99e89f4f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:46.379819 28535 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:46.380551 28263 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:46.382997 27862 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:46.387440 27997 consensus_queue.cc:237] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:46.389242 27728 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:46.389648 31446 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:46.390504 27862 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:46.390609 28131 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:46.390923 31462 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:46.391089 31444 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:46.391139 28399 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:46.391141 28263 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:46.391541 31444 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:46.391719 31445 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:46.393180 28535 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:46.393524 31462 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:46.395386 31445 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:46.396394 28263 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:46.398109 27564 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet dc925cbedd00454dbaa0e6b5e38b94d7 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:46.398928 27574 catalog_manager.cc:5484] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f reported cstate change: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "86e11777d9d744d0a5a8139c99e89f4f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:46.399022 28399 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:46.399564 28535 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:46.401376 27862 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:46.401371 28131 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:46.403159 27728 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
W20240502 01:59:46.410099 27931 consensus_peers.cc:485] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f -> Peer 0003837e2d88424093594ed169d82cd2 (127.10.133.200:45585): Couldn't send request to peer 0003837e2d88424093594ed169d82cd2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dc925cbedd00454dbaa0e6b5e38b94d7. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:46.415063 28399 consensus_queue.cc:237] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:46.417107 28535 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:46.417313 28263 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:46.417313 27862 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:46.417397 27728 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:46.417809 27997 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:46.417833 28131 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:46.418183 31464 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:46.418413 31273 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:46.418561 31467 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:46.418843 31464 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:46.420225 31468 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:46.420923 31464 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:46.422665 31273 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:46.423341 28131 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:46.423547 28264 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:46.423547 27862 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:46.425141 27728 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:46.426805 27570 catalog_manager.cc:5484] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:46.426955 28535 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:46.430683 27997 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:46.433633 28399 consensus_queue.cc:237] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:46.436393 27862 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:46.436944 27728 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:46.437096 28264 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:46.437433 31468 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:46.437620 31467 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:46.437865 31464 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:46.438123 28131 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:46.438162 27997 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:46.438472 31464 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:46.438612 28535 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:46.438782 31464 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:46.440099 31464 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:46.440604 31468 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:46.441323 27728 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:46.443100 28264 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:46.443581 27566 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet b247e3ad657f4661ab40ebd1cc8756b8 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:46.444433 27574 catalog_manager.cc:5484] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:46.445068 28535 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:46.445237 27997 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:46.445290 27862 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:46.454500 28131 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
W20240502 01:59:46.456223 28334 consensus_peers.cc:485] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 -> Peer 0003837e2d88424093594ed169d82cd2 (127.10.133.200:45585): Couldn't send request to peer 0003837e2d88424093594ed169d82cd2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b247e3ad657f4661ab40ebd1cc8756b8. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:46.492493 31491 ts_tablet_manager.cc:902] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2: Initiating tablet copy from peer da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835)
I20240502 01:59:46.492964 31491 tablet_copy_client.cc:308] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:40835
I20240502 01:59:46.493463 27749 tablet_copy_service.cc:140] P da58b5341d344efd833502f214e69ff1: Received BeginTabletCopySession request for tablet f7ccc60565e9447b8ab77927061813e5 from peer 0003837e2d88424093594ed169d82cd2 ({username='slave'} at 127.10.133.200:44783)
I20240502 01:59:46.493561 27749 tablet_copy_service.cc:161] P da58b5341d344efd833502f214e69ff1: Beginning new tablet copy session on tablet f7ccc60565e9447b8ab77927061813e5 from peer 0003837e2d88424093594ed169d82cd2 at {username='slave'} at 127.10.133.200:44783: session id = 0003837e2d88424093594ed169d82cd2-f7ccc60565e9447b8ab77927061813e5
I20240502 01:59:46.494354 27749 tablet_copy_source_session.cc:205] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:46.495302 31491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ccc60565e9447b8ab77927061813e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:46.497152 31491 tablet_copy_client.cc:783] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:46.497304 31491 tablet_copy_client.cc:647] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:46.498409 31491 tablet_copy_client.cc:523] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:46.499724 31491 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2: Bootstrap starting.
I20240502 01:59:46.518458 31491 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:46.518725 31491 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2: Bootstrap complete.
I20240502 01:59:46.518868 31491 ts_tablet_manager.cc:1367] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2: Time spent bootstrapping tablet: real 0.019s user 0.014s sys 0.005s
I20240502 01:59:46.519217 31491 raft_consensus.cc:348] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:46.519332 31491 raft_consensus.cc:729] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0003837e2d88424093594ed169d82cd2, State: Initialized, Role: LEARNER
I20240502 01:59:46.519413 31491 consensus_queue.cc:260] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:46.519778 31491 ts_tablet_manager.cc:1398] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 01:59:46.520263 27749 tablet_copy_service.cc:342] P da58b5341d344efd833502f214e69ff1: Request end of tablet copy session 0003837e2d88424093594ed169d82cd2-f7ccc60565e9447b8ab77927061813e5 received from {username='slave'} at 127.10.133.200:44783
I20240502 01:59:46.520350 27749 tablet_copy_service.cc:433] P da58b5341d344efd833502f214e69ff1: ending tablet copy session 0003837e2d88424093594ed169d82cd2-f7ccc60565e9447b8ab77927061813e5 on tablet f7ccc60565e9447b8ab77927061813e5 with peer 0003837e2d88424093594ed169d82cd2
I20240502 01:59:46.816565 31491 ts_tablet_manager.cc:902] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2: Initiating tablet copy from peer 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917)
I20240502 01:59:46.817059 31491 tablet_copy_client.cc:308] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.195:42917
I20240502 01:59:46.820753 28020 tablet_copy_service.cc:140] P 86e11777d9d744d0a5a8139c99e89f4f: Received BeginTabletCopySession request for tablet dc925cbedd00454dbaa0e6b5e38b94d7 from peer 0003837e2d88424093594ed169d82cd2 ({username='slave'} at 127.10.133.200:37771)
I20240502 01:59:46.820900 28020 tablet_copy_service.cc:161] P 86e11777d9d744d0a5a8139c99e89f4f: Beginning new tablet copy session on tablet dc925cbedd00454dbaa0e6b5e38b94d7 from peer 0003837e2d88424093594ed169d82cd2 at {username='slave'} at 127.10.133.200:37771: session id = 0003837e2d88424093594ed169d82cd2-dc925cbedd00454dbaa0e6b5e38b94d7
I20240502 01:59:46.822242 28020 tablet_copy_source_session.cc:205] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:46.823287 31491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc925cbedd00454dbaa0e6b5e38b94d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:46.825206 31491 tablet_copy_client.cc:783] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:46.825348 31491 tablet_copy_client.cc:647] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:46.826596 31491 tablet_copy_client.cc:523] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:46.827538 31491 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2: Bootstrap starting.
I20240502 01:59:46.845692 31491 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:46.845906 31491 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2: Bootstrap complete.
I20240502 01:59:46.846082 31491 ts_tablet_manager.cc:1367] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2: Time spent bootstrapping tablet: real 0.019s user 0.011s sys 0.008s
I20240502 01:59:46.846452 31491 raft_consensus.cc:348] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:46.846560 31491 raft_consensus.cc:729] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0003837e2d88424093594ed169d82cd2, State: Initialized, Role: LEARNER
I20240502 01:59:46.846662 31491 consensus_queue.cc:260] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:46.846906 31491 ts_tablet_manager.cc:1398] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:46.847399 28020 tablet_copy_service.cc:342] P 86e11777d9d744d0a5a8139c99e89f4f: Request end of tablet copy session 0003837e2d88424093594ed169d82cd2-dc925cbedd00454dbaa0e6b5e38b94d7 received from {username='slave'} at 127.10.133.200:37771
I20240502 01:59:46.847481 28020 tablet_copy_service.cc:433] P 86e11777d9d744d0a5a8139c99e89f4f: ending tablet copy session 0003837e2d88424093594ed169d82cd2-dc925cbedd00454dbaa0e6b5e38b94d7 on tablet dc925cbedd00454dbaa0e6b5e38b94d7 with peer 0003837e2d88424093594ed169d82cd2
I20240502 01:59:46.912552 29870 raft_consensus.cc:1203] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:47.020177 31491 ts_tablet_manager.cc:902] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2: Initiating tablet copy from peer 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921)
I20240502 01:59:47.020704 31491 tablet_copy_client.cc:308] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.198:44921
I20240502 01:59:47.023908 28421 tablet_copy_service.cc:140] P 12f527e76eff4669924a898d5029e3d1: Received BeginTabletCopySession request for tablet b247e3ad657f4661ab40ebd1cc8756b8 from peer 0003837e2d88424093594ed169d82cd2 ({username='slave'} at 127.10.133.200:49319)
I20240502 01:59:47.024009 28421 tablet_copy_service.cc:161] P 12f527e76eff4669924a898d5029e3d1: Beginning new tablet copy session on tablet b247e3ad657f4661ab40ebd1cc8756b8 from peer 0003837e2d88424093594ed169d82cd2 at {username='slave'} at 127.10.133.200:49319: session id = 0003837e2d88424093594ed169d82cd2-b247e3ad657f4661ab40ebd1cc8756b8
I20240502 01:59:47.024706 28421 tablet_copy_source_session.cc:205] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:47.025604 31491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b247e3ad657f4661ab40ebd1cc8756b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:47.027537 31491 tablet_copy_client.cc:783] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:47.027698 31491 tablet_copy_client.cc:647] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:47.028844 31491 tablet_copy_client.cc:523] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:47.029870 31491 tablet_bootstrap.cc:492] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2: Bootstrap starting.
I20240502 01:59:47.049294 31491 tablet_bootstrap.cc:492] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:47.049599 31491 tablet_bootstrap.cc:492] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2: Bootstrap complete.
I20240502 01:59:47.049758 31491 ts_tablet_manager.cc:1367] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2: Time spent bootstrapping tablet: real 0.020s user 0.015s sys 0.001s
I20240502 01:59:47.050182 31491 raft_consensus.cc:348] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:47.050326 31491 raft_consensus.cc:729] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0003837e2d88424093594ed169d82cd2, State: Initialized, Role: LEARNER
I20240502 01:59:47.050452 31491 consensus_queue.cc:260] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:47.051924 31491 ts_tablet_manager.cc:1398] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
I20240502 01:59:47.052420 28421 tablet_copy_service.cc:342] P 12f527e76eff4669924a898d5029e3d1: Request end of tablet copy session 0003837e2d88424093594ed169d82cd2-b247e3ad657f4661ab40ebd1cc8756b8 received from {username='slave'} at 127.10.133.200:49319
I20240502 01:59:47.052521 28421 tablet_copy_service.cc:433] P 12f527e76eff4669924a898d5029e3d1: ending tablet copy session 0003837e2d88424093594ed169d82cd2-b247e3ad657f4661ab40ebd1cc8756b8 on tablet b247e3ad657f4661ab40ebd1cc8756b8 with peer 0003837e2d88424093594ed169d82cd2
I20240502 01:59:47.232196 29870 raft_consensus.cc:1203] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:47.405234 30818 raft_consensus.cc:1050] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1: attempting to promote NON_VOTER 0003837e2d88424093594ed169d82cd2 to VOTER
I20240502 01:59:47.405867 30818 consensus_queue.cc:237] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:47.408216 28535 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.408252 28399 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.408310 28264 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.408675 31240 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.408788 27997 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.408825 27862 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.409085 31575 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.409157 29870 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.409837 28131 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.410338 31576 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.410732 31575 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.411031 31534 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.411342 31534 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.411669 31240 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.414008 31534 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.414639 28131 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.414690 27997 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.416442 28399 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.417301 28535 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.417806 28264 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.418840 27578 catalog_manager.cc:5484] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f reported cstate change: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.421247 27862 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.423065 29870 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.429299 27728 consensus_queue.cc:237] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:47.430990 29870 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:47.431020 28535 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:47.431061 27862 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:47.431531 31575 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:47.431633 28399 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:47.431977 31575 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:47.432508 30818 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:47.432646 31575 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:47.434536 28264 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:47.434677 27997 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:47.434670 31576 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.434968 31240 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:47.435324 31534 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:47.435364 28399 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.436291 28264 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.436393 27997 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.436933 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet f7ccc60565e9447b8ab77927061813e5 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:47.438618 28535 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.439210 27572 catalog_manager.cc:5484] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.440423 29870 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.442812 28112 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ccc60565e9447b8ab77927061813e5 with delete_type TABLET_DATA_TOMBSTONED (TS 82e8cba6ed104c2c9869ea0365bbe482 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:53288
I20240502 01:59:47.444046 27862 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.445937 31588 tablet_replica.cc:330] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: stopping tablet replica
I20240502 01:59:47.446112 31588 raft_consensus.cc:2229] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:47.446312 31588 raft_consensus.cc:2258] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:47.446933 31588 ts_tablet_manager.cc:1875] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:47.448932 31588 ts_tablet_manager.cc:1888] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:47.449010 31588 log.cc:1196] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/f7ccc60565e9447b8ab77927061813e5
I20240502 01:59:47.449527 27563 catalog_manager.cc:4830] TS 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553): tablet f7ccc60565e9447b8ab77927061813e5 (table rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]) successfully deleted
I20240502 01:59:47.473078 29870 raft_consensus.cc:1203] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:47.705957 31556 raft_consensus.cc:1050] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f: attempting to promote NON_VOTER 0003837e2d88424093594ed169d82cd2 to VOTER
I20240502 01:59:47.706511 31556 consensus_queue.cc:237] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:47.708442 28264 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.708451 28535 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.708922 28131 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.709012 29870 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.709010 27863 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.709028 28399 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.709363 31556 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.709517 27728 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.709537 31557 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.709676 31607 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.709962 31445 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.710157 31608 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.710271 31609 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.710867 31606 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.713917 31606 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.714286 28399 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.714581 28264 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.714627 28535 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.716399 29870 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.717690 28131 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.718968 27575 catalog_manager.cc:5484] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86e11777d9d744d0a5a8139c99e89f4f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.720031 27728 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.721486 27863 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.725879 27997 consensus_queue.cc:237] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:47.727713 28399 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:47.727949 29869 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:47.728180 31445 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:47.728346 28264 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:47.728710 28535 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:47.728698 31556 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:47.728796 27863 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:47.729036 31556 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:47.729166 31607 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:47.730118 31609 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:47.730161 27728 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:47.730582 31557 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:47.730878 31608 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.731737 28535 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.733151 27564 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet dc925cbedd00454dbaa0e6b5e38b94d7 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:47.732981 28399 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.733273 28264 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.733376 29869 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.735486 27863 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.736068 27570 catalog_manager.cc:5484] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 reported cstate change: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "86e11777d9d744d0a5a8139c99e89f4f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.737468 27728 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.740094 28112 tablet_service.cc:1514] Processing DeleteTablet for tablet dc925cbedd00454dbaa0e6b5e38b94d7 with delete_type TABLET_DATA_TOMBSTONED (TS 82e8cba6ed104c2c9869ea0365bbe482 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:53288
I20240502 01:59:47.740360 31588 tablet_replica.cc:330] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482: stopping tablet replica
I20240502 01:59:47.740525 31588 raft_consensus.cc:2229] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:47.740749 31588 raft_consensus.cc:2258] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:47.742827 31588 ts_tablet_manager.cc:1875] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:47.744946 31588 ts_tablet_manager.cc:1888] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:47.745008 31588 log.cc:1196] T dc925cbedd00454dbaa0e6b5e38b94d7 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/dc925cbedd00454dbaa0e6b5e38b94d7
I20240502 01:59:47.745584 27563 catalog_manager.cc:4830] TS 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553): tablet dc925cbedd00454dbaa0e6b5e38b94d7 (table rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]) successfully deleted
I20240502 01:59:47.783071 27728 consensus_queue.cc:237] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:47.784873 28535 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:47.784889 28399 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:47.785003 28264 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:47.785374 31575 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:47.785449 27997 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:47.785534 31534 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:47.785861 30818 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:47.786052 27863 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:47.786645 30818 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:47.787099 28131 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:47.787576 30818 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:47.788244 31534 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:47.789743 31534 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:47.790385 27997 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:47.790401 28264 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:47.791332 28535 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:47.792227 27863 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:47.792898 28131 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:47.794514 27571 catalog_manager.cc:5484] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:47.795001 28399 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:47.800093 27728 consensus_queue.cc:237] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:47.801766 27863 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:47.802059 27997 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:47.802120 28535 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:47.802134 28131 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
W20240502 01:59:47.802438 27662 consensus_peers.cc:485] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 -> Peer 845294d663994245b540c006dca93b7d (127.10.133.202:45645): Couldn't send request to peer 845294d663994245b540c006dca93b7d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c23922560934ef3be8f4659d8727995. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:47.802449 30818 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:47.802877 30818 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:47.803138 31576 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:47.803260 30818 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:47.803678 28264 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:47.804333 31575 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:47.805836 31240 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:47.807021 28399 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:47.807075 28131 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:47.807509 30818 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:47.807667 27997 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:47.808621 27565 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 5c23922560934ef3be8f4659d8727995 with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:47.808694 28535 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:47.809597 27577 catalog_manager.cc:5484] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:47.812240 28264 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:47.812438 28399 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:47.812987 27863 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:47.948081 31589 raft_consensus.cc:1050] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1: attempting to promote NON_VOTER 0003837e2d88424093594ed169d82cd2 to VOTER
I20240502 01:59:47.948640 31589 consensus_queue.cc:237] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:47.950570 29869 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.951015 28535 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.951151 28131 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.951375 27728 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.951913 31647 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.952280 31573 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.952811 31573 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.953017 27997 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.953351 31573 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.954936 27863 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.955392 31647 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.955821 31650 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.956583 28264 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:47.957387 31589 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:47.957957 31589 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.959343 28535 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.960227 27997 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.961194 28131 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.961638 27728 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.963477 27572 catalog_manager.cc:5484] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.964454 29869 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.966621 27863 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.967729 28264 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.972280 28399 consensus_queue.cc:237] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:47.973763 27728 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:47.973886 28535 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:47.973892 27863 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:47.974123 29869 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:47.974328 31650 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:47.974861 27997 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:47.975207 28264 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:47.975697 31468 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:47.975860 31648 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:47.976022 31589 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:47.976174 31573 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:47.976416 31647 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:47.978996 31650 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.979617 28535 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.979873 27728 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.981156 27566 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet b247e3ad657f4661ab40ebd1cc8756b8 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:47.981977 29869 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.982146 28264 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.982676 27577 catalog_manager.cc:5484] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.984628 27863 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.985373 28112 tablet_service.cc:1514] Processing DeleteTablet for tablet b247e3ad657f4661ab40ebd1cc8756b8 with delete_type TABLET_DATA_TOMBSTONED (TS 82e8cba6ed104c2c9869ea0365bbe482 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:53288
I20240502 01:59:47.985605 31588 tablet_replica.cc:330] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: stopping tablet replica
I20240502 01:59:47.985772 31588 raft_consensus.cc:2229] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:47.986004 31588 raft_consensus.cc:2258] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:47.986007 27997 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:47.986771 31588 ts_tablet_manager.cc:1875] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:47.989718 31588 ts_tablet_manager.cc:1888] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:47.989805 31588 log.cc:1196] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/b247e3ad657f4661ab40ebd1cc8756b8
I20240502 01:59:47.990515 27563 catalog_manager.cc:4830] TS 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553): tablet b247e3ad657f4661ab40ebd1cc8756b8 (table rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]) successfully deleted
I20240502 01:59:48.035691 28264 consensus_queue.cc:237] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } }
I20240502 01:59:48.037667 28535 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:48.037657 28131 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:48.038130 31555 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:48.038290 27728 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:48.038339 27863 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:48.038811 31555 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:48.039011 31666 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:48.039088 27997 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:48.039319 28399 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20240502 01:59:48.039336 31666 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:48.039455 31555 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:48.039741 31666 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:48.042228 31555 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:48.042878 27863 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:48.044711 27998 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:48.044704 28399 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:48.044763 28535 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:48.045735 27574 catalog_manager.cc:5484] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index -1 to 4. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } }
I20240502 01:59:48.049180 28131 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:48.051613 28264 consensus_queue.cc:237] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:48.053869 27728 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:48.053892 28535 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:48.054291 31681 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20240502 01:59:48.054414 28399 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:48.054791 31666 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:48.055095 31666 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:48.055315 27998 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:48.055483 27863 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:48.055825 31555 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:48.055922 31681 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:48.055999 27728 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index -1 to 4. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } }
I20240502 01:59:48.058502 28131 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20240502 01:59:48.058976 31666 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:48.059103 31668 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20240502 01:59:48.059605 27728 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:48.060073 28131 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:48.062412 27563 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 25d8fba21674442fbd100478245ff9aa with cas_config_opid_index 4: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:48.062479 28399 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:48.062875 28535 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:48.064926 27570 catalog_manager.cc:5484] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 reported cstate change: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:48.067555 27863 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:48.070753 27998 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.5: config changed from index 4 to 5, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
W20240502 01:59:48.072247 28199 consensus_peers.cc:485] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 -> Peer 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201:40597): Couldn't send request to peer 7332064716f04e84ba81c1f2b70821f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 25d8fba21674442fbd100478245ff9aa. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:48.352824 31704 ts_tablet_manager.cc:902] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d: Initiating tablet copy from peer da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835)
I20240502 01:59:48.353401 31704 tablet_copy_client.cc:308] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:40835
I20240502 01:59:48.353920 27749 tablet_copy_service.cc:140] P da58b5341d344efd833502f214e69ff1: Received BeginTabletCopySession request for tablet 5c23922560934ef3be8f4659d8727995 from peer 845294d663994245b540c006dca93b7d ({username='slave'} at 127.10.133.202:52171)
I20240502 01:59:48.354071 27749 tablet_copy_service.cc:161] P da58b5341d344efd833502f214e69ff1: Beginning new tablet copy session on tablet 5c23922560934ef3be8f4659d8727995 from peer 845294d663994245b540c006dca93b7d at {username='slave'} at 127.10.133.202:52171: session id = 845294d663994245b540c006dca93b7d-5c23922560934ef3be8f4659d8727995
I20240502 01:59:48.355093 27749 tablet_copy_source_session.cc:205] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:48.356030 31704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c23922560934ef3be8f4659d8727995. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:48.358280 31704 tablet_copy_client.cc:783] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:48.358436 31704 tablet_copy_client.cc:647] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:48.359606 31704 tablet_copy_client.cc:523] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:48.360860 31704 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d: Bootstrap starting.
I20240502 01:59:48.380520 31704 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:48.380827 31704 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d: Bootstrap complete.
I20240502 01:59:48.381029 31704 ts_tablet_manager.cc:1367] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d: Time spent bootstrapping tablet: real 0.020s user 0.014s sys 0.004s
I20240502 01:59:48.381436 31704 raft_consensus.cc:348] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:48.381543 31704 raft_consensus.cc:729] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 845294d663994245b540c006dca93b7d, State: Initialized, Role: LEARNER
I20240502 01:59:48.381634 31704 consensus_queue.cc:260] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:48.382095 31704 ts_tablet_manager.cc:1398] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d: Time spent starting tablet: real 0.001s user 0.003s sys 0.001s
I20240502 01:59:48.382592 27749 tablet_copy_service.cc:342] P da58b5341d344efd833502f214e69ff1: Request end of tablet copy session 845294d663994245b540c006dca93b7d-5c23922560934ef3be8f4659d8727995 received from {username='slave'} at 127.10.133.202:52171
I20240502 01:59:48.382673 27749 tablet_copy_service.cc:433] P da58b5341d344efd833502f214e69ff1: ending tablet copy session 845294d663994245b540c006dca93b7d-5c23922560934ef3be8f4659d8727995 on tablet 5c23922560934ef3be8f4659d8727995 with peer 845294d663994245b540c006dca93b7d
I20240502 01:59:48.474376 31711 ts_tablet_manager.cc:902] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9: Initiating tablet copy from peer 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567)
I20240502 01:59:48.474864 31711 tablet_copy_client.cc:308] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.197:46567
I20240502 01:59:48.478902 28288 tablet_copy_service.cc:140] P 8ed4b4242123404f86485ec57dc34e88: Received BeginTabletCopySession request for tablet 25d8fba21674442fbd100478245ff9aa from peer 7332064716f04e84ba81c1f2b70821f9 ({username='slave'} at 127.10.133.201:44843)
I20240502 01:59:48.479010 28288 tablet_copy_service.cc:161] P 8ed4b4242123404f86485ec57dc34e88: Beginning new tablet copy session on tablet 25d8fba21674442fbd100478245ff9aa from peer 7332064716f04e84ba81c1f2b70821f9 at {username='slave'} at 127.10.133.201:44843: session id = 7332064716f04e84ba81c1f2b70821f9-25d8fba21674442fbd100478245ff9aa
I20240502 01:59:48.479761 28288 tablet_copy_source_session.cc:205] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:48.480561 31711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25d8fba21674442fbd100478245ff9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:48.482595 31711 tablet_copy_client.cc:783] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:48.482805 31711 tablet_copy_client.cc:647] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:48.483892 31711 tablet_copy_client.cc:523] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:48.484853 31711 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9: Bootstrap starting.
I20240502 01:59:48.504192 31711 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:48.504494 31711 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9: Bootstrap complete.
I20240502 01:59:48.504686 31711 ts_tablet_manager.cc:1367] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9: Time spent bootstrapping tablet: real 0.020s user 0.018s sys 0.000s
I20240502 01:59:48.505158 31711 raft_consensus.cc:348] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:48.505326 31711 raft_consensus.cc:729] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7332064716f04e84ba81c1f2b70821f9, State: Initialized, Role: LEARNER
I20240502 01:59:48.505498 31711 consensus_queue.cc:260] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:48.505919 31711 ts_tablet_manager.cc:1398] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 01:59:48.506906 28288 tablet_copy_service.cc:342] P 8ed4b4242123404f86485ec57dc34e88: Request end of tablet copy session 7332064716f04e84ba81c1f2b70821f9-25d8fba21674442fbd100478245ff9aa received from {username='slave'} at 127.10.133.201:44843
I20240502 01:59:48.506991 28288 tablet_copy_service.cc:433] P 8ed4b4242123404f86485ec57dc34e88: ending tablet copy session 7332064716f04e84ba81c1f2b70821f9-25d8fba21674442fbd100478245ff9aa on tablet 25d8fba21674442fbd100478245ff9aa with peer 7332064716f04e84ba81c1f2b70821f9
I20240502 01:59:48.903002 30008 raft_consensus.cc:1203] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:48.947440 30146 raft_consensus.cc:1203] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.4->[1.5-1.5] Dedup: 1.5->[]
I20240502 01:59:49.375238 31753 raft_consensus.cc:1050] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1: attempting to promote NON_VOTER 845294d663994245b540c006dca93b7d to VOTER
I20240502 01:59:49.375747 31753 consensus_queue.cc:237] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:49.377888 28535 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:49.378135 27998 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:49.378543 28131 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:49.378614 31777 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:49.378859 31575 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:49.378953 28264 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:49.379324 27862 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:49.379652 31777 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:49.379714 28399 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:49.380439 31777 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:49.380534 30145 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:49.380576 31575 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:49.380893 31575 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:49.381060 31534 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:49.385627 31575 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:49.387558 27997 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:49.387912 28131 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:49.388543 27577 catalog_manager.cc:5484] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:49.389714 28400 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:49.391547 27862 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:49.392195 30145 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:49.394762 28535 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:49.394994 28264 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:49.402895 27727 consensus_queue.cc:237] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:49.404373 28264 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:49.404496 28400 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:49.404616 28535 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:49.404855 27997 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:49.404824 31753 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:49.405022 30145 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:49.405020 31780 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:49.405318 31753 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:49.405524 27862 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:49.405845 31779 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:49.406221 31779 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:49.406546 31779 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:49.407895 31753 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:49.408336 30145 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:49.409592 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 5c23922560934ef3be8f4659d8727995 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:49.410768 28264 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:49.410964 28400 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:49.412117 27997 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:49.413154 28535 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:49.413362 27578 catalog_manager.cc:5484] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:49.415011 27862 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:49.416518 28112 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c23922560934ef3be8f4659d8727995 with delete_type TABLET_DATA_TOMBSTONED (TS 82e8cba6ed104c2c9869ea0365bbe482 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:53288
I20240502 01:59:49.417071 31792 tablet_replica.cc:330] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: stopping tablet replica
I20240502 01:59:49.417446 31792 raft_consensus.cc:2229] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:49.417728 31792 raft_consensus.cc:2258] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:49.418540 31792 ts_tablet_manager.cc:1875] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:49.421192 31792 ts_tablet_manager.cc:1888] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:49.421480 31792 log.cc:1196] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/5c23922560934ef3be8f4659d8727995
I20240502 01:59:49.422143 27563 catalog_manager.cc:4830] TS 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553): tablet 5c23922560934ef3be8f4659d8727995 (table rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]) successfully deleted
I20240502 01:59:49.498399 31665 raft_consensus.cc:1050] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88: attempting to promote NON_VOTER 7332064716f04e84ba81c1f2b70821f9 to VOTER
I20240502 01:59:49.498876 31665 consensus_queue.cc:237] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:49.500794 28400 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:49.501226 31795 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:49.501534 27862 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:49.501492 28535 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:49.502053 31800 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:49.502283 30008 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:49.502278 31793 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:49.502375 27997 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:49.502846 31799 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:49.502940 28131 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:49.503160 31799 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:49.504038 31799 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:49.504662 27728 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20240502 01:59:49.505270 31800 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20240502 01:59:49.506717 31798 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:49.507270 27997 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:49.507640 28131 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:49.508195 30008 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:49.510169 28400 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:49.510550 27574 catalog_manager.cc:5484] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 reported cstate change: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:49.511227 28535 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:49.511915 27862 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:49.514096 27728 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:49.520911 28264 consensus_queue.cc:237] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:49.522534 28400 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:49.522753 28535 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:49.522781 27997 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:49.522871 27862 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:49.523078 31800 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:49.523254 31797 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:49.523415 31795 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:49.523742 31665 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:49.524765 27728 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:49.525125 31800 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:49.526093 30008 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20240502 01:59:49.526010 31800 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:49.526477 31797 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20240502 01:59:49.526366 28400 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:49.527472 30008 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:49.527913 27563 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 25d8fba21674442fbd100478245ff9aa with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:49.529305 27862 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:49.529572 27997 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:49.530804 27570 catalog_manager.cc:5484] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:49.531267 27728 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:49.534071 28112 tablet_service.cc:1514] Processing DeleteTablet for tablet 25d8fba21674442fbd100478245ff9aa with delete_type TABLET_DATA_TOMBSTONED (TS 82e8cba6ed104c2c9869ea0365bbe482 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:53288
I20240502 01:59:49.534318 31792 tablet_replica.cc:330] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: stopping tablet replica
I20240502 01:59:49.534459 31792 raft_consensus.cc:2229] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:49.534663 31792 raft_consensus.cc:2258] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:49.536648 31792 ts_tablet_manager.cc:1875] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:49.534559 28535 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:49.538726 31792 ts_tablet_manager.cc:1888] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.6
I20240502 01:59:49.538782 31792 log.cc:1196] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-3/wal/wals/25d8fba21674442fbd100478245ff9aa
I20240502 01:59:49.539213 27563 catalog_manager.cc:4830] TS 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553): tablet 25d8fba21674442fbd100478245ff9aa (table rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]) successfully deleted
I20240502 01:59:49.849934 28380 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:59:49.851287 29852 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:49.853778 28513 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:59:49.860155 30124 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:49.871392 27978 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:49.874249 28246 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:59:49.878481 27843 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:49.889484 29987 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:49.891980 28112 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:49.895557 27707 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:50.020498 28380 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:59:50.021294 28513 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:59:50.021464 29852 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:50.024292 30124 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:50.031785 28246 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:59:50.034986 27843 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:50.041007 28112 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:50.041710 29987 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:50.042589 27978 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:50.085218 27707 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:50.130143 28400 consensus_queue.cc:237] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:50.132345 27997 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.132576 30008 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.132736 28263 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.132918 31914 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.133117 31865 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.133445 31865 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.133641 27862 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.133669 27728 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.134068 31755 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.134402 28535 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.134793 31755 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.136284 31915 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.138458 31865 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
W20240502 01:59:50.138808 28334 consensus_peers.cc:485] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 -> Peer 845294d663994245b540c006dca93b7d (127.10.133.202:45645): Couldn't send request to peer 845294d663994245b540c006dca93b7d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3b56295cbe014d6894812ee0a64bc513. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:50.138868 27728 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.140709 28535 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.141412 28263 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.141431 30008 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.144344 27579 catalog_manager.cc:5484] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.146071 27997 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.149426 27862 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.159965 28535 consensus_queue.cc:237] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:50.161774 29869 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.162426 27728 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.162747 27997 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.162870 31729 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.163064 27862 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.163784 31729 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.164119 31729 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.164212 28131 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.164350 31729 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.164657 28263 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
W20240502 01:59:50.166431 28467 consensus_peers.cc:485] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb -> Peer 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201:40597): Couldn't send request to peer 7332064716f04e84ba81c1f2b70821f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13a5600dc379460b9c433ffdaa0b3d02. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:50.166581 31729 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.166751 31933 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.169193 28263 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.169237 28131 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.171526 31937 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.172107 27572 catalog_manager.cc:5484] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 reported cstate change: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.175454 27997 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.177759 27728 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.178591 27862 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.179968 29869 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.187180 28131 consensus_queue.cc:237] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:50.189183 27728 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.189467 28400 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.189644 30145 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.189756 31831 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.190061 27997 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.190441 28535 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.190934 27862 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.191139 31953 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.191509 31831 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.193279 31831 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.193471 31953 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.193876 31955 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20240502 01:59:50.194061 28066 consensus_peers.cc:485] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 -> Peer 0003837e2d88424093594ed169d82cd2 (127.10.133.200:45585): Couldn't send request to peer 0003837e2d88424093594ed169d82cd2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86eb15ad9b1b4ee6ab734cdbb972d5d3. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:50.194716 31831 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:50.196553 27862 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:50.197105 27728 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:50.197789 27578 catalog_manager.cc:5484] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 reported cstate change: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "82e8cba6ed104c2c9869ea0365bbe482" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:50.198288 28400 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:50.198827 28535 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:50.201591 30145 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:50.206503 27997 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:50.213373 27862 consensus_queue.cc:237] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:50.215441 27728 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.215441 28400 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.215874 31617 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.216033 31972 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.216060 27997 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.216423 28131 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.216725 31617 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.216873 31973 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.217054 28535 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.217626 31972 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.220224 31972 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.220577 30008 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
W20240502 01:59:50.221236 27796 consensus_peers.cc:485] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 -> Peer 845294d663994245b540c006dca93b7d (127.10.133.202:45645): Couldn't send request to peer 845294d663994245b540c006dca93b7d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dc0c5e7b20cd4fb8ac78ae2bff4f8187. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:50.221181 28400 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.221558 27997 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.222594 28535 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.224125 27572 catalog_manager.cc:5484] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.224246 28131 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.225174 31973 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.226255 27728 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.227067 30008 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.237875 27728 consensus_queue.cc:237] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:50.239881 28535 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.240054 27997 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.240126 27862 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.240321 31990 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.240566 28263 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.240569 31989 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.241000 31990 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.241253 30145 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.241503 28400 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.242056 31534 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.242319 31779 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.242650 31779 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.244726 31989 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.245594 27997 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.245640 27862 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.247254 28263 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.247457 28535 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.248832 27575 catalog_manager.cc:5484] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.249425 28400 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
W20240502 01:59:50.251341 27661 consensus_peers.cc:485] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 -> Peer 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201:40597): Couldn't send request to peer 7332064716f04e84ba81c1f2b70821f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c23922560934ef3be8f4659d8727995. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:50.254295 30145 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.262426 28535 consensus_queue.cc:237] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:50.264465 27728 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.264816 30145 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.264902 31939 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.265151 27862 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.265187 31933 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20240502 01:59:50.266088 28468 consensus_peers.cc:485] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb -> Peer 0003837e2d88424093594ed169d82cd2 (127.10.133.200:45585): Couldn't send request to peer 0003837e2d88424093594ed169d82cd2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0883c95dc88f4fb4a7a715c23fb7f078. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:50.266402 27997 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.266567 28400 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.266774 31933 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.266918 31939 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.267448 31936 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.269537 31939 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:50.269959 28400 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:50.271279 28263 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.273006 27575 catalog_manager.cc:5484] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:50.273715 31936 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.275063 27998 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:50.276101 28263 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:50.277591 30145 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:50.281375 27863 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:50.290769 27727 consensus_queue.cc:237] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:50.293323 29869 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.293422 27998 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.293882 27863 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.293908 31534 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.294278 28263 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.294310 31534 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.294692 28400 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.295032 28535 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.295477 31534 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.296624 32011 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.296860 27727 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
W20240502 01:59:50.297083 27662 consensus_peers.cc:485] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 -> Peer 845294d663994245b540c006dca93b7d (127.10.133.202:45645): Couldn't send request to peer 845294d663994245b540c006dca93b7d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7ccc60565e9447b8ab77927061813e5. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:50.297238 31988 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.297443 32011 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.300805 31988 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.301293 28263 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.302608 27998 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.303500 28535 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.305581 27570 catalog_manager.cc:5484] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.305577 28400 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.306725 29869 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.310221 27863 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.316716 27863 consensus_queue.cc:237] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:50.318589 29869 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.318926 28131 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.319307 28263 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.319299 31617 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.319813 28535 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
W20240502 01:59:50.320047 27795 consensus_peers.cc:485] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 -> Peer 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201:40597): Couldn't send request to peer 7332064716f04e84ba81c1f2b70821f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e1bd5156bcca44438438c6ca78facd35. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:50.320286 27727 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.320308 31973 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.320438 31972 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.320586 31617 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.320876 27998 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.321352 31974 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.322057 31973 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.323954 31972 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.324389 27727 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.324918 28263 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.325040 27998 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.326721 28535 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.327951 27572 catalog_manager.cc:5484] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.330443 29869 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.331156 28131 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:50.339756 28263 consensus_queue.cc:237] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:50.341943 28535 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.342173 27863 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.342399 30145 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.342456 31797 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.342917 27727 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.343381 28131 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.342803 32038 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.343678 31796 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.343963 32039 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.344116 31797 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.345618 27998 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.346125 32037 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.346889 32039 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:50.348834 27727 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
W20240502 01:59:50.349503 28200 consensus_peers.cc:485] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 -> Peer 0003837e2d88424093594ed169d82cd2 (127.10.133.200:45585): Couldn't send request to peer 0003837e2d88424093594ed169d82cd2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ee07ceb106a46778d215684d8fac8da. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:50.349471 28131 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:50.350311 27578 catalog_manager.cc:5484] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:50.353209 27998 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:50.353312 28535 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:50.356190 30145 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:50.356405 27863 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:50.367081 28263 consensus_queue.cc:237] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:50.368952 30008 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.368966 28400 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.369372 32037 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.369649 32039 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.369801 28535 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.369973 27863 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.370373 32039 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.370690 27998 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.370958 31796 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.372488 31796 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20240502 01:59:50.372627 28200 consensus_peers.cc:485] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 -> Peer 845294d663994245b540c006dca93b7d (127.10.133.202:45645): Couldn't send request to peer 845294d663994245b540c006dca93b7d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 25d8fba21674442fbd100478245ff9aa. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:50.372890 27727 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:50.373278 31796 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:50.373598 32047 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.375684 28400 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.375737 27863 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.375982 27727 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.378010 28535 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.378475 27570 catalog_manager.cc:5484] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.380319 30008 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.384266 27998 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:50.575480 32103 ts_tablet_manager.cc:902] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d: Initiating tablet copy from peer 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921)
I20240502 01:59:50.576020 32103 tablet_copy_client.cc:308] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.198:44921
I20240502 01:59:50.579926 28421 tablet_copy_service.cc:140] P 12f527e76eff4669924a898d5029e3d1: Received BeginTabletCopySession request for tablet 3b56295cbe014d6894812ee0a64bc513 from peer 845294d663994245b540c006dca93b7d ({username='slave'} at 127.10.133.202:58129)
I20240502 01:59:50.580051 28421 tablet_copy_service.cc:161] P 12f527e76eff4669924a898d5029e3d1: Beginning new tablet copy session on tablet 3b56295cbe014d6894812ee0a64bc513 from peer 845294d663994245b540c006dca93b7d at {username='slave'} at 127.10.133.202:58129: session id = 845294d663994245b540c006dca93b7d-3b56295cbe014d6894812ee0a64bc513
I20240502 01:59:50.580946 28421 tablet_copy_source_session.cc:205] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:50.582175 32103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b56295cbe014d6894812ee0a64bc513. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:50.584306 32103 tablet_copy_client.cc:783] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:50.584465 32103 tablet_copy_client.cc:647] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:50.585592 32103 tablet_copy_client.cc:523] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:50.586614 32103 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d: Bootstrap starting.
I20240502 01:59:50.606068 32103 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:50.606375 32103 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d: Bootstrap complete.
I20240502 01:59:50.606554 32103 ts_tablet_manager.cc:1367] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d: Time spent bootstrapping tablet: real 0.020s user 0.016s sys 0.003s
I20240502 01:59:50.606982 32103 raft_consensus.cc:348] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:50.607095 32103 raft_consensus.cc:729] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 845294d663994245b540c006dca93b7d, State: Initialized, Role: LEARNER
I20240502 01:59:50.607187 32103 consensus_queue.cc:260] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:50.607461 32103 ts_tablet_manager.cc:1398] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:50.607971 28421 tablet_copy_service.cc:342] P 12f527e76eff4669924a898d5029e3d1: Request end of tablet copy session 845294d663994245b540c006dca93b7d-3b56295cbe014d6894812ee0a64bc513 received from {username='slave'} at 127.10.133.202:58129
I20240502 01:59:50.608062 28421 tablet_copy_service.cc:433] P 12f527e76eff4669924a898d5029e3d1: ending tablet copy session 845294d663994245b540c006dca93b7d-3b56295cbe014d6894812ee0a64bc513 on tablet 3b56295cbe014d6894812ee0a64bc513 with peer 845294d663994245b540c006dca93b7d
I20240502 01:59:50.652195 32115 ts_tablet_manager.cc:902] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9: Initiating tablet copy from peer 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:50.652756 32115 tablet_copy_client.cc:308] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.199:35629
I20240502 01:59:50.653306 28555 tablet_copy_service.cc:140] P 257826b7ad7e4abb8499b6687e8c83eb: Received BeginTabletCopySession request for tablet 13a5600dc379460b9c433ffdaa0b3d02 from peer 7332064716f04e84ba81c1f2b70821f9 ({username='slave'} at 127.10.133.201:60003)
I20240502 01:59:50.653419 28555 tablet_copy_service.cc:161] P 257826b7ad7e4abb8499b6687e8c83eb: Beginning new tablet copy session on tablet 13a5600dc379460b9c433ffdaa0b3d02 from peer 7332064716f04e84ba81c1f2b70821f9 at {username='slave'} at 127.10.133.201:60003: session id = 7332064716f04e84ba81c1f2b70821f9-13a5600dc379460b9c433ffdaa0b3d02
I20240502 01:59:50.654995 28555 tablet_copy_source_session.cc:205] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:50.656008 32115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13a5600dc379460b9c433ffdaa0b3d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:50.658524 32115 tablet_copy_client.cc:783] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:50.658823 32115 tablet_copy_client.cc:647] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:50.660243 32115 tablet_copy_client.cc:523] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:50.661907 32115 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap starting.
I20240502 01:59:50.671219 32103 ts_tablet_manager.cc:902] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d: Initiating tablet copy from peer da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835)
I20240502 01:59:50.671703 32103 tablet_copy_client.cc:308] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:40835
I20240502 01:59:50.672169 27749 tablet_copy_service.cc:140] P da58b5341d344efd833502f214e69ff1: Received BeginTabletCopySession request for tablet f7ccc60565e9447b8ab77927061813e5 from peer 845294d663994245b540c006dca93b7d ({username='slave'} at 127.10.133.202:52171)
I20240502 01:59:50.672278 27749 tablet_copy_service.cc:161] P da58b5341d344efd833502f214e69ff1: Beginning new tablet copy session on tablet f7ccc60565e9447b8ab77927061813e5 from peer 845294d663994245b540c006dca93b7d at {username='slave'} at 127.10.133.202:52171: session id = 845294d663994245b540c006dca93b7d-f7ccc60565e9447b8ab77927061813e5
I20240502 01:59:50.673251 27749 tablet_copy_source_session.cc:205] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:50.674468 32103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ccc60565e9447b8ab77927061813e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:50.676417 32103 tablet_copy_client.cc:783] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:50.676579 32103 tablet_copy_client.cc:647] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:50.677978 32103 tablet_copy_client.cc:523] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:50.679739 32103 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d: Bootstrap starting.
I20240502 01:59:50.685065 32115 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:50.685322 32115 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap complete.
I20240502 01:59:50.685492 32115 ts_tablet_manager.cc:1367] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9: Time spent bootstrapping tablet: real 0.024s user 0.018s sys 0.001s
I20240502 01:59:50.685911 32115 raft_consensus.cc:348] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:50.686101 32115 raft_consensus.cc:729] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7332064716f04e84ba81c1f2b70821f9, State: Initialized, Role: LEARNER
I20240502 01:59:50.686218 32115 consensus_queue.cc:260] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:50.686640 32115 ts_tablet_manager.cc:1398] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 01:59:50.687191 28555 tablet_copy_service.cc:342] P 257826b7ad7e4abb8499b6687e8c83eb: Request end of tablet copy session 7332064716f04e84ba81c1f2b70821f9-13a5600dc379460b9c433ffdaa0b3d02 received from {username='slave'} at 127.10.133.201:60003
I20240502 01:59:50.687266 28555 tablet_copy_service.cc:433] P 257826b7ad7e4abb8499b6687e8c83eb: ending tablet copy session 7332064716f04e84ba81c1f2b70821f9-13a5600dc379460b9c433ffdaa0b3d02 on tablet 13a5600dc379460b9c433ffdaa0b3d02 with peer 7332064716f04e84ba81c1f2b70821f9
I20240502 01:59:50.701319 32103 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:50.701623 32103 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d: Bootstrap complete.
I20240502 01:59:50.701819 32103 ts_tablet_manager.cc:1367] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d: Time spent bootstrapping tablet: real 0.022s user 0.014s sys 0.004s
I20240502 01:59:50.702457 32103 raft_consensus.cc:348] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:50.702616 32103 raft_consensus.cc:729] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 845294d663994245b540c006dca93b7d, State: Initialized, Role: LEARNER
I20240502 01:59:50.702744 32103 consensus_queue.cc:260] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:50.703078 32103 ts_tablet_manager.cc:1398] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d: Time spent starting tablet: real 0.001s user 0.001s sys 0.004s
I20240502 01:59:50.703620 27749 tablet_copy_service.cc:342] P da58b5341d344efd833502f214e69ff1: Request end of tablet copy session 845294d663994245b540c006dca93b7d-f7ccc60565e9447b8ab77927061813e5 received from {username='slave'} at 127.10.133.202:52171
I20240502 01:59:50.703718 27749 tablet_copy_service.cc:433] P da58b5341d344efd833502f214e69ff1: ending tablet copy session 845294d663994245b540c006dca93b7d-f7ccc60565e9447b8ab77927061813e5 on tablet f7ccc60565e9447b8ab77927061813e5 with peer 845294d663994245b540c006dca93b7d
I20240502 01:59:50.715255 32157 ts_tablet_manager.cc:902] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 0003837e2d88424093594ed169d82cd2: Initiating tablet copy from peer 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553)
I20240502 01:59:50.715813 32157 tablet_copy_client.cc:308] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 0003837e2d88424093594ed169d82cd2: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.196:41553
I20240502 01:59:50.721467 28154 tablet_copy_service.cc:140] P 82e8cba6ed104c2c9869ea0365bbe482: Received BeginTabletCopySession request for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3 from peer 0003837e2d88424093594ed169d82cd2 ({username='slave'} at 127.10.133.200:34851)
I20240502 01:59:50.721578 28154 tablet_copy_service.cc:161] P 82e8cba6ed104c2c9869ea0365bbe482: Beginning new tablet copy session on tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3 from peer 0003837e2d88424093594ed169d82cd2 at {username='slave'} at 127.10.133.200:34851: session id = 0003837e2d88424093594ed169d82cd2-86eb15ad9b1b4ee6ab734cdbb972d5d3
I20240502 01:59:50.722427 28154 tablet_copy_source_session.cc:205] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:50.723394 32157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:50.725615 32157 tablet_copy_client.cc:783] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:50.725773 32157 tablet_copy_client.cc:647] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:50.726995 32157 tablet_copy_client.cc:523] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 0003837e2d88424093594ed169d82cd2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:50.728122 32157 tablet_bootstrap.cc:492] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 0003837e2d88424093594ed169d82cd2: Bootstrap starting.
I20240502 01:59:50.731613 32174 ts_tablet_manager.cc:902] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2: Initiating tablet copy from peer 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:50.732064 32115 ts_tablet_manager.cc:902] T e1bd5156bcca44438438c6ca78facd35 P 7332064716f04e84ba81c1f2b70821f9: Initiating tablet copy from peer a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731)
I20240502 01:59:50.732118 32174 tablet_copy_client.cc:308] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.199:35629
I20240502 01:59:50.732537 32115 tablet_copy_client.cc:308] T e1bd5156bcca44438438c6ca78facd35 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37731
I20240502 01:59:50.732865 28555 tablet_copy_service.cc:140] P 257826b7ad7e4abb8499b6687e8c83eb: Received BeginTabletCopySession request for tablet 0883c95dc88f4fb4a7a715c23fb7f078 from peer 0003837e2d88424093594ed169d82cd2 ({username='slave'} at 127.10.133.200:60711)
I20240502 01:59:50.732955 28555 tablet_copy_service.cc:161] P 257826b7ad7e4abb8499b6687e8c83eb: Beginning new tablet copy session on tablet 0883c95dc88f4fb4a7a715c23fb7f078 from peer 0003837e2d88424093594ed169d82cd2 at {username='slave'} at 127.10.133.200:60711: session id = 0003837e2d88424093594ed169d82cd2-0883c95dc88f4fb4a7a715c23fb7f078
I20240502 01:59:50.733247 27885 tablet_copy_service.cc:140] P a8c1908b1c554e7cbbb9bf9751b8ee98: Received BeginTabletCopySession request for tablet e1bd5156bcca44438438c6ca78facd35 from peer 7332064716f04e84ba81c1f2b70821f9 ({username='slave'} at 127.10.133.201:33397)
I20240502 01:59:50.733376 27885 tablet_copy_service.cc:161] P a8c1908b1c554e7cbbb9bf9751b8ee98: Beginning new tablet copy session on tablet e1bd5156bcca44438438c6ca78facd35 from peer 7332064716f04e84ba81c1f2b70821f9 at {username='slave'} at 127.10.133.201:33397: session id = 7332064716f04e84ba81c1f2b70821f9-e1bd5156bcca44438438c6ca78facd35
I20240502 01:59:50.733876 28555 tablet_copy_source_session.cc:205] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:50.734365 27885 tablet_copy_source_session.cc:205] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:50.734676 32174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0883c95dc88f4fb4a7a715c23fb7f078. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:50.735265 32115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1bd5156bcca44438438c6ca78facd35. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:50.736668 32174 tablet_copy_client.cc:783] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:50.736807 32174 tablet_copy_client.cc:647] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:50.737512 32115 tablet_copy_client.cc:783] T e1bd5156bcca44438438c6ca78facd35 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:50.737671 32115 tablet_copy_client.cc:647] T e1bd5156bcca44438438c6ca78facd35 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:50.738716 32174 tablet_copy_client.cc:523] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:50.738934 32115 tablet_copy_client.cc:523] T e1bd5156bcca44438438c6ca78facd35 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:50.739991 32174 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2: Bootstrap starting.
I20240502 01:59:50.740116 32115 tablet_bootstrap.cc:492] T e1bd5156bcca44438438c6ca78facd35 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap starting.
I20240502 01:59:50.762822 32191 ts_tablet_manager.cc:902] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2: Initiating tablet copy from peer 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567)
I20240502 01:59:50.763360 32191 tablet_copy_client.cc:308] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.197:46567
I20240502 01:59:50.767748 28288 tablet_copy_service.cc:140] P 8ed4b4242123404f86485ec57dc34e88: Received BeginTabletCopySession request for tablet 9ee07ceb106a46778d215684d8fac8da from peer 0003837e2d88424093594ed169d82cd2 ({username='slave'} at 127.10.133.200:53299)
I20240502 01:59:50.767859 28288 tablet_copy_service.cc:161] P 8ed4b4242123404f86485ec57dc34e88: Beginning new tablet copy session on tablet 9ee07ceb106a46778d215684d8fac8da from peer 0003837e2d88424093594ed169d82cd2 at {username='slave'} at 127.10.133.200:53299: session id = 0003837e2d88424093594ed169d82cd2-9ee07ceb106a46778d215684d8fac8da
I20240502 01:59:50.768826 28288 tablet_copy_source_session.cc:205] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:50.770084 32191 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ee07ceb106a46778d215684d8fac8da. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:50.772909 32191 tablet_copy_client.cc:783] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:50.773061 32191 tablet_copy_client.cc:647] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:50.774135 32191 tablet_copy_client.cc:523] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:50.775718 32191 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2: Bootstrap starting.
I20240502 01:59:50.780143 32157 tablet_bootstrap.cc:492] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 0003837e2d88424093594ed169d82cd2: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:50.780445 32157 tablet_bootstrap.cc:492] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 0003837e2d88424093594ed169d82cd2: Bootstrap complete.
I20240502 01:59:50.780632 32157 ts_tablet_manager.cc:1367] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 0003837e2d88424093594ed169d82cd2: Time spent bootstrapping tablet: real 0.053s user 0.031s sys 0.000s
I20240502 01:59:50.781186 32157 raft_consensus.cc:348] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:50.781373 32157 raft_consensus.cc:729] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0003837e2d88424093594ed169d82cd2, State: Initialized, Role: LEARNER
I20240502 01:59:50.781481 32157 consensus_queue.cc:260] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 0003837e2d88424093594ed169d82cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:50.783742 32157 ts_tablet_manager.cc:1398] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 0003837e2d88424093594ed169d82cd2: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20240502 01:59:50.785614 28154 tablet_copy_service.cc:342] P 82e8cba6ed104c2c9869ea0365bbe482: Request end of tablet copy session 0003837e2d88424093594ed169d82cd2-86eb15ad9b1b4ee6ab734cdbb972d5d3 received from {username='slave'} at 127.10.133.200:34851
I20240502 01:59:50.785708 28154 tablet_copy_service.cc:433] P 82e8cba6ed104c2c9869ea0365bbe482: ending tablet copy session 0003837e2d88424093594ed169d82cd2-86eb15ad9b1b4ee6ab734cdbb972d5d3 on tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3 with peer 0003837e2d88424093594ed169d82cd2
I20240502 01:59:50.786935 32174 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:50.787286 32174 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2: Bootstrap complete.
I20240502 01:59:50.787464 32174 ts_tablet_manager.cc:1367] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2: Time spent bootstrapping tablet: real 0.048s user 0.025s sys 0.005s
I20240502 01:59:50.787861 32174 raft_consensus.cc:348] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:50.787974 32174 raft_consensus.cc:729] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0003837e2d88424093594ed169d82cd2, State: Initialized, Role: LEARNER
I20240502 01:59:50.788079 32174 consensus_queue.cc:260] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:50.788345 32174 ts_tablet_manager.cc:1398] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:50.789103 28555 tablet_copy_service.cc:342] P 257826b7ad7e4abb8499b6687e8c83eb: Request end of tablet copy session 0003837e2d88424093594ed169d82cd2-0883c95dc88f4fb4a7a715c23fb7f078 received from {username='slave'} at 127.10.133.200:60711
I20240502 01:59:50.789194 28555 tablet_copy_service.cc:433] P 257826b7ad7e4abb8499b6687e8c83eb: ending tablet copy session 0003837e2d88424093594ed169d82cd2-0883c95dc88f4fb4a7a715c23fb7f078 on tablet 0883c95dc88f4fb4a7a715c23fb7f078 with peer 0003837e2d88424093594ed169d82cd2
I20240502 01:59:50.789553 32115 tablet_bootstrap.cc:492] T e1bd5156bcca44438438c6ca78facd35 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:50.789834 32115 tablet_bootstrap.cc:492] T e1bd5156bcca44438438c6ca78facd35 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap complete.
I20240502 01:59:50.790016 32115 ts_tablet_manager.cc:1367] T e1bd5156bcca44438438c6ca78facd35 P 7332064716f04e84ba81c1f2b70821f9: Time spent bootstrapping tablet: real 0.050s user 0.029s sys 0.000s
I20240502 01:59:50.790531 32115 raft_consensus.cc:348] T e1bd5156bcca44438438c6ca78facd35 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:50.790674 32115 raft_consensus.cc:729] T e1bd5156bcca44438438c6ca78facd35 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7332064716f04e84ba81c1f2b70821f9, State: Initialized, Role: LEARNER
I20240502 01:59:50.790773 32115 consensus_queue.cc:260] T e1bd5156bcca44438438c6ca78facd35 P 7332064716f04e84ba81c1f2b70821f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:50.791082 32115 ts_tablet_manager.cc:1398] T e1bd5156bcca44438438c6ca78facd35 P 7332064716f04e84ba81c1f2b70821f9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:50.791603 27885 tablet_copy_service.cc:342] P a8c1908b1c554e7cbbb9bf9751b8ee98: Request end of tablet copy session 7332064716f04e84ba81c1f2b70821f9-e1bd5156bcca44438438c6ca78facd35 received from {username='slave'} at 127.10.133.201:33397
I20240502 01:59:50.791688 27885 tablet_copy_service.cc:433] P a8c1908b1c554e7cbbb9bf9751b8ee98: ending tablet copy session 7332064716f04e84ba81c1f2b70821f9-e1bd5156bcca44438438c6ca78facd35 on tablet e1bd5156bcca44438438c6ca78facd35 with peer 7332064716f04e84ba81c1f2b70821f9
I20240502 01:59:50.805346 32191 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:50.805614 32191 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2: Bootstrap complete.
I20240502 01:59:50.805784 32191 ts_tablet_manager.cc:1367] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2: Time spent bootstrapping tablet: real 0.030s user 0.021s sys 0.000s
I20240502 01:59:50.806244 32191 raft_consensus.cc:348] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:50.806363 32191 raft_consensus.cc:729] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0003837e2d88424093594ed169d82cd2, State: Initialized, Role: LEARNER
I20240502 01:59:50.806463 32191 consensus_queue.cc:260] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:50.806704 32191 ts_tablet_manager.cc:1398] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2: Time spent starting tablet: real 0.001s user 0.004s sys 0.000s
I20240502 01:59:50.807202 28288 tablet_copy_service.cc:342] P 8ed4b4242123404f86485ec57dc34e88: Request end of tablet copy session 0003837e2d88424093594ed169d82cd2-9ee07ceb106a46778d215684d8fac8da received from {username='slave'} at 127.10.133.200:53299
I20240502 01:59:50.807291 28288 tablet_copy_service.cc:433] P 8ed4b4242123404f86485ec57dc34e88: ending tablet copy session 0003837e2d88424093594ed169d82cd2-9ee07ceb106a46778d215684d8fac8da on tablet 9ee07ceb106a46778d215684d8fac8da with peer 0003837e2d88424093594ed169d82cd2
I20240502 01:59:50.819111 32115 ts_tablet_manager.cc:902] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9: Initiating tablet copy from peer da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835)
I20240502 01:59:50.819689 32115 tablet_copy_client.cc:308] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:40835
I20240502 01:59:50.823904 27749 tablet_copy_service.cc:140] P da58b5341d344efd833502f214e69ff1: Received BeginTabletCopySession request for tablet 5c23922560934ef3be8f4659d8727995 from peer 7332064716f04e84ba81c1f2b70821f9 ({username='slave'} at 127.10.133.201:59089)
I20240502 01:59:50.824029 27749 tablet_copy_service.cc:161] P da58b5341d344efd833502f214e69ff1: Beginning new tablet copy session on tablet 5c23922560934ef3be8f4659d8727995 from peer 7332064716f04e84ba81c1f2b70821f9 at {username='slave'} at 127.10.133.201:59089: session id = 7332064716f04e84ba81c1f2b70821f9-5c23922560934ef3be8f4659d8727995
I20240502 01:59:50.824842 27749 tablet_copy_source_session.cc:205] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:50.825598 32115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c23922560934ef3be8f4659d8727995. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:50.827877 32115 tablet_copy_client.cc:783] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:50.828114 32115 tablet_copy_client.cc:647] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:50.829214 32115 tablet_copy_client.cc:523] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:50.830281 32115 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap starting.
I20240502 01:59:50.838254 32103 ts_tablet_manager.cc:902] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d: Initiating tablet copy from peer a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731)
I20240502 01:59:50.838735 32103 tablet_copy_client.cc:308] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37731
I20240502 01:59:50.842948 27885 tablet_copy_service.cc:140] P a8c1908b1c554e7cbbb9bf9751b8ee98: Received BeginTabletCopySession request for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 from peer 845294d663994245b540c006dca93b7d ({username='slave'} at 127.10.133.202:46705)
I20240502 01:59:50.843058 27885 tablet_copy_service.cc:161] P a8c1908b1c554e7cbbb9bf9751b8ee98: Beginning new tablet copy session on tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 from peer 845294d663994245b540c006dca93b7d at {username='slave'} at 127.10.133.202:46705: session id = 845294d663994245b540c006dca93b7d-dc0c5e7b20cd4fb8ac78ae2bff4f8187
I20240502 01:59:50.843991 27885 tablet_copy_source_session.cc:205] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:50.844894 32103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:50.847079 32103 tablet_copy_client.cc:783] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:50.847229 32103 tablet_copy_client.cc:647] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:50.848469 32103 tablet_copy_client.cc:523] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:50.849638 32103 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d: Bootstrap starting.
I20240502 01:59:50.854084 32115 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:50.854316 32115 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap complete.
I20240502 01:59:50.854473 32115 ts_tablet_manager.cc:1367] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9: Time spent bootstrapping tablet: real 0.024s user 0.020s sys 0.004s
I20240502 01:59:50.854852 32115 raft_consensus.cc:348] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:50.854965 32115 raft_consensus.cc:729] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7332064716f04e84ba81c1f2b70821f9, State: Initialized, Role: LEARNER
I20240502 01:59:50.855064 32115 consensus_queue.cc:260] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:50.855334 32115 ts_tablet_manager.cc:1398] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:50.855796 27749 tablet_copy_service.cc:342] P da58b5341d344efd833502f214e69ff1: Request end of tablet copy session 7332064716f04e84ba81c1f2b70821f9-5c23922560934ef3be8f4659d8727995 received from {username='slave'} at 127.10.133.201:59089
I20240502 01:59:50.855896 27749 tablet_copy_service.cc:433] P da58b5341d344efd833502f214e69ff1: ending tablet copy session 7332064716f04e84ba81c1f2b70821f9-5c23922560934ef3be8f4659d8727995 on tablet 5c23922560934ef3be8f4659d8727995 with peer 7332064716f04e84ba81c1f2b70821f9
I20240502 01:59:50.871163 32103 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:50.871402 32103 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d: Bootstrap complete.
I20240502 01:59:50.871557 32103 ts_tablet_manager.cc:1367] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d: Time spent bootstrapping tablet: real 0.022s user 0.021s sys 0.000s
I20240502 01:59:50.871928 32103 raft_consensus.cc:348] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:50.872045 32103 raft_consensus.cc:729] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 845294d663994245b540c006dca93b7d, State: Initialized, Role: LEARNER
I20240502 01:59:50.872124 32103 consensus_queue.cc:260] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:50.872367 32103 ts_tablet_manager.cc:1398] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:50.872890 27885 tablet_copy_service.cc:342] P a8c1908b1c554e7cbbb9bf9751b8ee98: Request end of tablet copy session 845294d663994245b540c006dca93b7d-dc0c5e7b20cd4fb8ac78ae2bff4f8187 received from {username='slave'} at 127.10.133.202:46705
I20240502 01:59:50.872992 27885 tablet_copy_service.cc:433] P a8c1908b1c554e7cbbb9bf9751b8ee98: ending tablet copy session 845294d663994245b540c006dca93b7d-dc0c5e7b20cd4fb8ac78ae2bff4f8187 on tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 with peer 845294d663994245b540c006dca93b7d
I20240502 01:59:50.911913 32103 ts_tablet_manager.cc:902] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d: Initiating tablet copy from peer 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567)
I20240502 01:59:50.912384 32103 tablet_copy_client.cc:308] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.197:46567
I20240502 01:59:50.913004 28288 tablet_copy_service.cc:140] P 8ed4b4242123404f86485ec57dc34e88: Received BeginTabletCopySession request for tablet 25d8fba21674442fbd100478245ff9aa from peer 845294d663994245b540c006dca93b7d ({username='slave'} at 127.10.133.202:34859)
I20240502 01:59:50.913100 28288 tablet_copy_service.cc:161] P 8ed4b4242123404f86485ec57dc34e88: Beginning new tablet copy session on tablet 25d8fba21674442fbd100478245ff9aa from peer 845294d663994245b540c006dca93b7d at {username='slave'} at 127.10.133.202:34859: session id = 845294d663994245b540c006dca93b7d-25d8fba21674442fbd100478245ff9aa
I20240502 01:59:50.913867 28288 tablet_copy_source_session.cc:205] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:50.914713 32103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25d8fba21674442fbd100478245ff9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:50.916922 32103 tablet_copy_client.cc:783] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:50.917073 32103 tablet_copy_client.cc:647] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:50.918236 32103 tablet_copy_client.cc:523] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:50.919257 32103 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d: Bootstrap starting.
I20240502 01:59:50.954444 32103 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:50.954720 32103 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d: Bootstrap complete.
I20240502 01:59:50.954887 32103 ts_tablet_manager.cc:1367] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d: Time spent bootstrapping tablet: real 0.036s user 0.016s sys 0.004s
I20240502 01:59:50.955374 32103 raft_consensus.cc:348] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:50.955502 32103 raft_consensus.cc:729] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 845294d663994245b540c006dca93b7d, State: Initialized, Role: LEARNER
I20240502 01:59:50.955614 32103 consensus_queue.cc:260] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:50.955886 32103 ts_tablet_manager.cc:1398] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:50.956928 28288 tablet_copy_service.cc:342] P 8ed4b4242123404f86485ec57dc34e88: Request end of tablet copy session 845294d663994245b540c006dca93b7d-25d8fba21674442fbd100478245ff9aa received from {username='slave'} at 127.10.133.202:34859
I20240502 01:59:50.957017 28288 tablet_copy_service.cc:433] P 8ed4b4242123404f86485ec57dc34e88: ending tablet copy session 845294d663994245b540c006dca93b7d-25d8fba21674442fbd100478245ff9aa on tablet 25d8fba21674442fbd100478245ff9aa with peer 845294d663994245b540c006dca93b7d
I20240502 01:59:51.066519 30145 raft_consensus.cc:1203] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 01:59:51.080341 30008 raft_consensus.cc:1203] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 01:59:51.139534 30008 raft_consensus.cc:1203] T e1bd5156bcca44438438c6ca78facd35 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 01:59:51.168785 29869 raft_consensus.cc:1203] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 01:59:51.204205 29869 raft_consensus.cc:1203] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 01:59:51.248481 30008 raft_consensus.cc:1203] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 01:59:51.278837 30145 raft_consensus.cc:1203] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 01:59:51.283505 29869 raft_consensus.cc:1203] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 01:59:51.366653 30145 raft_consensus.cc:1203] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 01:59:51.389786 30145 raft_consensus.cc:1203] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 01:59:51.528463 31729 raft_consensus.cc:1050] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb: attempting to promote NON_VOTER 7332064716f04e84ba81c1f2b70821f9 to VOTER
I20240502 01:59:51.529044 31729 consensus_queue.cc:237] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:51.531107 29869 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.531160 28131 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.531199 27998 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.531528 28263 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.531745 30008 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.531885 27727 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.532073 31936 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.532317 27863 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.532416 31936 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.532703 31936 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.532909 31939 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.533064 31936 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.533236 32355 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.533445 31729 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.536610 31936 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.537891 27863 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.538300 28263 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.538410 27727 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.540897 27578 catalog_manager.cc:5484] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.542312 29869 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.542610 28131 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.543953 27998 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.545866 30008 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.553949 28535 consensus_queue.cc:237] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:51.555445 30008 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.555913 27998 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.556015 31939 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.556391 28263 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.556419 28131 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.556857 29869 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.556856 27863 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.556972 32266 raft_consensus.cc:1050] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482: attempting to promote NON_VOTER 0003837e2d88424093594ed169d82cd2 to VOTER
I20240502 01:59:51.557487 31729 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.557560 32266 consensus_queue.cc:237] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:51.557662 32355 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.557835 31936 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.558161 32356 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.558496 32356 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.559480 29869 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.559608 27998 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.559911 30145 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.559959 28535 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.559989 27727 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.560442 27863 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.560473 32265 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.560607 28400 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.560622 32383 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.561028 31956 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.561198 32265 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.561340 32380 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.561448 32381 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.561543 32266 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.564559 31939 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.565903 32263 raft_consensus.cc:1050] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1: attempting to promote NON_VOTER 845294d663994245b540c006dca93b7d to VOTER
I20240502 01:59:51.566815 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 13a5600dc379460b9c433ffdaa0b3d02 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:51.567389 28131 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.567668 27862 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.568075 30008 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.569375 27574 catalog_manager.cc:5484] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:51.569775 27997 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.570422 29870 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.566565 32263 consensus_queue.cc:237] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:51.577327 27707 tablet_service.cc:1514] Processing DeleteTablet for tablet 13a5600dc379460b9c433ffdaa0b3d02 with delete_type TABLET_DATA_TOMBSTONED (TS da58b5341d344efd833502f214e69ff1 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:38722
I20240502 01:59:51.579469 27998 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.580085 27863 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.580519 28263 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.581120 32382 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.583106 30145 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.584457 32396 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.584769 28534 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.586174 28264 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.585806 27863 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.586273 27574 catalog_manager.cc:5484] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d reported cstate change: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "82e8cba6ed104c2c9869ea0365bbe482" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.586531 27728 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.587998 32146 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.588976 28535 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.589115 27727 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.589669 30008 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.591080 32263 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.591436 32263 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.591797 32263 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.592115 32263 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.592808 29869 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.595026 28400 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.595398 27997 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.603646 28131 consensus_queue.cc:237] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:51.605783 28400 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.606108 28534 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.606266 27728 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.606245 31956 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.606593 31956 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.607457 32383 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.609483 29869 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.609580 27997 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.609776 30146 raft_consensus.cc:1261] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 82e8cba6ed104c2c9869ea0365bbe482: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.610162 30145 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.610500 32146 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.610541 31956 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.610682 32383 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.610901 32266 consensus_queue.cc:1035] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.614280 32266 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.614573 29869 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.614611 27997 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.616590 28534 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.616848 28400 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.617506 27579 catalog_manager.cc:5484] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 0003837e2d88424093594ed169d82cd2 reported cstate change: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New cstate: current_term: 1 leader_uuid: "82e8cba6ed104c2c9869ea0365bbe482" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.618376 32263 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.619328 27563 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:51.620369 28264 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.622432 30008 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.623034 27577 catalog_manager.cc:5484] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.623663 27843 tablet_service.cc:1514] Processing DeleteTablet for tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3 with delete_type TABLET_DATA_TOMBSTONED (TS a8c1908b1c554e7cbbb9bf9751b8ee98 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:35346
I20240502 01:59:51.623842 27728 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.624027 27727 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.625129 28534 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.626334 30145 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.631731 32264 raft_consensus.cc:1050] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98: attempting to promote NON_VOTER 7332064716f04e84ba81c1f2b70821f9 to VOTER
I20240502 01:59:51.632273 32264 consensus_queue.cc:237] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:51.632241 27863 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.634443 29869 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.635529 28534 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.636062 28264 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.636051 31972 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.635928 30146 raft_consensus.cc:2932] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.636698 28131 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.636900 31972 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.637130 27997 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.637508 31972 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.638680 31972 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.638754 32397 tablet_replica.cc:330] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1: stopping tablet replica
I20240502 01:59:51.638834 30008 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.639014 31972 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.639154 32397 raft_consensus.cc:2229] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:51.639559 27727 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.639539 31972 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.639616 32397 raft_consensus.cc:2258] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:51.640717 32264 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.640889 32397 ts_tablet_manager.cc:1875] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:51.643144 32397 ts_tablet_manager.cc:1888] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 01:59:51.642982 31972 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.643236 32397 log.cc:1196] T 13a5600dc379460b9c433ffdaa0b3d02 P da58b5341d344efd833502f214e69ff1: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/13a5600dc379460b9c433ffdaa0b3d02
I20240502 01:59:51.643366 30008 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.645095 27565 catalog_manager.cc:4830] TS da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835): tablet 13a5600dc379460b9c433ffdaa0b3d02 (table rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]) successfully deleted
I20240502 01:59:51.645044 28534 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.645201 27998 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.646437 28131 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.646641 29869 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.647842 32410 tablet_replica.cc:330] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98: stopping tablet replica
I20240502 01:59:51.648303 32410 raft_consensus.cc:2229] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:51.648535 27574 catalog_manager.cc:5484] T e1bd5156bcca44438438c6ca78facd35 P 7332064716f04e84ba81c1f2b70821f9 reported cstate change: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.649070 32410 raft_consensus.cc:2258] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:51.650465 32410 ts_tablet_manager.cc:1875] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:51.650527 28400 consensus_queue.cc:237] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:51.652711 27727 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.652801 30146 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.653662 28263 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.654359 27728 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.654642 27998 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.655071 32392 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.655443 32392 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.655616 32395 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.656646 28264 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.657100 32263 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.657212 30008 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.657711 32393 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.657800 28534 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.658215 32263 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.661523 32410 ts_tablet_manager.cc:1888] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 01:59:51.661623 32410 log.cc:1196] T 86eb15ad9b1b4ee6ab734cdbb972d5d3 P a8c1908b1c554e7cbbb9bf9751b8ee98: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/86eb15ad9b1b4ee6ab734cdbb972d5d3
I20240502 01:59:51.661859 32263 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.662438 27997 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.663332 28534 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.663887 28264 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.664593 27566 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 3b56295cbe014d6894812ee0a64bc513 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:51.664990 27564 catalog_manager.cc:4830] TS a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731): tablet 86eb15ad9b1b4ee6ab734cdbb972d5d3 (table rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]) successfully deleted
I20240502 01:59:51.665004 30146 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.665261 27728 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.666476 27997 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.668124 27577 catalog_manager.cc:5484] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.670976 30008 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.672917 27863 consensus_queue.cc:237] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:51.674634 30008 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.674779 28131 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.675257 31736 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.675609 32412 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.676093 27843 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b56295cbe014d6894812ee0a64bc513 with delete_type TABLET_DATA_TOMBSTONED (TS a8c1908b1c554e7cbbb9bf9751b8ee98 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:35346
I20240502 01:59:51.676478 28264 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.676860 32412 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.677862 27997 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.678186 32410 tablet_replica.cc:330] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98: stopping tablet replica
I20240502 01:59:51.678457 28534 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.678586 32412 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.679332 31736 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.679342 32410 raft_consensus.cc:2229] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:51.679608 32410 raft_consensus.cc:2258] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:51.679956 32412 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.680394 30008 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.681530 28535 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.682708 28131 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.683542 27574 catalog_manager.cc:5484] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:51.684147 32410 ts_tablet_manager.cc:1875] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:51.685034 27997 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.685926 27564 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet e1bd5156bcca44438438c6ca78facd35 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:51.686215 28264 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.687373 32410 ts_tablet_manager.cc:1888] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 01:59:51.687494 32410 log.cc:1196] T 3b56295cbe014d6894812ee0a64bc513 P a8c1908b1c554e7cbbb9bf9751b8ee98: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/3b56295cbe014d6894812ee0a64bc513
I20240502 01:59:51.688297 27564 catalog_manager.cc:4830] TS a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731): tablet 3b56295cbe014d6894812ee0a64bc513 (table rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]) successfully deleted
I20240502 01:59:51.689319 29869 raft_consensus.cc:1261] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.689770 32412 consensus_queue.cc:1035] T e1bd5156bcca44438438c6ca78facd35 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.689810 27707 tablet_service.cc:1514] Processing DeleteTablet for tablet e1bd5156bcca44438438c6ca78facd35 with delete_type TABLET_DATA_TOMBSTONED (TS da58b5341d344efd833502f214e69ff1 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:38722
I20240502 01:59:51.690140 32397 tablet_replica.cc:330] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1: stopping tablet replica
I20240502 01:59:51.690335 32397 raft_consensus.cc:2229] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:51.690721 32397 raft_consensus.cc:2258] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:51.690888 29869 raft_consensus.cc:2932] T e1bd5156bcca44438438c6ca78facd35 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.692341 32397 ts_tablet_manager.cc:1875] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:51.695180 32397 ts_tablet_manager.cc:1888] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 01:59:51.695241 32397 log.cc:1196] T e1bd5156bcca44438438c6ca78facd35 P da58b5341d344efd833502f214e69ff1: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/e1bd5156bcca44438438c6ca78facd35
I20240502 01:59:51.695700 27565 catalog_manager.cc:4830] TS da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835): tablet e1bd5156bcca44438438c6ca78facd35 (table rebalance_test_table_5 [id=8202d074fd8846f7b81f42388210e19a]) successfully deleted
I20240502 01:59:51.732479 31939 raft_consensus.cc:1050] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb: attempting to promote NON_VOTER 0003837e2d88424093594ed169d82cd2 to VOTER
I20240502 01:59:51.732962 31939 consensus_queue.cc:237] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:51.734840 30146 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.734846 27997 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.734982 28400 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.735206 29869 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.735373 27863 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.735394 32356 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.735636 28264 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.735724 31729 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.735944 27728 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.736088 31936 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.736335 32355 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.736455 31936 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.736600 32356 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.736884 31729 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.739104 31939 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.739532 29869 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.740656 27997 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.743083 28264 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.743098 27863 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.743376 27579 catalog_manager.cc:5484] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2 reported cstate change: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.749114 30146 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.750221 27728 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.750459 28400 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.752979 28534 consensus_queue.cc:237] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:51.755558 29869 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.755694 27997 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.755806 27863 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.756098 32378 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.756210 32355 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.756306 30146 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.756793 32378 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.757032 32378 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.757860 28264 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.758440 31936 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.759028 28400 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.759394 32378 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.760180 32378 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.760644 32010 raft_consensus.cc:1050] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1: attempting to promote NON_VOTER 7332064716f04e84ba81c1f2b70821f9 to VOTER
I20240502 01:59:51.760618 30146 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.761168 32010 consensus_queue.cc:237] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:51.762540 29869 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.763422 27997 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.763653 28264 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.763818 30008 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.763818 32011 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.764225 32011 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.765122 27863 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.765193 28263 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.765487 31989 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.765765 30146 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.765915 31989 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.766414 27579 catalog_manager.cc:5484] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d reported cstate change: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.766501 27998 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.767180 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 0883c95dc88f4fb4a7a715c23fb7f078 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:51.769270 27707 tablet_service.cc:1514] Processing DeleteTablet for tablet 0883c95dc88f4fb4a7a715c23fb7f078 with delete_type TABLET_DATA_TOMBSTONED (TS da58b5341d344efd833502f214e69ff1 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:38722
I20240502 01:59:51.769508 32397 tablet_replica.cc:330] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1: stopping tablet replica
I20240502 01:59:51.769649 32397 raft_consensus.cc:2229] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:51.769766 31989 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.769887 32397 raft_consensus.cc:2258] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:51.770776 32397 ts_tablet_manager.cc:1875] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:51.772507 27863 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.773085 32397 ts_tablet_manager.cc:1888] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 01:59:51.773317 28534 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.774113 32397 log.cc:1196] T 0883c95dc88f4fb4a7a715c23fb7f078 P da58b5341d344efd833502f214e69ff1: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/0883c95dc88f4fb4a7a715c23fb7f078
I20240502 01:59:51.774618 28400 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.774484 28399 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.773772 32011 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.775310 32010 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.775887 27565 catalog_manager.cc:4830] TS da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835): tablet 0883c95dc88f4fb4a7a715c23fb7f078 (table rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]) successfully deleted
I20240502 01:59:51.777715 32011 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.778153 27997 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.778297 28534 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.779994 28264 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.780292 27863 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.780632 27577 catalog_manager.cc:5484] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:51.781145 30008 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.782840 30146 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.787565 28399 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.788252 27728 consensus_queue.cc:237] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:51.789733 28534 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.790042 30008 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.790283 28399 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.790411 32010 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.790549 27997 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.790988 30146 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.791323 32438 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.791512 32437 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.791743 32436 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.791867 28264 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.792186 32010 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.792492 32434 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.794768 32037 raft_consensus.cc:1050] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88: attempting to promote NON_VOTER 0003837e2d88424093594ed169d82cd2 to VOTER
I20240502 01:59:51.794838 31989 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.795325 32037 consensus_queue.cc:237] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:51.797390 30146 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.797466 27997 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.797467 29869 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.797564 28264 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.797945 27863 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.798375 31796 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.798525 32038 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.798504 30008 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.798830 32038 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.798981 31796 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.799837 28534 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.800843 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 5c23922560934ef3be8f4659d8727995 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:51.801013 32038 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.801075 27728 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.801501 27570 catalog_manager.cc:5484] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9 reported cstate change: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.802120 27998 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.802891 28534 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.804889 28131 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.805601 30146 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.805800 27843 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c23922560934ef3be8f4659d8727995 with delete_type TABLET_DATA_TOMBSTONED (TS a8c1908b1c554e7cbbb9bf9751b8ee98 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:35346
I20240502 01:59:51.806033 32410 tablet_replica.cc:330] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98: stopping tablet replica
I20240502 01:59:51.806165 32410 raft_consensus.cc:2229] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:51.806376 32410 raft_consensus.cc:2258] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:51.807154 32410 ts_tablet_manager.cc:1875] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:51.809012 32410 ts_tablet_manager.cc:1888] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 01:59:51.809062 32410 log.cc:1196] T 5c23922560934ef3be8f4659d8727995 P a8c1908b1c554e7cbbb9bf9751b8ee98: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/5c23922560934ef3be8f4659d8727995
I20240502 01:59:51.809571 27564 catalog_manager.cc:4830] TS a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731): tablet 5c23922560934ef3be8f4659d8727995 (table rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]) successfully deleted
I20240502 01:59:51.810671 32038 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.811172 32448 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.811267 28399 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:51.814098 32038 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.814420 28534 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.815997 30145 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.816844 28131 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.817005 27728 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.818534 27997 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.819643 27574 catalog_manager.cc:5484] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.820824 27863 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.820938 29869 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.826790 28264 consensus_queue.cc:237] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:51.828361 28131 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.828421 30145 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.828527 29869 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.828821 27997 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.828827 32038 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.829025 32449 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.829247 27863 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.829310 32449 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.829385 28534 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.829617 32449 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.829768 31796 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.830749 32449 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.831970 31796 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.832368 28534 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.833227 27997 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.834009 27563 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 9ee07ceb106a46778d215684d8fac8da with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:51.834232 28131 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.834394 30145 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.836453 29869 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.836570 27574 catalog_manager.cc:5484] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.837752 27863 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:51.840096 27707 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ee07ceb106a46778d215684d8fac8da with delete_type TABLET_DATA_TOMBSTONED (TS da58b5341d344efd833502f214e69ff1 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:38722
I20240502 01:59:51.840322 32397 tablet_replica.cc:330] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: stopping tablet replica
I20240502 01:59:51.840469 32397 raft_consensus.cc:2229] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:51.840750 32397 raft_consensus.cc:2258] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:51.841583 32397 ts_tablet_manager.cc:1875] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:51.843873 32397 ts_tablet_manager.cc:1888] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 01:59:51.843950 32397 log.cc:1196] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/9ee07ceb106a46778d215684d8fac8da
I20240502 01:59:51.844440 27565 catalog_manager.cc:4830] TS da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835): tablet 9ee07ceb106a46778d215684d8fac8da (table rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]) successfully deleted
I20240502 01:59:51.850657 32437 raft_consensus.cc:1050] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1: attempting to promote NON_VOTER 845294d663994245b540c006dca93b7d to VOTER
I20240502 01:59:51.851049 32437 consensus_queue.cc:237] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:51.852859 28264 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.852859 27863 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.852850 28399 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.853097 30145 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.853219 31989 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.853431 32435 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.853608 32436 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.853664 29869 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.853765 32438 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.854043 32011 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.854115 28534 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.854534 32435 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.854707 27997 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.855763 31989 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.857113 31989 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.858101 28264 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.858525 27997 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.858654 30145 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.861109 27574 catalog_manager.cc:5484] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f reported cstate change: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.861258 28534 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.861733 28399 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.862565 27863 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.866683 29869 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.868989 27728 consensus_queue.cc:237] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:51.870527 28399 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.870929 28535 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.871004 32434 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.871299 28264 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.871402 32434 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.871706 32010 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.873054 30145 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.873461 27997 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.873816 32010 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.873869 29869 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:51.874058 32434 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.874275 32438 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:51.874701 32438 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.875025 28399 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.876693 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet f7ccc60565e9447b8ab77927061813e5 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:51.877137 28264 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.877290 28534 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.880254 27579 catalog_manager.cc:5484] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.881759 27997 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.882871 29869 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.884080 30145 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.888871 27843 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ccc60565e9447b8ab77927061813e5 with delete_type TABLET_DATA_TOMBSTONED (TS a8c1908b1c554e7cbbb9bf9751b8ee98 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:35346
I20240502 01:59:51.889082 32410 tablet_replica.cc:330] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98: stopping tablet replica
I20240502 01:59:51.889218 32410 raft_consensus.cc:2229] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:51.889835 32410 raft_consensus.cc:2258] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:51.890594 32410 ts_tablet_manager.cc:1875] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:51.892361 32410 ts_tablet_manager.cc:1888] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 01:59:51.892431 32410 log.cc:1196] T f7ccc60565e9447b8ab77927061813e5 P a8c1908b1c554e7cbbb9bf9751b8ee98: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/f7ccc60565e9447b8ab77927061813e5
I20240502 01:59:51.892987 27564 catalog_manager.cc:4830] TS a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731): tablet f7ccc60565e9447b8ab77927061813e5 (table rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]) successfully deleted
I20240502 01:59:51.953318 32415 raft_consensus.cc:1050] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98: attempting to promote NON_VOTER 845294d663994245b540c006dca93b7d to VOTER
I20240502 01:59:51.953967 32415 consensus_queue.cc:237] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:51.956077 28534 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.956210 27728 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.956737 30008 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.956842 28399 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.957103 28131 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.957695 32414 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.957643 27997 consensus_queue.cc:237] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:51.958269 32264 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.958585 32264 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.958931 32264 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.960404 28535 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:51.960453 27727 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:51.960441 28264 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:51.960794 29869 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:51.960861 32465 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:51.961110 27863 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:51.961234 32465 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:51.961292 27997 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.961573 32465 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:51.961680 28399 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:51.961901 32465 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:51.962080 32528 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:51.962240 31972 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.962411 32465 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:51.963759 30145 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.966459 32414 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.966827 32414 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.967918 31556 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
W20240502 01:59:51.968652 27930 consensus_peers.cc:485] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f -> Peer 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201:40597): Couldn't send request to peer 7332064716f04e84ba81c1f2b70821f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dc925cbedd00454dbaa0e6b5e38b94d7. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:51.969324 28400 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:51.969784 29869 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:51.971030 28264 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:51.971197 27728 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:51.972079 27579 catalog_manager.cc:5484] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f reported cstate change: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "86e11777d9d744d0a5a8139c99e89f4f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:51.974426 28534 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:51.975507 32524 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.976848 28131 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.977281 27863 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:51.979542 30008 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.979571 28400 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.979738 27728 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.981730 27577 catalog_manager.cc:5484] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 reported cstate change: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.982775 27997 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.983628 28534 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.986984 30145 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:51.991708 32448 raft_consensus.cc:1050] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88: attempting to promote NON_VOTER 845294d663994245b540c006dca93b7d to VOTER
I20240502 01:59:51.992306 32448 consensus_queue.cc:237] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:51.994556 28534 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.994639 28400 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.994966 30008 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.995100 27728 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.995210 30145 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.995260 32553 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.995538 27863 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.995674 32448 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.995959 31796 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.996126 32038 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.996924 27997 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:51.997459 32038 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.997797 32448 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:51.998780 32449 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:52.000720 27728 consensus_queue.cc:237] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:52.001385 32449 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.001703 27862 consensus_queue.cc:237] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:52.001698 28534 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.003736 28400 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.003950 29869 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:52.004385 31989 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:52.005254 27862 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:52.005349 28534 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:52.006181 28131 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:52.006394 27571 catalog_manager.cc:5484] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.006672 28534 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:52.006767 30009 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:52.006831 30008 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.007036 32438 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:52.007691 27727 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.009428 27997 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
W20240502 01:59:52.010021 27661 consensus_peers.cc:485] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 -> Peer 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201:40597): Couldn't send request to peer 7332064716f04e84ba81c1f2b70821f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77e62ec43c8d442b9846f05439ac7a99. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:52.010324 32438 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:52.010298 32524 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:52.010648 32524 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:52.011140 31972 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:52.011140 32438 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:52.011863 27998 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:52.012140 28131 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:52.012300 31972 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:52.012527 32438 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:52.013031 30146 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.013116 27996 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.014132 28399 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:52.014132 28400 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:52.015151 31972 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:52.016357 31989 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:52.016566 32438 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:52.017323 30145 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:52.017386 27863 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:52.018587 31972 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.019201 28534 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:52.020042 31972 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:52.021595 29869 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:52.022337 28399 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:52.024219 27996 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.024329 27572 catalog_manager.cc:5484] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2 reported cstate change: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:52.024533 28130 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:52.027457 30145 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.027966 27564 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:52.028262 28130 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.028810 28534 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.029359 27576 catalog_manager.cc:5484] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f reported cstate change: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.031021 28401 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.031157 27862 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.032512 27707 tablet_service.cc:1514] Processing DeleteTablet for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 with delete_type TABLET_DATA_TOMBSTONED (TS da58b5341d344efd833502f214e69ff1 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:38722
I20240502 01:59:52.032755 32397 tablet_replica.cc:330] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1: stopping tablet replica
I20240502 01:59:52.032910 32397 raft_consensus.cc:2229] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:52.033176 32397 raft_consensus.cc:2258] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:52.034704 32397 ts_tablet_manager.cc:1875] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:52.036798 32397 ts_tablet_manager.cc:1888] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 01:59:52.036873 32397 log.cc:1196] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P da58b5341d344efd833502f214e69ff1: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/dc0c5e7b20cd4fb8ac78ae2bff4f8187
I20240502 01:59:52.036988 30008 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.037369 27565 catalog_manager.cc:4830] TS da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835): tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 (table rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]) successfully deleted
I20240502 01:59:52.039013 28264 consensus_queue.cc:237] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:52.040937 28400 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:52.040990 30145 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:52.041098 27997 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:52.041472 32037 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:52.041795 28534 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:52.041867 30008 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:52.042260 32447 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:52.042423 31796 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:52.042572 32553 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:52.043272 32037 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:52.043963 27727 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:52.045346 32447 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:52.046284 30145 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.046447 28400 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.048713 27727 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.048700 27997 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:52.049336 27862 consensus_queue.cc:237] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:52.051662 27574 catalog_manager.cc:5484] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d reported cstate change: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.051868 30008 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:52.052214 28130 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:52.052259 31736 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:52.052785 31736 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:52.053740 27996 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
W20240502 01:59:52.054100 27796 consensus_peers.cc:485] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 -> Peer 845294d663994245b540c006dca93b7d (127.10.133.202:45645): Couldn't send request to peer 845294d663994245b540c006dca93b7d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 798ef14558d44d01911b4c8453c2b126. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:52.054605 28535 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:52.054685 28400 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:52.055040 32415 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:52.045822 32037 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.055444 32415 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:52.055774 32415 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:52.057361 27563 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 25d8fba21674442fbd100478245ff9aa with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:52.058372 28534 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.058624 27996 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.059882 27727 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:52.060092 27843 tablet_service.cc:1514] Processing DeleteTablet for tablet 25d8fba21674442fbd100478245ff9aa with delete_type TABLET_DATA_TOMBSTONED (TS a8c1908b1c554e7cbbb9bf9751b8ee98 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:35346
I20240502 01:59:52.060762 32410 tablet_replica.cc:330] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98: stopping tablet replica
I20240502 01:59:52.060994 32410 raft_consensus.cc:2229] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:52.061247 32410 raft_consensus.cc:2258] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:52.061513 30008 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:52.062235 32410 ts_tablet_manager.cc:1875] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:52.064996 32410 ts_tablet_manager.cc:1888] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 01:59:52.065117 32410 log.cc:1196] T 25d8fba21674442fbd100478245ff9aa P a8c1908b1c554e7cbbb9bf9751b8ee98: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/25d8fba21674442fbd100478245ff9aa
I20240502 01:59:52.065775 27564 catalog_manager.cc:4830] TS a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731): tablet 25d8fba21674442fbd100478245ff9aa (table rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]) successfully deleted
I20240502 01:59:52.067027 32412 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:52.067492 32264 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:52.068277 28400 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:52.069095 27997 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:52.069095 28130 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:52.071364 27570 catalog_manager.cc:5484] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:52.071946 27727 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:52.074715 30008 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:52.075176 28534 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:52.453961 32635 ts_tablet_manager.cc:902] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9: Initiating tablet copy from peer 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917)
I20240502 01:59:52.454501 32635 tablet_copy_client.cc:308] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.195:42917
I20240502 01:59:52.459151 28020 tablet_copy_service.cc:140] P 86e11777d9d744d0a5a8139c99e89f4f: Received BeginTabletCopySession request for tablet dc925cbedd00454dbaa0e6b5e38b94d7 from peer 7332064716f04e84ba81c1f2b70821f9 ({username='slave'} at 127.10.133.201:54361)
I20240502 01:59:52.459259 28020 tablet_copy_service.cc:161] P 86e11777d9d744d0a5a8139c99e89f4f: Beginning new tablet copy session on tablet dc925cbedd00454dbaa0e6b5e38b94d7 from peer 7332064716f04e84ba81c1f2b70821f9 at {username='slave'} at 127.10.133.201:54361: session id = 7332064716f04e84ba81c1f2b70821f9-dc925cbedd00454dbaa0e6b5e38b94d7
I20240502 01:59:52.459942 28020 tablet_copy_source_session.cc:205] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:52.460836 32635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc925cbedd00454dbaa0e6b5e38b94d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:52.474892 32641 ts_tablet_manager.cc:902] T 77e62ec43c8d442b9846f05439ac7a99 P 7332064716f04e84ba81c1f2b70821f9: Initiating tablet copy from peer da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835)
I20240502 01:59:52.475450 32641 tablet_copy_client.cc:308] T 77e62ec43c8d442b9846f05439ac7a99 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:40835
I20240502 01:59:52.475870 27749 tablet_copy_service.cc:140] P da58b5341d344efd833502f214e69ff1: Received BeginTabletCopySession request for tablet 77e62ec43c8d442b9846f05439ac7a99 from peer 7332064716f04e84ba81c1f2b70821f9 ({username='slave'} at 127.10.133.201:59089)
I20240502 01:59:52.475973 27749 tablet_copy_service.cc:161] P da58b5341d344efd833502f214e69ff1: Beginning new tablet copy session on tablet 77e62ec43c8d442b9846f05439ac7a99 from peer 7332064716f04e84ba81c1f2b70821f9 at {username='slave'} at 127.10.133.201:59089: session id = 7332064716f04e84ba81c1f2b70821f9-77e62ec43c8d442b9846f05439ac7a99
I20240502 01:59:52.476934 27749 tablet_copy_source_session.cc:205] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:52.478042 32641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77e62ec43c8d442b9846f05439ac7a99. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:52.483721 32641 tablet_copy_client.cc:783] T 77e62ec43c8d442b9846f05439ac7a99 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:52.483796 32635 tablet_copy_client.cc:783] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:52.483891 32641 tablet_copy_client.cc:647] T 77e62ec43c8d442b9846f05439ac7a99 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:52.483968 32635 tablet_copy_client.cc:647] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:52.485188 32641 tablet_copy_client.cc:523] T 77e62ec43c8d442b9846f05439ac7a99 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:52.485244 32635 tablet_copy_client.cc:523] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:52.486413 32641 tablet_bootstrap.cc:492] T 77e62ec43c8d442b9846f05439ac7a99 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap starting.
I20240502 01:59:52.486527 32635 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap starting.
I20240502 01:59:52.506829 32641 tablet_bootstrap.cc:492] T 77e62ec43c8d442b9846f05439ac7a99 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:52.507055 32635 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:52.507117 32641 tablet_bootstrap.cc:492] T 77e62ec43c8d442b9846f05439ac7a99 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap complete.
I20240502 01:59:52.507279 32641 ts_tablet_manager.cc:1367] T 77e62ec43c8d442b9846f05439ac7a99 P 7332064716f04e84ba81c1f2b70821f9: Time spent bootstrapping tablet: real 0.021s user 0.016s sys 0.003s
I20240502 01:59:52.507371 32635 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap complete.
I20240502 01:59:52.507534 32635 ts_tablet_manager.cc:1367] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9: Time spent bootstrapping tablet: real 0.021s user 0.018s sys 0.003s
I20240502 01:59:52.507716 32641 raft_consensus.cc:348] T 77e62ec43c8d442b9846f05439ac7a99 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:52.507850 32641 raft_consensus.cc:729] T 77e62ec43c8d442b9846f05439ac7a99 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7332064716f04e84ba81c1f2b70821f9, State: Initialized, Role: LEARNER
I20240502 01:59:52.507962 32641 consensus_queue.cc:260] T 77e62ec43c8d442b9846f05439ac7a99 P 7332064716f04e84ba81c1f2b70821f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:52.508066 32635 raft_consensus.cc:348] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:52.508198 32635 raft_consensus.cc:729] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7332064716f04e84ba81c1f2b70821f9, State: Initialized, Role: LEARNER
I20240502 01:59:52.508272 32641 ts_tablet_manager.cc:1398] T 77e62ec43c8d442b9846f05439ac7a99 P 7332064716f04e84ba81c1f2b70821f9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:52.508308 32635 consensus_queue.cc:260] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:52.508694 32635 ts_tablet_manager.cc:1398] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:52.509348 28020 tablet_copy_service.cc:342] P 86e11777d9d744d0a5a8139c99e89f4f: Request end of tablet copy session 7332064716f04e84ba81c1f2b70821f9-dc925cbedd00454dbaa0e6b5e38b94d7 received from {username='slave'} at 127.10.133.201:54361
I20240502 01:59:52.509446 28020 tablet_copy_service.cc:433] P 86e11777d9d744d0a5a8139c99e89f4f: ending tablet copy session 7332064716f04e84ba81c1f2b70821f9-dc925cbedd00454dbaa0e6b5e38b94d7 on tablet dc925cbedd00454dbaa0e6b5e38b94d7 with peer 7332064716f04e84ba81c1f2b70821f9
I20240502 01:59:52.509598 27749 tablet_copy_service.cc:342] P da58b5341d344efd833502f214e69ff1: Request end of tablet copy session 7332064716f04e84ba81c1f2b70821f9-77e62ec43c8d442b9846f05439ac7a99 received from {username='slave'} at 127.10.133.201:59089
I20240502 01:59:52.509670 27749 tablet_copy_service.cc:433] P da58b5341d344efd833502f214e69ff1: ending tablet copy session 7332064716f04e84ba81c1f2b70821f9-77e62ec43c8d442b9846f05439ac7a99 on tablet 77e62ec43c8d442b9846f05439ac7a99 with peer 7332064716f04e84ba81c1f2b70821f9
I20240502 01:59:52.535810 32649 ts_tablet_manager.cc:902] T 798ef14558d44d01911b4c8453c2b126 P 845294d663994245b540c006dca93b7d: Initiating tablet copy from peer a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731)
I20240502 01:59:52.536374 32649 tablet_copy_client.cc:308] T 798ef14558d44d01911b4c8453c2b126 P 845294d663994245b540c006dca93b7d: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37731
I20240502 01:59:52.536849 27885 tablet_copy_service.cc:140] P a8c1908b1c554e7cbbb9bf9751b8ee98: Received BeginTabletCopySession request for tablet 798ef14558d44d01911b4c8453c2b126 from peer 845294d663994245b540c006dca93b7d ({username='slave'} at 127.10.133.202:46705)
I20240502 01:59:52.536969 27885 tablet_copy_service.cc:161] P a8c1908b1c554e7cbbb9bf9751b8ee98: Beginning new tablet copy session on tablet 798ef14558d44d01911b4c8453c2b126 from peer 845294d663994245b540c006dca93b7d at {username='slave'} at 127.10.133.202:46705: session id = 845294d663994245b540c006dca93b7d-798ef14558d44d01911b4c8453c2b126
I20240502 01:59:52.538048 27885 tablet_copy_source_session.cc:205] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:52.539170 32649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 798ef14558d44d01911b4c8453c2b126. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:52.541045 32649 tablet_copy_client.cc:783] T 798ef14558d44d01911b4c8453c2b126 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:52.541203 32649 tablet_copy_client.cc:647] T 798ef14558d44d01911b4c8453c2b126 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:52.542235 32649 tablet_copy_client.cc:523] T 798ef14558d44d01911b4c8453c2b126 P 845294d663994245b540c006dca93b7d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:52.543164 32649 tablet_bootstrap.cc:492] T 798ef14558d44d01911b4c8453c2b126 P 845294d663994245b540c006dca93b7d: Bootstrap starting.
I20240502 01:59:52.567847 32649 tablet_bootstrap.cc:492] T 798ef14558d44d01911b4c8453c2b126 P 845294d663994245b540c006dca93b7d: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:52.568183 32649 tablet_bootstrap.cc:492] T 798ef14558d44d01911b4c8453c2b126 P 845294d663994245b540c006dca93b7d: Bootstrap complete.
I20240502 01:59:52.568373 32649 ts_tablet_manager.cc:1367] T 798ef14558d44d01911b4c8453c2b126 P 845294d663994245b540c006dca93b7d: Time spent bootstrapping tablet: real 0.025s user 0.019s sys 0.006s
I20240502 01:59:52.569150 32649 raft_consensus.cc:348] T 798ef14558d44d01911b4c8453c2b126 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:52.569293 32649 raft_consensus.cc:729] T 798ef14558d44d01911b4c8453c2b126 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 845294d663994245b540c006dca93b7d, State: Initialized, Role: LEARNER
I20240502 01:59:52.569419 32649 consensus_queue.cc:260] T 798ef14558d44d01911b4c8453c2b126 P 845294d663994245b540c006dca93b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:52.569792 32649 ts_tablet_manager.cc:1398] T 798ef14558d44d01911b4c8453c2b126 P 845294d663994245b540c006dca93b7d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:52.570289 27885 tablet_copy_service.cc:342] P a8c1908b1c554e7cbbb9bf9751b8ee98: Request end of tablet copy session 845294d663994245b540c006dca93b7d-798ef14558d44d01911b4c8453c2b126 received from {username='slave'} at 127.10.133.202:46705
I20240502 01:59:52.570376 27885 tablet_copy_service.cc:433] P a8c1908b1c554e7cbbb9bf9751b8ee98: ending tablet copy session 845294d663994245b540c006dca93b7d-798ef14558d44d01911b4c8453c2b126 on tablet 798ef14558d44d01911b4c8453c2b126 with peer 845294d663994245b540c006dca93b7d
I20240502 01:59:52.914155 30009 raft_consensus.cc:1203] T 77e62ec43c8d442b9846f05439ac7a99 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 01:59:52.944073 30146 raft_consensus.cc:1203] T 798ef14558d44d01911b4c8453c2b126 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 01:59:53.047852 30009 raft_consensus.cc:1203] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 01:59:53.360560 32413 raft_consensus.cc:1050] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98: attempting to promote NON_VOTER 845294d663994245b540c006dca93b7d to VOTER
I20240502 01:59:53.361104 32413 consensus_queue.cc:237] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:53.363224 27727 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.363382 28534 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.363652 30008 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.363672 27997 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.364068 28130 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.364039 32723 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.364241 32722 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.364495 32725 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.364734 30145 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.364758 32723 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.365131 32723 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.365504 32723 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.365581 28400 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.366020 32722 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.368552 32413 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:53.369043 27727 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:53.369277 30145 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:53.370008 28400 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:53.371888 28534 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:53.372630 27575 catalog_manager.cc:5484] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:53.378556 27997 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:53.380306 28130 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:53.380604 30008 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:53.387014 27862 consensus_queue.cc:237] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:53.388794 28534 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:53.388852 30145 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:53.388852 27997 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:53.389037 28400 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:53.389189 31736 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:53.389369 32723 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:53.389569 32722 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:53.389654 28130 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:53.389878 31736 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:53.390247 31736 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:53.390285 30008 raft_consensus.cc:1261] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:53.390763 31736 consensus_queue.cc:1035] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:53.393043 32724 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:53.393564 30145 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:53.393790 27997 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:53.396261 27564 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 798ef14558d44d01911b4c8453c2b126 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:53.396167 28534 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:53.396167 30008 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:53.396664 27570 catalog_manager.cc:5484] T 798ef14558d44d01911b4c8453c2b126 P 86e11777d9d744d0a5a8139c99e89f4f reported cstate change: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:53.398610 28130 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:53.400213 27707 tablet_service.cc:1514] Processing DeleteTablet for tablet 798ef14558d44d01911b4c8453c2b126 with delete_type TABLET_DATA_TOMBSTONED (TS da58b5341d344efd833502f214e69ff1 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:38722
I20240502 01:59:53.401006 32737 tablet_replica.cc:330] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1: stopping tablet replica
I20240502 01:59:53.400851 28400 raft_consensus.cc:2932] T 798ef14558d44d01911b4c8453c2b126 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:53.401307 32737 raft_consensus.cc:2229] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:53.401703 32737 raft_consensus.cc:2258] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:53.402994 32737 ts_tablet_manager.cc:1875] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:53.404987 32737 ts_tablet_manager.cc:1888] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 01:59:53.405057 32737 log.cc:1196] T 798ef14558d44d01911b4c8453c2b126 P da58b5341d344efd833502f214e69ff1: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/798ef14558d44d01911b4c8453c2b126
I20240502 01:59:53.405586 27565 catalog_manager.cc:4830] TS da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835): tablet 798ef14558d44d01911b4c8453c2b126 (table rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]) successfully deleted
I20240502 01:59:53.498256 32435 raft_consensus.cc:1050] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1: attempting to promote NON_VOTER 7332064716f04e84ba81c1f2b70821f9 to VOTER
I20240502 01:59:53.498713 32435 consensus_queue.cc:237] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:53.500535 30008 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.500658 28400 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.500772 29869 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.500885 27862 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.501081 32766 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.501158 28130 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.501224 27997 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.501808 32766 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.502223 32436 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.502373 32767 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.502676 32765 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.502943 32435 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.504158 28534 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.504889 32704 raft_consensus.cc:1050] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f: attempting to promote NON_VOTER 7332064716f04e84ba81c1f2b70821f9 to VOTER
I20240502 01:59:53.505474 32704 consensus_queue.cc:237] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:53.505728 32435 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.507221 28130 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.507551 28535 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.507673 28400 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.507951 32703 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.508196 29869 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.509464 32528 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.506772 32765 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.509797 32528 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.510232 27571 catalog_manager.cc:5484] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 reported cstate change: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.511902 29870 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.512311 28263 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.512472 30008 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.512516 30009 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.512866 32703 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.514516 27862 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.514886 27997 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.515626 311 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.516227 28399 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.517870 28534 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.518540 27727 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.518923 311 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.520941 27728 consensus_queue.cc:237] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:53.521203 311 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.523141 30008 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:53.523263 28130 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:53.523584 27997 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:53.523730 29869 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:53.524078 27727 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.524093 28263 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.524379 28400 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:53.526104 32765 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:53.526536 32764 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:53.526893 32764 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:53.527555 32767 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:53.527666 29869 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.528016 32767 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:53.528842 27570 catalog_manager.cc:5484] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86e11777d9d744d0a5a8139c99e89f4f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.531380 28535 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.531735 27862 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:53.532158 28534 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:53.533131 32436 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:53.533375 32704 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:53.533500 32765 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.534116 30009 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.534531 29870 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.535751 28130 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.536247 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 77e62ec43c8d442b9846f05439ac7a99 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:53.536444 27862 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.537110 27997 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.538976 28399 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.539099 27574 catalog_manager.cc:5484] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 reported cstate change: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.541152 30008 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.542471 28535 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.546787 28399 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:53.548314 27843 tablet_service.cc:1514] Processing DeleteTablet for tablet 77e62ec43c8d442b9846f05439ac7a99 with delete_type TABLET_DATA_TOMBSTONED (TS a8c1908b1c554e7cbbb9bf9751b8ee98 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:35346
I20240502 01:59:53.549418 322 tablet_replica.cc:330] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98: stopping tablet replica
I20240502 01:59:53.549710 322 raft_consensus.cc:2229] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:53.550107 322 raft_consensus.cc:2258] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:53.550925 322 ts_tablet_manager.cc:1875] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:53.552889 322 ts_tablet_manager.cc:1888] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 01:59:53.552965 322 log.cc:1196] T 77e62ec43c8d442b9846f05439ac7a99 P a8c1908b1c554e7cbbb9bf9751b8ee98: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/77e62ec43c8d442b9846f05439ac7a99
I20240502 01:59:53.553414 27564 catalog_manager.cc:4830] TS a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731): tablet 77e62ec43c8d442b9846f05439ac7a99 (table rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]) successfully deleted
I20240502 01:59:54.109462 27996 consensus_queue.cc:237] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:54.111007 30008 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:54.111112 29870 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:54.111387 28263 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:54.111505 28399 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:54.111639 28535 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:54.111671 350 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:54.111868 311 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:54.112032 352 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:54.112210 351 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:54.112470 352 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:54.112497 27862 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:54.112828 351 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:54.115037 349 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:54.115883 28263 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:54.116261 29870 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:54.118176 27564 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet dc925cbedd00454dbaa0e6b5e38b94d7 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:54.117959 28535 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:54.119689 27574 catalog_manager.cc:5484] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f reported cstate change: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New cstate: current_term: 1 leader_uuid: "86e11777d9d744d0a5a8139c99e89f4f" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:54.120019 28399 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:54.122609 27862 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:54.123227 30008 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:54.127269 27707 tablet_service.cc:1514] Processing DeleteTablet for tablet dc925cbedd00454dbaa0e6b5e38b94d7 with delete_type TABLET_DATA_TOMBSTONED (TS da58b5341d344efd833502f214e69ff1 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:38722
I20240502 01:59:54.127715 361 tablet_replica.cc:330] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1: stopping tablet replica
I20240502 01:59:54.127981 361 raft_consensus.cc:2229] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:54.128790 361 raft_consensus.cc:2258] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:54.129648 361 ts_tablet_manager.cc:1875] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:54.131443 361 ts_tablet_manager.cc:1888] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 01:59:54.131522 361 log.cc:1196] T dc925cbedd00454dbaa0e6b5e38b94d7 P da58b5341d344efd833502f214e69ff1: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-0/wal/wals/dc925cbedd00454dbaa0e6b5e38b94d7
I20240502 01:59:54.131965 27565 catalog_manager.cc:4830] TS da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835): tablet dc925cbedd00454dbaa0e6b5e38b94d7 (table rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]) successfully deleted
I20240502 01:59:54.359522 28380 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:59:54.361202 29852 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:54.361723 28513 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:59:54.369025 28246 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:59:54.378136 28112 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:54.383579 29987 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:54.390841 30124 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:54.391873 27707 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:54.422570 27843 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:54.427371 27978 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:54.541293 29852 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:54.545593 28513 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:59:54.546161 28112 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:54.546571 28380 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:59:54.554528 29987 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:54.558439 28246 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:59:54.565157 27978 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:54.583058 30124 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:54.590162 27707 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:54.617316 27843 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:54.655741 28263 consensus_queue.cc:237] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: NON_VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: true } }
I20240502 01:59:54.657835 27862 consensus_queue.cc:237] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: true } }
I20240502 01:59:54.658329 29870 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
W20240502 01:59:54.658346 28201 consensus_peers.cc:485] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 -> Peer da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835): Couldn't send request to peer da58b5341d344efd833502f214e69ff1. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:54.658744 489 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.659765 30145 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.659898 28130 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.660372 27996 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.660495 28130 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.660507 30008 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.660847 32037 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.661005 28400 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.661010 362 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.661100 28535 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.661394 362 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.661504 28535 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.661736 362 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.662310 27996 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.662600 32037 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.662921 30145 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.662945 32037 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.662955 32413 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.663116 496 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.663219 32037 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.663336 497 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20240502 01:59:54.665123 27795 consensus_peers.cc:485] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 -> Peer 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567): Couldn't send request to peer 8ed4b4242123404f86485ec57dc34e88. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:54.666513 27862 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.666862 490 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.666994 495 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: true } } }
I20240502 01:59:54.667457 28263 consensus_queue.cc:237] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:54.667439 27997 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: true } } }
I20240502 01:59:54.669854 28400 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: true } } }
I20240502 01:59:54.670414 27571 catalog_manager.cc:5484] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f reported cstate change: config changed from index 10 to 11, NON_VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) added. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: true } } }
I20240502 01:59:54.670826 27727 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.670830 30008 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.671244 32037 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20240502 01:59:54.671422 28200 consensus_peers.cc:485] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 -> Peer 0003837e2d88424093594ed169d82cd2 (127.10.133.200:45585): Couldn't send request to peer 0003837e2d88424093594ed169d82cd2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 25d8fba21674442fbd100478245ff9aa. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:54.671569 491 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.671772 28535 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.671962 30144 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.672613 491 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.673027 28400 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.673558 28535 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: true } } }
I20240502 01:59:54.674075 491 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.677453 510 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:54.678016 30008 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:54.678282 491 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.678742 491 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: NON_VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: true } } }
I20240502 01:59:54.679687 28535 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:54.681457 28130 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: NON_VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: true } } }
I20240502 01:59:54.681603 28400 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:54.682955 27996 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: NON_VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: true } } }
I20240502 01:59:54.683007 28131 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: true } } }
I20240502 01:59:54.683183 27997 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.683605 488 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.683576 30145 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:54.684721 27997 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:54.685040 27578 catalog_manager.cc:5484] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 10 to 11, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:54.685122 30144 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: NON_VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: true } } }
I20240502 01:59:54.688164 27727 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:54.688388 29870 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: NON_VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: true } } }
I20240502 01:59:54.689121 28535 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: NON_VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: true } } }
I20240502 01:59:54.690455 30008 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: true } } }
I20240502 01:59:54.692646 30146 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: true } } }
I20240502 01:59:54.697634 27570 catalog_manager.cc:5484] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 reported cstate change: config changed from index 10 to 11, NON_VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) added. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: NON_VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: true } } }
I20240502 01:59:54.705086 28263 consensus_queue.cc:237] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } }
I20240502 01:59:54.707738 30145 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:54.707756 27997 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
W20240502 01:59:54.708281 28200 consensus_peers.cc:485] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 -> Peer 0003837e2d88424093594ed169d82cd2 (127.10.133.200:45585): Couldn't send request to peer 0003837e2d88424093594ed169d82cd2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 25d8fba21674442fbd100478245ff9aa. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:54.708379 491 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:54.708384 27862 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER da58b5341d344efd833502f214e69ff1 (127.10.133.193) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: NON_VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: true } } }
I20240502 01:59:54.708650 491 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:54.709245 28400 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:54.709738 489 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20240502 01:59:54.710326 28199 consensus_peers.cc:485] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 -> Peer 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553): Couldn't send request to peer 82e8cba6ed104c2c9869ea0365bbe482. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:54.711514 30008 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:54.713232 28535 consensus_queue.cc:237] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:54.714712 28534 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:54.714715 489 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20240502 01:59:54.715240 28468 consensus_peers.cc:485] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb -> Peer 845294d663994245b540c006dca93b7d (127.10.133.202:45645): Couldn't send request to peer 845294d663994245b540c006dca93b7d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13a5600dc379460b9c433ffdaa0b3d02. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:54.715359 489 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:54.715751 30009 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.716338 28264 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.716517 28130 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.716542 29870 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.716619 548 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.716949 32705 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.717104 549 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.717350 27862 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.717691 550 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.718139 550 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.719161 27997 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.720050 27727 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:54.720449 489 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:54.720718 550 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.721577 489 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.723783 27996 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.723752 28400 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.723809 28535 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.724874 550 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:54.726790 27570 catalog_manager.cc:5484] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f reported cstate change: config changed from index 11 to 12, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.726845 30008 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.728093 27727 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.729060 30145 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.733479 30008 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:54.734290 28263 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:54.735845 29870 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:54.735915 27997 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:54.737740 27862 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:54.738005 28130 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:54.742974 27579 catalog_manager.cc:5484] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index 10 to 11, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:54.748826 27728 consensus_queue.cc:237] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } }
I20240502 01:59:54.748826 27727 consensus_queue.cc:237] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
W20240502 01:59:54.751636 27661 consensus_peers.cc:485] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 -> Peer 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553): Couldn't send request to peer 82e8cba6ed104c2c9869ea0365bbe482. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:54.751881 30008 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.752228 28264 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:54.752236 28263 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.752804 28399 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:54.752894 32767 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:54.752969 30145 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.753222 32767 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.753284 30146 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:54.753569 28400 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.754185 28535 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.754191 28534 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:54.754336 27862 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:54.754346 27996 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:54.754776 574 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20240502 01:59:54.754981 27662 consensus_peers.cc:485] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 -> Peer 0003837e2d88424093594ed169d82cd2 (127.10.133.200:45585): Couldn't send request to peer 0003837e2d88424093594ed169d82cd2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 110a6faea0904da9970934cb2aba94c6. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:54.755712 27997 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.756588 581 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:54.757117 574 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:54.757848 32767 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.758047 581 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:54.759465 32767 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.759627 574 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.759876 575 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:54.760217 32767 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.763422 575 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.764215 30008 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.764725 27996 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.763814 578 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.766971 27571 catalog_manager.cc:5484] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9 reported cstate change: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.767134 30145 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.772861 28263 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.773043 28534 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.773464 572 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:54.774221 30146 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:54.776568 27862 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:54.776990 27571 catalog_manager.cc:5484] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d reported cstate change: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:54.779178 28263 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:54.781283 28399 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:54.782760 28535 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:54.783331 27997 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } }
I20240502 01:59:54.786620 28400 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.789927 28400 consensus_queue.cc:237] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } }
I20240502 01:59:54.794072 28263 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
W20240502 01:59:54.794207 28333 consensus_peers.cc:485] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 -> Peer 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553): Couldn't send request to peer 82e8cba6ed104c2c9869ea0365bbe482. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:54.794533 29870 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:54.794788 27862 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:54.794965 32393 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:54.795029 28535 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:54.795413 32393 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:54.795528 27727 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:54.795749 32393 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:54.796361 27997 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:54.797017 32393 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:54.797372 32393 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:54.797590 607 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:54.799444 608 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.799852 27862 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.801448 28535 consensus_queue.cc:237] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:54.802155 28534 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.803150 29870 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
W20240502 01:59:54.803611 28467 consensus_peers.cc:485] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb -> Peer 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201:40597): Couldn't send request to peer 7332064716f04e84ba81c1f2b70821f9. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0883c95dc88f4fb4a7a715c23fb7f078. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:54.804114 29869 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.804059 27575 catalog_manager.cc:5484] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 reported cstate change: config changed from index 7 to 8, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.804738 30146 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.804713 547 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.804831 27996 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.805274 550 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.805595 550 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.806185 28263 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.806182 28400 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.806315 27862 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.806577 548 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.806722 547 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.808494 27727 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.810462 28263 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.813268 548 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.816668 548 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:54.816968 27997 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.819041 28400 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:54.820658 28264 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:54.821306 30146 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:54.823325 29870 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:54.825258 27579 catalog_manager.cc:5484] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 10 to 11, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:54.825564 27997 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:54.825788 27862 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } } }
I20240502 01:59:54.827360 27727 consensus_queue.cc:237] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } }
I20240502 01:59:54.829408 28534 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.829408 28400 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.829825 572 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.830085 27997 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.830420 28264 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.830727 29870 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.830798 575 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.831104 570 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.831368 574 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.831640 30146 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
W20240502 01:59:54.832031 27661 consensus_peers.cc:485] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 -> Peer 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553): Couldn't send request to peer 82e8cba6ed104c2c9869ea0365bbe482. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:54.833197 574 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.834661 572 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.836319 572 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.837015 28534 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.837209 30146 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.839784 27570 catalog_manager.cc:5484] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:54.842700 28400 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.842900 28264 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.844367 29870 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.847887 27997 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.859025 28400 consensus_queue.cc:237] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } }
I20240502 01:59:54.861220 30146 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
W20240502 01:59:54.861353 28333 consensus_peers.cc:485] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 -> Peer 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196:41553): Couldn't send request to peer 82e8cba6ed104c2c9869ea0365bbe482. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:54.861826 32393 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.862084 28534 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.862325 27997 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.863034 27727 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.863271 604 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.863456 606 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.863787 604 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.864331 30008 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.864423 28264 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:54.864815 604 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.866600 604 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:54.867383 604 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.869525 30008 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.869925 30146 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.870323 27574 catalog_manager.cc:5484] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:54.871279 27997 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.872385 27727 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.873466 28534 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:54.876636 28264 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } }
I20240502 01:59:55.088205 722 ts_tablet_manager.cc:902] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: Initiating tablet copy from peer 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567)
I20240502 01:59:55.089033 722 tablet_copy_client.cc:308] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.197:46567
I20240502 01:59:55.089596 28288 tablet_copy_service.cc:140] P 8ed4b4242123404f86485ec57dc34e88: Received BeginTabletCopySession request for tablet 25d8fba21674442fbd100478245ff9aa from peer 82e8cba6ed104c2c9869ea0365bbe482 ({username='slave'} at 127.10.133.196:45853)
I20240502 01:59:55.089705 28288 tablet_copy_service.cc:161] P 8ed4b4242123404f86485ec57dc34e88: Beginning new tablet copy session on tablet 25d8fba21674442fbd100478245ff9aa from peer 82e8cba6ed104c2c9869ea0365bbe482 at {username='slave'} at 127.10.133.196:45853: session id = 82e8cba6ed104c2c9869ea0365bbe482-25d8fba21674442fbd100478245ff9aa
I20240502 01:59:55.090909 28288 tablet_copy_source_session.cc:205] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:55.092046 722 ts_tablet_manager.cc:1875] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 01:59:55.093945 722 ts_tablet_manager.cc:1888] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.6
I20240502 01:59:55.094164 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25d8fba21674442fbd100478245ff9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:55.095292 722 tablet_copy_client.cc:783] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:55.095468 722 tablet_copy_client.cc:647] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:55.095677 727 ts_tablet_manager.cc:902] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2: Initiating tablet copy from peer 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567)
I20240502 01:59:55.096259 727 tablet_copy_client.cc:308] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.197:46567
I20240502 01:59:55.096700 28288 tablet_copy_service.cc:140] P 8ed4b4242123404f86485ec57dc34e88: Received BeginTabletCopySession request for tablet 25d8fba21674442fbd100478245ff9aa from peer 0003837e2d88424093594ed169d82cd2 ({username='slave'} at 127.10.133.200:53299)
I20240502 01:59:55.096804 28288 tablet_copy_service.cc:161] P 8ed4b4242123404f86485ec57dc34e88: Beginning new tablet copy session on tablet 25d8fba21674442fbd100478245ff9aa from peer 0003837e2d88424093594ed169d82cd2 at {username='slave'} at 127.10.133.200:53299: session id = 0003837e2d88424093594ed169d82cd2-25d8fba21674442fbd100478245ff9aa
I20240502 01:59:55.097074 722 tablet_copy_client.cc:523] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:55.097589 28288 tablet_copy_source_session.cc:205] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:55.098487 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25d8fba21674442fbd100478245ff9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:55.098634 722 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:55.100152 727 tablet_copy_client.cc:783] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:55.100292 727 tablet_copy_client.cc:647] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:55.103116 727 tablet_copy_client.cc:523] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:55.104161 727 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2: Bootstrap starting.
I20240502 01:59:55.130126 722 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:55.130481 722 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap complete.
I20240502 01:59:55.130699 722 ts_tablet_manager.cc:1367] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.032s user 0.025s sys 0.002s
I20240502 01:59:55.131196 722 raft_consensus.cc:348] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } }
I20240502 01:59:55.131400 722 raft_consensus.cc:729] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: LEARNER
I20240502 01:59:55.131577 722 consensus_queue.cc:260] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } }
I20240502 01:59:55.132019 722 ts_tablet_manager.cc:1398] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:55.132261 727 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:55.132675 28288 tablet_copy_service.cc:342] P 8ed4b4242123404f86485ec57dc34e88: Request end of tablet copy session 82e8cba6ed104c2c9869ea0365bbe482-25d8fba21674442fbd100478245ff9aa received from {username='slave'} at 127.10.133.196:45853
I20240502 01:59:55.132756 28288 tablet_copy_service.cc:433] P 8ed4b4242123404f86485ec57dc34e88: ending tablet copy session 82e8cba6ed104c2c9869ea0365bbe482-25d8fba21674442fbd100478245ff9aa on tablet 25d8fba21674442fbd100478245ff9aa with peer 82e8cba6ed104c2c9869ea0365bbe482
I20240502 01:59:55.132787 727 tablet_bootstrap.cc:492] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2: Bootstrap complete.
I20240502 01:59:55.132978 727 ts_tablet_manager.cc:1367] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2: Time spent bootstrapping tablet: real 0.029s user 0.026s sys 0.000s
I20240502 01:59:55.133800 727 raft_consensus.cc:348] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } }
I20240502 01:59:55.133971 727 raft_consensus.cc:729] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0003837e2d88424093594ed169d82cd2, State: Initialized, Role: LEARNER
I20240502 01:59:55.134141 727 consensus_queue.cc:260] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } }
I20240502 01:59:55.134552 727 ts_tablet_manager.cc:1398] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:55.135885 28288 tablet_copy_service.cc:342] P 8ed4b4242123404f86485ec57dc34e88: Request end of tablet copy session 0003837e2d88424093594ed169d82cd2-25d8fba21674442fbd100478245ff9aa received from {username='slave'} at 127.10.133.200:53299
I20240502 01:59:55.135977 28288 tablet_copy_service.cc:433] P 8ed4b4242123404f86485ec57dc34e88: ending tablet copy session 0003837e2d88424093594ed169d82cd2-25d8fba21674442fbd100478245ff9aa on tablet 25d8fba21674442fbd100478245ff9aa with peer 0003837e2d88424093594ed169d82cd2
I20240502 01:59:55.208631 771 ts_tablet_manager.cc:902] T 13a5600dc379460b9c433ffdaa0b3d02 P 845294d663994245b540c006dca93b7d: Initiating tablet copy from peer 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:55.209082 771 tablet_copy_client.cc:308] T 13a5600dc379460b9c433ffdaa0b3d02 P 845294d663994245b540c006dca93b7d: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.199:35629
I20240502 01:59:55.209535 28555 tablet_copy_service.cc:140] P 257826b7ad7e4abb8499b6687e8c83eb: Received BeginTabletCopySession request for tablet 13a5600dc379460b9c433ffdaa0b3d02 from peer 845294d663994245b540c006dca93b7d ({username='slave'} at 127.10.133.202:57109)
I20240502 01:59:55.209630 28555 tablet_copy_service.cc:161] P 257826b7ad7e4abb8499b6687e8c83eb: Beginning new tablet copy session on tablet 13a5600dc379460b9c433ffdaa0b3d02 from peer 845294d663994245b540c006dca93b7d at {username='slave'} at 127.10.133.202:57109: session id = 845294d663994245b540c006dca93b7d-13a5600dc379460b9c433ffdaa0b3d02
I20240502 01:59:55.210413 28555 tablet_copy_source_session.cc:205] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:55.211225 771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13a5600dc379460b9c433ffdaa0b3d02. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:55.212955 771 tablet_copy_client.cc:783] T 13a5600dc379460b9c433ffdaa0b3d02 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:55.213091 771 tablet_copy_client.cc:647] T 13a5600dc379460b9c433ffdaa0b3d02 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:55.214149 771 tablet_copy_client.cc:523] T 13a5600dc379460b9c433ffdaa0b3d02 P 845294d663994245b540c006dca93b7d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:55.215279 771 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P 845294d663994245b540c006dca93b7d: Bootstrap starting.
I20240502 01:59:55.227103 722 ts_tablet_manager.cc:902] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: Initiating tablet copy from peer da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835)
I20240502 01:59:55.227583 722 tablet_copy_client.cc:308] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:40835
I20240502 01:59:55.228417 27749 tablet_copy_service.cc:140] P da58b5341d344efd833502f214e69ff1: Received BeginTabletCopySession request for tablet 5c23922560934ef3be8f4659d8727995 from peer 82e8cba6ed104c2c9869ea0365bbe482 ({username='slave'} at 127.10.133.196:56027)
I20240502 01:59:55.228569 781 ts_tablet_manager.cc:902] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: Initiating tablet copy from peer 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197:46567)
I20240502 01:59:55.228667 27749 tablet_copy_service.cc:161] P da58b5341d344efd833502f214e69ff1: Beginning new tablet copy session on tablet 5c23922560934ef3be8f4659d8727995 from peer 82e8cba6ed104c2c9869ea0365bbe482 at {username='slave'} at 127.10.133.196:56027: session id = 82e8cba6ed104c2c9869ea0365bbe482-5c23922560934ef3be8f4659d8727995
I20240502 01:59:55.229460 781 tablet_copy_client.cc:308] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.197:46567
I20240502 01:59:55.229704 27749 tablet_copy_source_session.cc:205] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:55.230357 28288 tablet_copy_service.cc:140] P 8ed4b4242123404f86485ec57dc34e88: Received BeginTabletCopySession request for tablet 9ee07ceb106a46778d215684d8fac8da from peer da58b5341d344efd833502f214e69ff1 ({username='slave'} at 127.10.133.193:50409)
I20240502 01:59:55.230456 28288 tablet_copy_service.cc:161] P 8ed4b4242123404f86485ec57dc34e88: Beginning new tablet copy session on tablet 9ee07ceb106a46778d215684d8fac8da from peer da58b5341d344efd833502f214e69ff1 at {username='slave'} at 127.10.133.193:50409: session id = da58b5341d344efd833502f214e69ff1-9ee07ceb106a46778d215684d8fac8da
I20240502 01:59:55.230499 722 ts_tablet_manager.cc:1875] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 01:59:55.231376 28288 tablet_copy_source_session.cc:205] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:55.232723 722 ts_tablet_manager.cc:1888] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.6
I20240502 01:59:55.232879 722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c23922560934ef3be8f4659d8727995. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:55.233062 781 ts_tablet_manager.cc:1875] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 01:59:55.233492 786 ts_tablet_manager.cc:902] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: Initiating tablet copy from peer 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921)
I20240502 01:59:55.233913 722 tablet_copy_client.cc:783] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:55.234099 722 tablet_copy_client.cc:647] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:55.234740 786 tablet_copy_client.cc:308] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.198:44921
I20240502 01:59:55.235392 781 ts_tablet_manager.cc:1888] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.9
I20240502 01:59:55.235555 781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ee07ceb106a46778d215684d8fac8da. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:55.236460 781 tablet_copy_client.cc:783] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:55.236611 781 tablet_copy_client.cc:647] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:55.237176 28421 tablet_copy_service.cc:140] P 12f527e76eff4669924a898d5029e3d1: Received BeginTabletCopySession request for tablet b247e3ad657f4661ab40ebd1cc8756b8 from peer 82e8cba6ed104c2c9869ea0365bbe482 ({username='slave'} at 127.10.133.196:37623)
I20240502 01:59:55.237282 28421 tablet_copy_service.cc:161] P 12f527e76eff4669924a898d5029e3d1: Beginning new tablet copy session on tablet b247e3ad657f4661ab40ebd1cc8756b8 from peer 82e8cba6ed104c2c9869ea0365bbe482 at {username='slave'} at 127.10.133.196:37623: session id = 82e8cba6ed104c2c9869ea0365bbe482-b247e3ad657f4661ab40ebd1cc8756b8
I20240502 01:59:55.237861 771 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P 845294d663994245b540c006dca93b7d: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:55.238010 781 tablet_copy_client.cc:523] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:55.238142 771 tablet_bootstrap.cc:492] T 13a5600dc379460b9c433ffdaa0b3d02 P 845294d663994245b540c006dca93b7d: Bootstrap complete.
I20240502 01:59:55.238230 28421 tablet_copy_source_session.cc:205] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:55.238292 771 ts_tablet_manager.cc:1367] T 13a5600dc379460b9c433ffdaa0b3d02 P 845294d663994245b540c006dca93b7d: Time spent bootstrapping tablet: real 0.023s user 0.021s sys 0.003s
I20240502 01:59:55.238679 771 raft_consensus.cc:348] T 13a5600dc379460b9c433ffdaa0b3d02 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:55.238822 771 raft_consensus.cc:729] T 13a5600dc379460b9c433ffdaa0b3d02 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 845294d663994245b540c006dca93b7d, State: Initialized, Role: LEARNER
I20240502 01:59:55.238909 786 ts_tablet_manager.cc:1875] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 01:59:55.238929 771 consensus_queue.cc:260] T 13a5600dc379460b9c433ffdaa0b3d02 P 845294d663994245b540c006dca93b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:55.239230 771 ts_tablet_manager.cc:1398] T 13a5600dc379460b9c433ffdaa0b3d02 P 845294d663994245b540c006dca93b7d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:55.239516 781 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: Bootstrap starting.
I20240502 01:59:55.239744 28555 tablet_copy_service.cc:342] P 257826b7ad7e4abb8499b6687e8c83eb: Request end of tablet copy session 845294d663994245b540c006dca93b7d-13a5600dc379460b9c433ffdaa0b3d02 received from {username='slave'} at 127.10.133.202:57109
I20240502 01:59:55.239809 28555 tablet_copy_service.cc:433] P 257826b7ad7e4abb8499b6687e8c83eb: ending tablet copy session 845294d663994245b540c006dca93b7d-13a5600dc379460b9c433ffdaa0b3d02 on tablet 13a5600dc379460b9c433ffdaa0b3d02 with peer 845294d663994245b540c006dca93b7d
I20240502 01:59:55.242600 786 ts_tablet_manager.cc:1888] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.6
I20240502 01:59:55.242836 786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b247e3ad657f4661ab40ebd1cc8756b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:55.243254 722 tablet_copy_client.cc:523] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:55.244381 786 tablet_copy_client.cc:783] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:55.244553 786 tablet_copy_client.cc:647] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:55.245020 722 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:55.246320 786 tablet_copy_client.cc:523] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:55.247473 786 tablet_bootstrap.cc:492] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:55.261123 794 ts_tablet_manager.cc:902] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: Initiating tablet copy from peer a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731)
I20240502 01:59:55.261938 794 tablet_copy_client.cc:308] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.194:37731
I20240502 01:59:55.273888 786 tablet_bootstrap.cc:492] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:55.274209 786 tablet_bootstrap.cc:492] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap complete.
I20240502 01:59:55.274379 786 ts_tablet_manager.cc:1367] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.027s user 0.014s sys 0.010s
I20240502 01:59:55.274780 786 raft_consensus.cc:348] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } }
I20240502 01:59:55.274928 786 raft_consensus.cc:729] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: LEARNER
I20240502 01:59:55.275039 786 consensus_queue.cc:260] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } }
I20240502 01:59:55.275772 722 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:55.276176 722 tablet_bootstrap.cc:492] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap complete.
I20240502 01:59:55.276397 722 ts_tablet_manager.cc:1367] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.031s user 0.031s sys 0.000s
I20240502 01:59:55.276578 27885 tablet_copy_service.cc:140] P a8c1908b1c554e7cbbb9bf9751b8ee98: Received BeginTabletCopySession request for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 from peer 8ed4b4242123404f86485ec57dc34e88 ({username='slave'} at 127.10.133.197:58091)
I20240502 01:59:55.276705 27885 tablet_copy_service.cc:161] P a8c1908b1c554e7cbbb9bf9751b8ee98: Beginning new tablet copy session on tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 from peer 8ed4b4242123404f86485ec57dc34e88 at {username='slave'} at 127.10.133.197:58091: session id = 8ed4b4242123404f86485ec57dc34e88-dc0c5e7b20cd4fb8ac78ae2bff4f8187
I20240502 01:59:55.276863 722 raft_consensus.cc:348] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } }
I20240502 01:59:55.276999 722 raft_consensus.cc:729] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: LEARNER
I20240502 01:59:55.277102 722 consensus_queue.cc:260] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } }
I20240502 01:59:55.277354 722 ts_tablet_manager.cc:1398] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:55.277616 781 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:55.277683 27885 tablet_copy_source_session.cc:205] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:55.277884 781 tablet_bootstrap.cc:492] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: Bootstrap complete.
I20240502 01:59:55.278065 781 ts_tablet_manager.cc:1367] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: Time spent bootstrapping tablet: real 0.039s user 0.029s sys 0.002s
I20240502 01:59:55.278394 27749 tablet_copy_service.cc:342] P da58b5341d344efd833502f214e69ff1: Request end of tablet copy session 82e8cba6ed104c2c9869ea0365bbe482-5c23922560934ef3be8f4659d8727995 received from {username='slave'} at 127.10.133.196:56027
I20240502 01:59:55.278465 27749 tablet_copy_service.cc:433] P da58b5341d344efd833502f214e69ff1: ending tablet copy session 82e8cba6ed104c2c9869ea0365bbe482-5c23922560934ef3be8f4659d8727995 on tablet 5c23922560934ef3be8f4659d8727995 with peer 82e8cba6ed104c2c9869ea0365bbe482
I20240502 01:59:55.278450 781 raft_consensus.cc:348] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: NON_VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: true } }
I20240502 01:59:55.278577 781 raft_consensus.cc:729] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: da58b5341d344efd833502f214e69ff1, State: Initialized, Role: LEARNER
I20240502 01:59:55.278671 781 consensus_queue.cc:260] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: NON_VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: true } }
I20240502 01:59:55.278995 781 ts_tablet_manager.cc:1398] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:55.279368 794 ts_tablet_manager.cc:1875] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 01:59:55.279493 28288 tablet_copy_service.cc:342] P 8ed4b4242123404f86485ec57dc34e88: Request end of tablet copy session da58b5341d344efd833502f214e69ff1-9ee07ceb106a46778d215684d8fac8da received from {username='slave'} at 127.10.133.193:50409
I20240502 01:59:55.279562 28288 tablet_copy_service.cc:433] P 8ed4b4242123404f86485ec57dc34e88: ending tablet copy session da58b5341d344efd833502f214e69ff1-9ee07ceb106a46778d215684d8fac8da on tablet 9ee07ceb106a46778d215684d8fac8da with peer da58b5341d344efd833502f214e69ff1
I20240502 01:59:55.279726 786 ts_tablet_manager.cc:1398] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20240502 01:59:55.280279 28421 tablet_copy_service.cc:342] P 12f527e76eff4669924a898d5029e3d1: Request end of tablet copy session 82e8cba6ed104c2c9869ea0365bbe482-b247e3ad657f4661ab40ebd1cc8756b8 received from {username='slave'} at 127.10.133.196:37623
I20240502 01:59:55.280346 28421 tablet_copy_service.cc:433] P 12f527e76eff4669924a898d5029e3d1: ending tablet copy session 82e8cba6ed104c2c9869ea0365bbe482-b247e3ad657f4661ab40ebd1cc8756b8 on tablet b247e3ad657f4661ab40ebd1cc8756b8 with peer 82e8cba6ed104c2c9869ea0365bbe482
I20240502 01:59:55.283095 799 ts_tablet_manager.cc:902] T 0883c95dc88f4fb4a7a715c23fb7f078 P 7332064716f04e84ba81c1f2b70821f9: Initiating tablet copy from peer 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:55.283561 799 tablet_copy_client.cc:308] T 0883c95dc88f4fb4a7a715c23fb7f078 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.199:35629
I20240502 01:59:55.284041 28555 tablet_copy_service.cc:140] P 257826b7ad7e4abb8499b6687e8c83eb: Received BeginTabletCopySession request for tablet 0883c95dc88f4fb4a7a715c23fb7f078 from peer 7332064716f04e84ba81c1f2b70821f9 ({username='slave'} at 127.10.133.201:60003)
I20240502 01:59:55.284135 28555 tablet_copy_service.cc:161] P 257826b7ad7e4abb8499b6687e8c83eb: Beginning new tablet copy session on tablet 0883c95dc88f4fb4a7a715c23fb7f078 from peer 7332064716f04e84ba81c1f2b70821f9 at {username='slave'} at 127.10.133.201:60003: session id = 7332064716f04e84ba81c1f2b70821f9-0883c95dc88f4fb4a7a715c23fb7f078
I20240502 01:59:55.284787 28555 tablet_copy_source_session.cc:205] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:55.285634 799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0883c95dc88f4fb4a7a715c23fb7f078. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:55.286566 794 ts_tablet_manager.cc:1888] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.6
I20240502 01:59:55.286782 794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:55.288208 794 tablet_copy_client.cc:783] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:55.288445 799 tablet_copy_client.cc:783] T 0883c95dc88f4fb4a7a715c23fb7f078 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:55.288632 799 tablet_copy_client.cc:647] T 0883c95dc88f4fb4a7a715c23fb7f078 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:55.288724 794 tablet_copy_client.cc:647] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:55.289930 799 tablet_copy_client.cc:523] T 0883c95dc88f4fb4a7a715c23fb7f078 P 7332064716f04e84ba81c1f2b70821f9: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:55.290318 794 tablet_copy_client.cc:523] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:55.291412 799 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap starting.
I20240502 01:59:55.291882 794 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap starting.
I20240502 01:59:55.295033 727 ts_tablet_manager.cc:902] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2: Initiating tablet copy from peer da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835)
I20240502 01:59:55.295423 727 tablet_copy_client.cc:308] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:40835
I20240502 01:59:55.296291 27749 tablet_copy_service.cc:140] P da58b5341d344efd833502f214e69ff1: Received BeginTabletCopySession request for tablet 110a6faea0904da9970934cb2aba94c6 from peer 0003837e2d88424093594ed169d82cd2 ({username='slave'} at 127.10.133.200:44783)
I20240502 01:59:55.296394 27749 tablet_copy_service.cc:161] P da58b5341d344efd833502f214e69ff1: Beginning new tablet copy session on tablet 110a6faea0904da9970934cb2aba94c6 from peer 0003837e2d88424093594ed169d82cd2 at {username='slave'} at 127.10.133.200:44783: session id = 0003837e2d88424093594ed169d82cd2-110a6faea0904da9970934cb2aba94c6
I20240502 01:59:55.297276 27749 tablet_copy_source_session.cc:205] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:55.298292 727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 110a6faea0904da9970934cb2aba94c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:55.300320 727 tablet_copy_client.cc:783] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:55.300455 727 tablet_copy_client.cc:647] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:55.302426 727 tablet_copy_client.cc:523] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:55.303601 727 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2: Bootstrap starting.
I20240502 01:59:55.317072 786 ts_tablet_manager.cc:902] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: Initiating tablet copy from peer 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921)
I20240502 01:59:55.317600 786 tablet_copy_client.cc:308] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.198:44921
I20240502 01:59:55.318053 28421 tablet_copy_service.cc:140] P 12f527e76eff4669924a898d5029e3d1: Received BeginTabletCopySession request for tablet 3b56295cbe014d6894812ee0a64bc513 from peer 82e8cba6ed104c2c9869ea0365bbe482 ({username='slave'} at 127.10.133.196:37623)
I20240502 01:59:55.318171 28421 tablet_copy_service.cc:161] P 12f527e76eff4669924a898d5029e3d1: Beginning new tablet copy session on tablet 3b56295cbe014d6894812ee0a64bc513 from peer 82e8cba6ed104c2c9869ea0365bbe482 at {username='slave'} at 127.10.133.196:37623: session id = 82e8cba6ed104c2c9869ea0365bbe482-3b56295cbe014d6894812ee0a64bc513
I20240502 01:59:55.319167 28421 tablet_copy_source_session.cc:205] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:55.322455 786 ts_tablet_manager.cc:1875] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 01:59:55.324450 794 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:55.324818 786 ts_tablet_manager.cc:1888] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.6
I20240502 01:59:55.324920 794 tablet_bootstrap.cc:492] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: Bootstrap complete.
I20240502 01:59:55.324999 786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b56295cbe014d6894812ee0a64bc513. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:55.325110 794 ts_tablet_manager.cc:1367] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: Time spent bootstrapping tablet: real 0.033s user 0.027s sys 0.002s
I20240502 01:59:55.325559 794 raft_consensus.cc:348] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: true } }
I20240502 01:59:55.325721 794 raft_consensus.cc:729] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8ed4b4242123404f86485ec57dc34e88, State: Initialized, Role: LEARNER
I20240502 01:59:55.325974 794 consensus_queue.cc:260] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: NON_VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: true } }
I20240502 01:59:55.326339 794 ts_tablet_manager.cc:1398] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20240502 01:59:55.326205 786 tablet_copy_client.cc:783] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:55.326856 27885 tablet_copy_service.cc:342] P a8c1908b1c554e7cbbb9bf9751b8ee98: Request end of tablet copy session 8ed4b4242123404f86485ec57dc34e88-dc0c5e7b20cd4fb8ac78ae2bff4f8187 received from {username='slave'} at 127.10.133.197:58091
I20240502 01:59:55.326916 786 tablet_copy_client.cc:647] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:55.326936 27885 tablet_copy_service.cc:433] P a8c1908b1c554e7cbbb9bf9751b8ee98: ending tablet copy session 8ed4b4242123404f86485ec57dc34e88-dc0c5e7b20cd4fb8ac78ae2bff4f8187 on tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 with peer 8ed4b4242123404f86485ec57dc34e88
I20240502 01:59:55.329756 786 tablet_copy_client.cc:523] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:55.330986 786 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:55.335989 799 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=676 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:55.336277 799 tablet_bootstrap.cc:492] T 0883c95dc88f4fb4a7a715c23fb7f078 P 7332064716f04e84ba81c1f2b70821f9: Bootstrap complete.
I20240502 01:59:55.336467 799 ts_tablet_manager.cc:1367] T 0883c95dc88f4fb4a7a715c23fb7f078 P 7332064716f04e84ba81c1f2b70821f9: Time spent bootstrapping tablet: real 0.045s user 0.029s sys 0.001s
I20240502 01:59:55.336885 799 raft_consensus.cc:348] T 0883c95dc88f4fb4a7a715c23fb7f078 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:55.337038 799 raft_consensus.cc:729] T 0883c95dc88f4fb4a7a715c23fb7f078 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7332064716f04e84ba81c1f2b70821f9, State: Initialized, Role: LEARNER
I20240502 01:59:55.337142 799 consensus_queue.cc:260] T 0883c95dc88f4fb4a7a715c23fb7f078 P 7332064716f04e84ba81c1f2b70821f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: NON_VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: true } }
I20240502 01:59:55.337448 799 ts_tablet_manager.cc:1398] T 0883c95dc88f4fb4a7a715c23fb7f078 P 7332064716f04e84ba81c1f2b70821f9: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20240502 01:59:55.338994 28555 tablet_copy_service.cc:342] P 257826b7ad7e4abb8499b6687e8c83eb: Request end of tablet copy session 7332064716f04e84ba81c1f2b70821f9-0883c95dc88f4fb4a7a715c23fb7f078 received from {username='slave'} at 127.10.133.201:60003
I20240502 01:59:55.339075 28555 tablet_copy_service.cc:433] P 257826b7ad7e4abb8499b6687e8c83eb: ending tablet copy session 7332064716f04e84ba81c1f2b70821f9-0883c95dc88f4fb4a7a715c23fb7f078 on tablet 0883c95dc88f4fb4a7a715c23fb7f078 with peer 7332064716f04e84ba81c1f2b70821f9
I20240502 01:59:55.359158 727 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:55.359436 727 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2: Bootstrap complete.
I20240502 01:59:55.359612 727 ts_tablet_manager.cc:1367] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2: Time spent bootstrapping tablet: real 0.056s user 0.027s sys 0.000s
I20240502 01:59:55.360054 727 raft_consensus.cc:348] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:55.360183 727 raft_consensus.cc:729] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0003837e2d88424093594ed169d82cd2, State: Initialized, Role: LEARNER
I20240502 01:59:55.360299 727 consensus_queue.cc:260] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } }
I20240502 01:59:55.361410 727 ts_tablet_manager.cc:1398] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20240502 01:59:55.361871 27749 tablet_copy_service.cc:342] P da58b5341d344efd833502f214e69ff1: Request end of tablet copy session 0003837e2d88424093594ed169d82cd2-110a6faea0904da9970934cb2aba94c6 received from {username='slave'} at 127.10.133.200:44783
I20240502 01:59:55.361959 27749 tablet_copy_service.cc:433] P da58b5341d344efd833502f214e69ff1: ending tablet copy session 0003837e2d88424093594ed169d82cd2-110a6faea0904da9970934cb2aba94c6 on tablet 110a6faea0904da9970934cb2aba94c6 with peer 0003837e2d88424093594ed169d82cd2
I20240502 01:59:55.362578 786 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:55.362846 786 tablet_bootstrap.cc:492] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap complete.
I20240502 01:59:55.363009 786 ts_tablet_manager.cc:1367] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.032s user 0.026s sys 0.002s
I20240502 01:59:55.363371 786 raft_consensus.cc:348] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } }
I20240502 01:59:55.363497 786 raft_consensus.cc:729] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: LEARNER
I20240502 01:59:55.363579 786 consensus_queue.cc:260] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } }
I20240502 01:59:55.364300 786 ts_tablet_manager.cc:1398] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:55.364717 28421 tablet_copy_service.cc:342] P 12f527e76eff4669924a898d5029e3d1: Request end of tablet copy session 82e8cba6ed104c2c9869ea0365bbe482-3b56295cbe014d6894812ee0a64bc513 received from {username='slave'} at 127.10.133.196:37623
I20240502 01:59:55.364799 28421 tablet_copy_service.cc:433] P 12f527e76eff4669924a898d5029e3d1: ending tablet copy session 82e8cba6ed104c2c9869ea0365bbe482-3b56295cbe014d6894812ee0a64bc513 on tablet 3b56295cbe014d6894812ee0a64bc513 with peer 82e8cba6ed104c2c9869ea0365bbe482
I20240502 01:59:55.376633 786 ts_tablet_manager.cc:902] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: Initiating tablet copy from peer da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835)
I20240502 01:59:55.377061 786 tablet_copy_client.cc:308] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:40835
I20240502 01:59:55.377656 27749 tablet_copy_service.cc:140] P da58b5341d344efd833502f214e69ff1: Received BeginTabletCopySession request for tablet f7ccc60565e9447b8ab77927061813e5 from peer 82e8cba6ed104c2c9869ea0365bbe482 ({username='slave'} at 127.10.133.196:56027)
I20240502 01:59:55.377766 27749 tablet_copy_service.cc:161] P da58b5341d344efd833502f214e69ff1: Beginning new tablet copy session on tablet f7ccc60565e9447b8ab77927061813e5 from peer 82e8cba6ed104c2c9869ea0365bbe482 at {username='slave'} at 127.10.133.196:56027: session id = 82e8cba6ed104c2c9869ea0365bbe482-f7ccc60565e9447b8ab77927061813e5
I20240502 01:59:55.378672 27749 tablet_copy_source_session.cc:205] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:55.379400 786 ts_tablet_manager.cc:1875] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 01:59:55.381743 786 ts_tablet_manager.cc:1888] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.6
I20240502 01:59:55.381937 786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ccc60565e9447b8ab77927061813e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:55.383081 786 tablet_copy_client.cc:783] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:55.383206 786 tablet_copy_client.cc:647] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:55.384268 786 tablet_copy_client.cc:523] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:55.385251 786 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap starting.
I20240502 01:59:55.412354 786 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=635 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:55.412681 786 tablet_bootstrap.cc:492] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: Bootstrap complete.
I20240502 01:59:55.412885 786 ts_tablet_manager.cc:1367] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent bootstrapping tablet: real 0.028s user 0.021s sys 0.004s
I20240502 01:59:55.413322 786 raft_consensus.cc:348] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } }
I20240502 01:59:55.413444 786 raft_consensus.cc:729] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 82e8cba6ed104c2c9869ea0365bbe482, State: Initialized, Role: LEARNER
I20240502 01:59:55.413558 786 consensus_queue.cc:260] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } }
I20240502 01:59:55.413877 786 ts_tablet_manager.cc:1398] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:55.414523 27749 tablet_copy_service.cc:342] P da58b5341d344efd833502f214e69ff1: Request end of tablet copy session 82e8cba6ed104c2c9869ea0365bbe482-f7ccc60565e9447b8ab77927061813e5 received from {username='slave'} at 127.10.133.196:56027
I20240502 01:59:55.414613 27749 tablet_copy_service.cc:433] P da58b5341d344efd833502f214e69ff1: ending tablet copy session 82e8cba6ed104c2c9869ea0365bbe482-f7ccc60565e9447b8ab77927061813e5 on tablet f7ccc60565e9447b8ab77927061813e5 with peer 82e8cba6ed104c2c9869ea0365bbe482
I20240502 01:59:55.468623 28130 raft_consensus.cc:1203] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.11->[1.12-1.12] Dedup: 1.12->[]
I20240502 01:59:55.593474 30146 raft_consensus.cc:1203] T 13a5600dc379460b9c433ffdaa0b3d02 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.10->[1.11-1.11] Dedup: 1.11->[]
I20240502 01:59:55.613669 29870 raft_consensus.cc:1203] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.11->[1.12-1.12] Dedup: 1.12->[]
I20240502 01:59:55.728423 27727 raft_consensus.cc:1203] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.10->[1.11-1.11] Dedup: 1.11->[]
I20240502 01:59:55.746842 30008 raft_consensus.cc:1203] T 0883c95dc88f4fb4a7a715c23fb7f078 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.10->[1.11-1.11] Dedup: 1.11->[]
I20240502 01:59:55.753547 28130 raft_consensus.cc:1203] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.10->[1.11-1.11] Dedup: 1.11->[]
I20240502 01:59:55.763238 28130 raft_consensus.cc:1203] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.10->[1.11-1.11] Dedup: 1.11->[]
I20240502 01:59:55.773941 28130 raft_consensus.cc:1203] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 01:59:55.775537 28130 raft_consensus.cc:1203] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.10->[1.11-1.11] Dedup: 1.11->[]
I20240502 01:59:55.814181 28264 raft_consensus.cc:1203] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.10->[1.11-1.11] Dedup: 1.11->[]
I20240502 01:59:55.905225 29870 raft_consensus.cc:1203] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.7->[1.8-1.8] Dedup: 1.8->[]
I20240502 01:59:55.917505 524 raft_consensus.cc:1050] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88: attempting to promote NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 to VOTER
I20240502 01:59:55.918190 524 consensus_queue.cc:237] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } }
I20240502 01:59:55.920150 28130 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEARNER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:55.920357 28534 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:55.920395 30146 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:55.920658 997 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:55.920902 29870 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:55.921131 877 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:55.922063 878 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:55.922240 997 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:55.924583 27727 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:55.924597 28400 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:55.924623 30008 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:55.925009 997 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:55.925262 877 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:55.925493 27997 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:55.925880 997 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:55.927969 997 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:55.927978 524 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.928970 28130 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.930371 524 raft_consensus.cc:1050] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88: attempting to promote NON_VOTER 0003837e2d88424093594ed169d82cd2 to VOTER
I20240502 01:59:55.930752 524 consensus_queue.cc:237] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 1.13, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } }
I20240502 01:59:55.931164 28534 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.931558 30008 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.931578 27578 catalog_manager.cc:5484] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 12 to 13, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:55.932891 29869 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20240502 01:59:55.933235 878 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:55.933317 30146 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.933611 29870 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.935217 27996 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20240502 01:59:55.935580 28399 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20240502 01:59:55.936391 997 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:55.936883 27727 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20240502 01:59:55.937631 997 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:55.937692 28534 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20240502 01:59:55.937784 28399 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.938300 997 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20240502 01:59:55.938310 27997 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.939872 27727 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: NON_VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: true } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.940330 997 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:55.940691 30146 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20240502 01:59:55.941084 998 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20240502 01:59:55.941185 28130 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20240502 01:59:55.941807 30008 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20240502 01:59:55.942215 998 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20240502 01:59:55.942957 27997 raft_consensus.cc:1203] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.12->[1.13-1.14] Dedup: 1.13->[1.14-1.14]
I20240502 01:59:55.943225 998 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20240502 01:59:55.946058 878 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.14: config changed from index 13 to 14, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.946470 27727 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.947017 27997 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.947300 30008 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.948423 28534 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.949791 28400 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.951658 29869 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.952701 30146 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.953730 28130 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.962308 27570 catalog_manager.cc:5484] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index 13 to 14, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } attrs { replace: true } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.966670 28264 consensus_queue.cc:237] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 1.14, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } }
I20240502 01:59:55.968448 28130 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 14. Preceding OpId from leader: term: 1 index: 15. (index mismatch)
I20240502 01:59:55.968930 29869 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 14. Preceding OpId from leader: term: 1 index: 15. (index mismatch)
I20240502 01:59:55.968935 28534 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 14. Preceding OpId from leader: term: 1 index: 15. (index mismatch)
I20240502 01:59:55.969154 30008 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 14. Preceding OpId from leader: term: 1 index: 15. (index mismatch)
I20240502 01:59:55.969276 30146 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 14. Preceding OpId from leader: term: 1 index: 15. (index mismatch)
I20240502 01:59:55.969354 998 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20240502 01:59:55.969767 998 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20240502 01:59:55.969904 27997 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 14. Preceding OpId from leader: term: 1 index: 15. (index mismatch)
I20240502 01:59:55.970074 27727 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 14. Preceding OpId from leader: term: 1 index: 15. (index mismatch)
I20240502 01:59:55.970371 878 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20240502 01:59:55.970520 524 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20240502 01:59:55.970889 524 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20240502 01:59:55.971490 524 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20240502 01:59:55.971812 878 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20240502 01:59:55.974022 998 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.974555 30146 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.975095 30008 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.975438 27727 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.976691 29869 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.977322 28130 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.978077 27997 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.978607 27563 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 25d8fba21674442fbd100478245ff9aa with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:55.979213 27576 catalog_manager.cc:5484] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index 14 to 15, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.980268 28534 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER 12f527e76eff4669924a898d5029e3d1 (127.10.133.198) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.984081 28380 tablet_service.cc:1514] Processing DeleteTablet for tablet 25d8fba21674442fbd100478245ff9aa with delete_type TABLET_DATA_TOMBSTONED (TS 12f527e76eff4669924a898d5029e3d1 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:33400
I20240502 01:59:55.984445 1018 tablet_replica.cc:330] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1: stopping tablet replica
I20240502 01:59:55.984652 1018 raft_consensus.cc:2229] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:55.985154 1018 raft_consensus.cc:2258] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:55.986213 1018 ts_tablet_manager.cc:1875] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:55.987046 28264 consensus_queue.cc:237] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 1.15, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } }
I20240502 01:59:55.988448 29869 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 1 index: 16. (index mismatch)
I20240502 01:59:55.988636 28130 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 1 index: 16. (index mismatch)
I20240502 01:59:55.988802 1018 ts_tablet_manager.cc:1888] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.14
I20240502 01:59:55.988874 1018 log.cc:1196] T 25d8fba21674442fbd100478245ff9aa P 12f527e76eff4669924a898d5029e3d1: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-5/wal/wals/25d8fba21674442fbd100478245ff9aa
I20240502 01:59:55.989077 878 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20240502 01:59:55.989243 30146 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 1 index: 16. (index mismatch)
I20240502 01:59:55.989269 28534 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 1 index: 16. (index mismatch)
I20240502 01:59:55.989714 27566 catalog_manager.cc:4830] TS 12f527e76eff4669924a898d5029e3d1 (127.10.133.198:44921): tablet 25d8fba21674442fbd100478245ff9aa (table rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]) successfully deleted
I20240502 01:59:55.989796 998 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20240502 01:59:55.989822 27727 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 1 index: 16. (index mismatch)
I20240502 01:59:55.990315 997 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20240502 01:59:55.990664 997 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20240502 01:59:55.990978 997 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20240502 01:59:55.992568 997 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.16: config changed from index 15 to 16, VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.993031 27727 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.16: config changed from index 15 to 16, VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.993468 27997 raft_consensus.cc:1261] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 1 index: 16. (index mismatch)
I20240502 01:59:55.993674 29869 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.16: config changed from index 15 to 16, VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.993885 998 consensus_queue.cc:1035] T 25d8fba21674442fbd100478245ff9aa P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20240502 01:59:55.995002 27563 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 25d8fba21674442fbd100478245ff9aa with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:55.994895 28534 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.16: config changed from index 15 to 16, VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.995800 30146 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.16: config changed from index 15 to 16, VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.996100 28130 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.16: config changed from index 15 to 16, VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:55.996877 27571 catalog_manager.cc:5484] T 25d8fba21674442fbd100478245ff9aa P 0003837e2d88424093594ed169d82cd2 reported cstate change: config changed from index 15 to 16, VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) evicted. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.000154 27997 raft_consensus.cc:2932] T 25d8fba21674442fbd100478245ff9aa P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.16: config changed from index 15 to 16, VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.006724 29987 tablet_service.cc:1514] Processing DeleteTablet for tablet 25d8fba21674442fbd100478245ff9aa with delete_type TABLET_DATA_TOMBSTONED (TS 7332064716f04e84ba81c1f2b70821f9 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:51776
I20240502 01:59:56.007197 1021 tablet_replica.cc:330] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9: stopping tablet replica
I20240502 01:59:56.007534 1021 raft_consensus.cc:2229] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:56.007911 1021 raft_consensus.cc:2258] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:56.008846 1021 ts_tablet_manager.cc:1875] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:56.010644 1021 ts_tablet_manager.cc:1888] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.15
I20240502 01:59:56.010736 1021 log.cc:1196] T 25d8fba21674442fbd100478245ff9aa P 7332064716f04e84ba81c1f2b70821f9: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal/wals/25d8fba21674442fbd100478245ff9aa
I20240502 01:59:56.011233 27563 catalog_manager.cc:4830] TS 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201:40597): tablet 25d8fba21674442fbd100478245ff9aa (table rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]) successfully deleted
I20240502 01:59:56.138674 905 raft_consensus.cc:1050] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb: attempting to promote NON_VOTER 845294d663994245b540c006dca93b7d to VOTER
I20240502 01:59:56.139209 905 consensus_queue.cc:237] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:56.142037 30008 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.142089 28130 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.142906 1094 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.143417 1094 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.150458 30146 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.150458 29869 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.150974 27862 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.151017 28264 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.151284 1094 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.151481 1095 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.151692 27997 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.151794 905 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.152611 1094 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.152976 905 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.156096 1094 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:56.156663 27997 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:56.159049 28130 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:56.159109 30008 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:56.159358 27578 catalog_manager.cc:5484] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f reported cstate change: config changed from index 11 to 12, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:56.161098 30146 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:56.162585 29869 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:56.162789 27862 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:56.172623 28264 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:56.174582 28534 consensus_queue.cc:237] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:56.176441 30146 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.176741 29869 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.176757 27862 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.176847 905 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.177129 906 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.177295 905 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.177379 27997 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.177853 906 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.178548 28264 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.178908 906 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.179170 28130 raft_consensus.cc:1261] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.179617 1094 consensus_queue.cc:1035] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.180666 1094 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:56.181090 28263 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:56.181439 575 raft_consensus.cc:1050] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1: attempting to promote NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 to VOTER
I20240502 01:59:56.182199 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 13a5600dc379460b9c433ffdaa0b3d02 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:56.182240 575 consensus_queue.cc:237] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } }
I20240502 01:59:56.183125 29869 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:56.183233 27997 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:56.184517 28399 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.184978 577 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.185322 28534 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.186188 27575 catalog_manager.cc:5484] T 13a5600dc379460b9c433ffdaa0b3d02 P 0003837e2d88424093594ed169d82cd2 reported cstate change: config changed from index 12 to 13, VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) evicted. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:56.186705 30008 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.187083 27997 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.187140 937 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.187480 937 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.187779 30145 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.188206 575 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.189100 29987 tablet_service.cc:1514] Processing DeleteTablet for tablet 13a5600dc379460b9c433ffdaa0b3d02 with delete_type TABLET_DATA_TOMBSTONED (TS 7332064716f04e84ba81c1f2b70821f9 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:51776
I20240502 01:59:56.189299 1120 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.189361 28263 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.189791 1021 tablet_replica.cc:330] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9: stopping tablet replica
I20240502 01:59:56.189934 1021 raft_consensus.cc:2229] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:56.190026 1120 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.190147 1021 raft_consensus.cc:2258] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:56.191723 1021 ts_tablet_manager.cc:1875] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:56.195554 1120 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.196115 28132 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEARNER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.196050 28263 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.196713 577 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.198273 28132 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.199211 30145 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.199934 28534 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.201133 27579 catalog_manager.cc:5484] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 reported cstate change: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.201112 27997 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.203136 1021 ts_tablet_manager.cc:1888] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.12
I20240502 01:59:56.203227 1021 log.cc:1196] T 13a5600dc379460b9c433ffdaa0b3d02 P 7332064716f04e84ba81c1f2b70821f9: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-8/wal/wals/13a5600dc379460b9c433ffdaa0b3d02
I20240502 01:59:56.204663 28399 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.205384 28130 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:56.207235 27563 catalog_manager.cc:4830] TS 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201:40597): tablet 13a5600dc379460b9c433ffdaa0b3d02 (table rebalance_test_table_0 [id=b4f89fda5e5c4d469600eebaa7611170]) successfully deleted
I20240502 01:59:56.212263 30146 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:56.212566 27862 raft_consensus.cc:2932] T 13a5600dc379460b9c433ffdaa0b3d02 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:56.213431 30008 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.216634 1094 raft_consensus.cc:1050] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb: attempting to promote NON_VOTER 7332064716f04e84ba81c1f2b70821f9 to VOTER
I20240502 01:59:56.217213 1094 consensus_queue.cc:237] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:56.217339 1120 raft_consensus.cc:1050] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1: attempting to promote NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 to VOTER
I20240502 01:59:56.217830 1120 consensus_queue.cc:237] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } }
I20240502 01:59:56.219470 28399 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.219702 28263 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.220261 30146 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.220373 27997 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.220523 548 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.220854 29869 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.221035 28534 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.221714 937 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.222106 937 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.222254 1118 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.222370 577 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.223055 28263 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.223711 28399 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.224084 575 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.224372 577 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.224675 548 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.226091 30009 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 7332064716f04e84ba81c1f2b70821f9 [term 1 LEARNER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.226087 28132 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEARNER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.227396 905 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.226904 1148 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.228982 29870 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.229257 27862 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.229606 27996 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.229699 548 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.229974 30145 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.230324 548 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.230669 548 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.231137 937 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.232630 905 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.233355 28263 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.233355 29870 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.233678 28399 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.235803 27579 catalog_manager.cc:5484] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:56.237340 30145 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.238799 28132 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.240006 548 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:56.240494 28400 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:56.244088 27997 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:56.244088 27996 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.245049 27862 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:56.245967 27571 catalog_manager.cc:5484] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 11 to 12, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:56.247280 30145 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:56.248117 28263 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:56.250272 27727 consensus_queue.cc:237] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } }
I20240502 01:59:56.251133 29869 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:56.252445 28264 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.252841 939 raft_consensus.cc:1050] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1: attempting to promote NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 to VOTER
I20240502 01:59:56.253227 27996 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.253440 939 consensus_queue.cc:237] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } }
I20240502 01:59:56.253530 30145 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.254074 28400 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.254019 30009 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 7332064716f04e84ba81c1f2b70821f9 (127.10.133.201) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:56.254356 29869 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.254537 28132 raft_consensus.cc:1261] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.254863 1148 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.254987 575 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.255107 1117 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.255793 1116 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.255894 1148 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.256489 29869 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:56.256583 27996 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:56.256605 27862 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:56.257546 28265 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:56.258179 28534 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:56.258479 28130 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEARNER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:56.258606 27727 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:56.259224 1116 consensus_queue.cc:1035] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.260017 938 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:56.260406 938 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:56.260733 938 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:56.261282 605 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:56.261309 1147 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.261637 605 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:56.261615 28264 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.262127 30145 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.262550 28130 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.264259 28534 consensus_queue.cc:237] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:56.266101 27863 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.266103 605 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:56.266281 30009 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.266445 605 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:56.267307 906 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.267836 27997 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.268302 1145 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.268824 30145 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.268801 905 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.269193 548 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.268978 27575 catalog_manager.cc:5484] T f7ccc60565e9447b8ab77927061813e5 P 845294d663994245b540c006dca93b7d reported cstate change: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.273269 28513 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ccc60565e9447b8ab77927061813e5 with delete_type TABLET_DATA_TOMBSTONED (TS 257826b7ad7e4abb8499b6687e8c83eb not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:35224
I20240502 01:59:56.277096 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet f7ccc60565e9447b8ab77927061813e5 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:56.276786 905 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:56.278731 27863 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:56.279573 28399 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.279925 548 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.280982 28401 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:56.280766 27997 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:56.282142 27998 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.284446 28265 raft_consensus.cc:1261] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.285027 1176 tablet_replica.cc:330] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb: stopping tablet replica
I20240502 01:59:56.285359 1176 raft_consensus.cc:2229] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:56.285890 29870 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.286221 27574 catalog_manager.cc:5484] T 0883c95dc88f4fb4a7a715c23fb7f078 P 86e11777d9d744d0a5a8139c99e89f4f reported cstate change: config changed from index 12 to 13, VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) evicted. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:56.286265 28400 raft_consensus.cc:2932] T f7ccc60565e9447b8ab77927061813e5 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.287031 548 consensus_queue.cc:1035] T 0883c95dc88f4fb4a7a715c23fb7f078 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.288432 28265 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:56.291661 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 0883c95dc88f4fb4a7a715c23fb7f078 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:56.293265 30009 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:56.294809 1176 pending_rounds.cc:62] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb: Trying to abort 1 pending ops.
I20240502 01:59:56.294886 1176 pending_rounds.cc:68] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb: Aborting op as it isn't in flight: id { term: 1 index: 12 } timestamp: 7023063843706761216 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "f7ccc60565e9447b8ab77927061813e5" old_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: NON_VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: true } } } new_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } } }
I20240502 01:59:56.295559 1176 raft_consensus.cc:2894] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Aborting config change with OpId 1.12: Aborted: Op aborted
I20240502 01:59:56.296285 30145 raft_consensus.cc:2932] T 0883c95dc88f4fb4a7a715c23fb7f078 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 0003837e2d88424093594ed169d82cd2 (127.10.133.200) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:56.296831 1176 raft_consensus.cc:2866] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20240502 01:59:56.296679 28132 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.297008 1176 raft_consensus.cc:2258] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:56.298583 938 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.299134 27996 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.300204 1176 ts_tablet_manager.cc:1875] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:56.301398 27728 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.302085 27863 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.302953 1176 ts_tablet_manager.cc:1888] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.12
I20240502 01:59:56.303035 1176 log.cc:1196] T f7ccc60565e9447b8ab77927061813e5 P 257826b7ad7e4abb8499b6687e8c83eb: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal/wals/f7ccc60565e9447b8ab77927061813e5
I20240502 01:59:56.303153 28534 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.303799 27565 catalog_manager.cc:4830] TS 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629): tablet f7ccc60565e9447b8ab77927061813e5 (table rebalance_test_table_6 [id=492b6c600fbb4723b4c3734cb5c293b8]) successfully deleted
I20240502 01:59:56.304780 27575 catalog_manager.cc:5484] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 8 to 9, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:56.308367 29869 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.310133 28266 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.312719 29852 tablet_service.cc:1514] Processing DeleteTablet for tablet 0883c95dc88f4fb4a7a715c23fb7f078 with delete_type TABLET_DATA_TOMBSTONED (TS 0003837e2d88424093594ed169d82cd2 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:58458
I20240502 01:59:56.315527 28400 consensus_queue.cc:237] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } }
I20240502 01:59:56.317102 28266 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:56.317467 29869 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:56.317445 939 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:56.317726 27996 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:56.318246 27863 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:56.318233 939 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:56.318457 28132 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:56.318549 939 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:56.318868 939 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:56.319139 27728 raft_consensus.cc:1261] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:56.319372 1168 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:56.319573 1169 consensus_queue.cc:1035] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:56.321736 1170 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.322095 27728 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.322346 27863 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.323346 27566 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet b247e3ad657f4661ab40ebd1cc8756b8 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:56.323669 27998 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.324921 27574 catalog_manager.cc:5484] T b247e3ad657f4661ab40ebd1cc8756b8 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 9 to 10, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:56.326117 28132 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.326351 29869 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.326732 28266 raft_consensus.cc:2932] T b247e3ad657f4661ab40ebd1cc8756b8 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.327852 28513 tablet_service.cc:1514] Processing DeleteTablet for tablet b247e3ad657f4661ab40ebd1cc8756b8 with delete_type TABLET_DATA_TOMBSTONED (TS 257826b7ad7e4abb8499b6687e8c83eb not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:35224
I20240502 01:59:56.330343 1185 tablet_replica.cc:330] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2: stopping tablet replica
I20240502 01:59:56.330575 1176 tablet_replica.cc:330] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb: stopping tablet replica
I20240502 01:59:56.330657 1185 raft_consensus.cc:2229] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:56.330698 1176 raft_consensus.cc:2229] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:56.330915 1176 raft_consensus.cc:2258] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:56.331892 1176 ts_tablet_manager.cc:1875] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:56.333822 1176 ts_tablet_manager.cc:1888] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 01:59:56.333930 1176 log.cc:1196] T b247e3ad657f4661ab40ebd1cc8756b8 P 257826b7ad7e4abb8499b6687e8c83eb: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal/wals/b247e3ad657f4661ab40ebd1cc8756b8
I20240502 01:59:56.334441 27565 catalog_manager.cc:4830] TS 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629): tablet b247e3ad657f4661ab40ebd1cc8756b8 (table rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]) successfully deleted
I20240502 01:59:56.334523 1185 raft_consensus.cc:2258] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:56.334580 1167 raft_consensus.cc:1050] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1: attempting to promote NON_VOTER 82e8cba6ed104c2c9869ea0365bbe482 to VOTER
I20240502 01:59:56.335081 1167 consensus_queue.cc:237] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } }
I20240502 01:59:56.335932 1185 ts_tablet_manager.cc:1875] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:56.336483 997 raft_consensus.cc:1050] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88: attempting to promote NON_VOTER da58b5341d344efd833502f214e69ff1 to VOTER
I20240502 01:59:56.337055 997 consensus_queue.cc:237] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false } }
I20240502 01:59:56.337466 27728 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.338025 28534 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.338435 1169 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.338480 1185 ts_tablet_manager.cc:1888] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.12
I20240502 01:59:56.338615 1185 log.cc:1196] T 0883c95dc88f4fb4a7a715c23fb7f078 P 0003837e2d88424093594ed169d82cd2: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-7/wal/wals/0883c95dc88f4fb4a7a715c23fb7f078
I20240502 01:59:56.338819 1169 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.339344 27564 catalog_manager.cc:4830] TS 0003837e2d88424093594ed169d82cd2 (127.10.133.200:45585): tablet 0883c95dc88f4fb4a7a715c23fb7f078 (table rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]) successfully deleted
I20240502 01:59:56.339648 28132 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.339664 29869 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.339851 30145 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.340063 1009 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.340212 27998 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.340354 27727 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 LEARNER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.340708 997 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.340972 878 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.341101 524 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.341262 1009 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.343909 28130 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 LEARNER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.344122 28535 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.344147 27863 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.344254 30009 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.344521 1009 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.344602 28266 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.344682 524 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.345813 1167 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.345973 605 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.346288 605 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.347795 30146 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.347848 27996 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.348146 939 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.348294 1170 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.351166 1170 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.352767 28266 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.354085 27996 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.355701 27578 catalog_manager.cc:5484] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.355733 30009 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.358678 27728 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.358983 28535 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.368188 1009 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, da58b5341d344efd833502f214e69ff1 (127.10.133.193) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false } } }
I20240502 01:59:56.369010 30145 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, da58b5341d344efd833502f214e69ff1 (127.10.133.193) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false } } }
I20240502 01:59:56.370700 28132 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, da58b5341d344efd833502f214e69ff1 (127.10.133.193) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false } } }
I20240502 01:59:56.371351 27863 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, da58b5341d344efd833502f214e69ff1 (127.10.133.193) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false } } }
I20240502 01:59:56.371649 29869 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, da58b5341d344efd833502f214e69ff1 (127.10.133.193) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false } } }
I20240502 01:59:56.371907 27571 catalog_manager.cc:5484] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d reported cstate change: config changed from index 11 to 12, da58b5341d344efd833502f214e69ff1 (127.10.133.193) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false } } }
I20240502 01:59:56.372999 27727 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, da58b5341d344efd833502f214e69ff1 (127.10.133.193) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false } } }
I20240502 01:59:56.375355 27998 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, da58b5341d344efd833502f214e69ff1 (127.10.133.193) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false } } }
I20240502 01:59:56.377736 28132 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.380239 30145 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 82e8cba6ed104c2c9869ea0365bbe482 (127.10.133.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.380817 28534 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, da58b5341d344efd833502f214e69ff1 (127.10.133.193) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } attrs { replace: true } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false } } }
I20240502 01:59:56.389384 28400 consensus_queue.cc:237] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } }
I20240502 01:59:56.389573 28266 consensus_queue.cc:237] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false } }
I20240502 01:59:56.391114 28132 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.391610 30145 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.391611 29869 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.391688 938 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.392346 28266 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.392927 27998 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.393123 27727 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.393621 28132 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.393977 878 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.394351 878 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.394477 998 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.394701 877 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.394827 998 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.394954 1166 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.397581 30146 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.397980 1166 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.397897 1009 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false } } }
I20240502 01:59:56.399842 27563 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 9ee07ceb106a46778d215684d8fac8da with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:56.400122 27727 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false } } }
I20240502 01:59:56.402505 29869 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false } } }
I20240502 01:59:56.403298 30009 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.403295 30146 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false } } }
I20240502 01:59:56.403271 27998 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false } } }
I20240502 01:59:56.403815 1166 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.405740 27579 catalog_manager.cc:5484] T 9ee07ceb106a46778d215684d8fac8da P 0003837e2d88424093594ed169d82cd2 reported cstate change: config changed from index 12 to 13, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New cstate: current_term: 1 leader_uuid: "8ed4b4242123404f86485ec57dc34e88" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false } } }
I20240502 01:59:56.408871 1166 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.409154 27998 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.409286 30009 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.409519 938 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.410634 27998 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.412120 27727 raft_consensus.cc:1261] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 12f527e76eff4669924a898d5029e3d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.412034 28132 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.412263 27843 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ee07ceb106a46778d215684d8fac8da with delete_type TABLET_DATA_TOMBSTONED (TS a8c1908b1c554e7cbbb9bf9751b8ee98 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:35346
I20240502 01:59:56.412726 938 consensus_queue.cc:1035] T 3b56295cbe014d6894812ee0a64bc513 P 12f527e76eff4669924a898d5029e3d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.412842 28534 raft_consensus.cc:1261] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 8ed4b4242123404f86485ec57dc34e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.413252 878 consensus_queue.cc:1035] T 9ee07ceb106a46778d215684d8fac8da P 8ed4b4242123404f86485ec57dc34e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.413698 27575 catalog_manager.cc:5484] T 3b56295cbe014d6894812ee0a64bc513 P 7332064716f04e84ba81c1f2b70821f9 reported cstate change: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New cstate: current_term: 1 leader_uuid: "12f527e76eff4669924a898d5029e3d1" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.414438 27566 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 3b56295cbe014d6894812ee0a64bc513 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:56.415092 28265 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.415156 30146 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.416680 28513 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b56295cbe014d6894812ee0a64bc513 with delete_type TABLET_DATA_TOMBSTONED (TS 257826b7ad7e4abb8499b6687e8c83eb not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:35224
I20240502 01:59:56.417093 1176 tablet_replica.cc:330] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb: stopping tablet replica
I20240502 01:59:56.417249 1176 raft_consensus.cc:2229] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:56.417528 1176 raft_consensus.cc:2258] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:56.417759 27727 raft_consensus.cc:2932] T 3b56295cbe014d6894812ee0a64bc513 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.418463 1176 ts_tablet_manager.cc:1875] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:56.418427 28534 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false } } }
I20240502 01:59:56.421082 28132 raft_consensus.cc:2932] T 9ee07ceb106a46778d215684d8fac8da P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } attrs { promote: false } } }
I20240502 01:59:56.421653 1176 ts_tablet_manager.cc:1888] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.12
I20240502 01:59:56.421731 1176 log.cc:1196] T 3b56295cbe014d6894812ee0a64bc513 P 257826b7ad7e4abb8499b6687e8c83eb: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal/wals/3b56295cbe014d6894812ee0a64bc513
I20240502 01:59:56.422925 27565 catalog_manager.cc:4830] TS 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629): tablet 3b56295cbe014d6894812ee0a64bc513 (table rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]) successfully deleted
I20240502 01:59:56.423471 494 raft_consensus.cc:1050] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98: attempting to promote NON_VOTER 8ed4b4242123404f86485ec57dc34e88 to VOTER
I20240502 01:59:56.423980 494 consensus_queue.cc:237] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false } }
I20240502 01:59:56.426252 28534 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.426254 30145 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.426463 28400 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.426626 960 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.426868 1221 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.426973 27998 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.427275 1220 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.428028 960 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.428903 30009 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.429234 28266 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 1 LEARNER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.430166 1221 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.430508 960 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.431207 28132 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:56.431620 1220 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:56.434055 1220 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false } } }
I20240502 01:59:56.434796 30009 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false } } }
I20240502 01:59:56.435142 28132 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false } } }
I20240502 01:59:56.436858 28400 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false } } }
I20240502 01:59:56.436982 30145 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false } } }
I20240502 01:59:56.437044 28534 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false } } }
I20240502 01:59:56.437906 1218 tablet_replica.cc:330] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98: stopping tablet replica
I20240502 01:59:56.438117 1218 raft_consensus.cc:2229] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:56.439405 1218 raft_consensus.cc:2258] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:56.439316 27998 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false } } }
I20240502 01:59:56.440260 1218 ts_tablet_manager.cc:1875] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:56.440527 28266 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false } } }
I20240502 01:59:56.442808 27575 catalog_manager.cc:5484] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 reported cstate change: config changed from index 11 to 12, 8ed4b4242123404f86485ec57dc34e88 (127.10.133.197) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } attrs { replace: true } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false } } }
I20240502 01:59:56.444097 1218 ts_tablet_manager.cc:1888] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.12
I20240502 01:59:56.444229 1218 log.cc:1196] T 9ee07ceb106a46778d215684d8fac8da P a8c1908b1c554e7cbbb9bf9751b8ee98: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-1/wal/wals/9ee07ceb106a46778d215684d8fac8da
I20240502 01:59:56.444851 27564 catalog_manager.cc:4830] TS a8c1908b1c554e7cbbb9bf9751b8ee98 (127.10.133.194:37731): tablet 9ee07ceb106a46778d215684d8fac8da (table rebalance_test_table_1 [id=67e4f58714fd4a32a6eda4c222a1e444]) successfully deleted
I20240502 01:59:56.456571 27863 consensus_queue.cc:237] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false } }
I20240502 01:59:56.458189 30145 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.458737 1220 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.458837 27998 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.459251 28266 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.459442 30009 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.459602 1220 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.460249 1221 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.460552 1221 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.462546 28400 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.462714 28132 raft_consensus.cc:1261] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer a8c1908b1c554e7cbbb9bf9751b8ee98: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.462965 1224 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.463514 960 consensus_queue.cc:1035] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.463421 1222 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false } } }
I20240502 01:59:56.464520 28132 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false } } }
I20240502 01:59:56.465739 27564 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:56.467764 28400 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false } } }
I20240502 01:59:56.470510 27579 catalog_manager.cc:5484] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New cstate: current_term: 1 leader_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false } } }
I20240502 01:59:56.470970 27998 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false } } }
I20240502 01:59:56.471551 30145 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false } } }
I20240502 01:59:56.473776 30009 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false } } }
I20240502 01:59:56.474340 28266 raft_consensus.cc:2932] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } attrs { promote: false } } }
I20240502 01:59:56.475868 28513 tablet_service.cc:1514] Processing DeleteTablet for tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 with delete_type TABLET_DATA_TOMBSTONED (TS 257826b7ad7e4abb8499b6687e8c83eb not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:35224
I20240502 01:59:56.476092 1176 tablet_replica.cc:330] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb: stopping tablet replica
I20240502 01:59:56.476214 1176 raft_consensus.cc:2229] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:56.476482 1176 raft_consensus.cc:2258] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:56.478127 1176 ts_tablet_manager.cc:1875] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:56.480162 1176 ts_tablet_manager.cc:1888] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.12
I20240502 01:59:56.480232 1176 log.cc:1196] T dc0c5e7b20cd4fb8ac78ae2bff4f8187 P 257826b7ad7e4abb8499b6687e8c83eb: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal/wals/dc0c5e7b20cd4fb8ac78ae2bff4f8187
I20240502 01:59:56.480768 27565 catalog_manager.cc:4830] TS 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629): tablet dc0c5e7b20cd4fb8ac78ae2bff4f8187 (table rebalance_test_table_4 [id=d7dc65cd6e4c4c1cb759dc08f52e2061]) successfully deleted
I20240502 01:59:56.483359 1148 raft_consensus.cc:1050] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1: attempting to promote NON_VOTER 0003837e2d88424093594ed169d82cd2 to VOTER
I20240502 01:59:56.484087 1148 consensus_queue.cc:237] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:56.486246 28400 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:56.486689 28534 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:56.487509 28266 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:56.489006 1149 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:56.490360 27998 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:56.491266 1149 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:56.494589 30145 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:56.495270 1149 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:56.495481 1119 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:56.495970 1147 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:56.497198 29870 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2 [term 1 LEARNER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:56.498224 27863 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:56.498209 1149 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:56.499061 1147 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:56.500495 1149 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:56.500921 28400 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:56.502418 27863 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:56.504117 28266 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:56.504705 28534 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:56.504819 27579 catalog_manager.cc:5484] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:56.507572 27998 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:56.508827 30145 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:56.512141 29869 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, 0003837e2d88424093594ed169d82cd2 (127.10.133.200) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false replace: true } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:56.512562 27727 consensus_queue.cc:237] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:56.515089 28266 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:56.515187 28534 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:56.515635 937 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:56.516091 27863 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:56.516651 1119 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:56.516821 937 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:56.517616 27998 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:56.518633 28400 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:56.519042 937 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:56.519237 29869 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:56.519611 1119 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:56.519963 1119 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:56.521131 937 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:56.523043 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 110a6faea0904da9970934cb2aba94c6 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:56.523185 27863 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:56.527853 29869 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:56.527853 28534 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:56.530437 28400 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:56.530525 27998 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:56.530642 27572 catalog_manager.cc:5484] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2 reported cstate change: config changed from index 9 to 10, VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) evicted. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:56.532994 28266 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:56.542904 30124 tablet_service.cc:1514] Processing DeleteTablet for tablet 110a6faea0904da9970934cb2aba94c6 with delete_type TABLET_DATA_TOMBSTONED (TS 845294d663994245b540c006dca93b7d not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:56082
I20240502 01:59:56.543438 1289 tablet_replica.cc:330] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: stopping tablet replica
I20240502 01:59:56.543826 1289 raft_consensus.cc:2229] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:56.544569 1289 raft_consensus.cc:2258] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:56.545653 1289 ts_tablet_manager.cc:1875] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:56.548043 1289 ts_tablet_manager.cc:1888] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.9
I20240502 01:59:56.548130 1289 log.cc:1196] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-9/wal/wals/110a6faea0904da9970934cb2aba94c6
I20240502 01:59:56.548655 27564 catalog_manager.cc:4830] TS 845294d663994245b540c006dca93b7d (127.10.133.202:45645): tablet 110a6faea0904da9970934cb2aba94c6 (table rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]) successfully deleted
I20240502 01:59:56.601512 29852 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:56.601605 28513 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:59:56.606374 28380 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:59:56.614651 30124 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:56.630154 28112 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:56.630920 27727 consensus_queue.cc:237] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } }
I20240502 01:59:56.633180 30145 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.633324 27998 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.633733 29987 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:56.633720 937 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.634557 30008 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.634912 28266 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.635535 1117 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.635934 1117 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.638090 1120 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.638792 28400 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.639134 937 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.639847 28132 raft_consensus.cc:1261] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:56.640455 937 consensus_queue.cc:1035] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:56.640621 1116 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.640820 27998 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.643281 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 5c23922560934ef3be8f4659d8727995 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:56.643980 27578 catalog_manager.cc:5484] T 5c23922560934ef3be8f4659d8727995 P 86e11777d9d744d0a5a8139c99e89f4f reported cstate change: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.644296 28266 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.644361 30145 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.646509 30009 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.650836 28513 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c23922560934ef3be8f4659d8727995 with delete_type TABLET_DATA_TOMBSTONED (TS 257826b7ad7e4abb8499b6687e8c83eb not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:35224
I20240502 01:59:56.651059 1176 tablet_replica.cc:330] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb: stopping tablet replica
I20240502 01:59:56.651183 1176 raft_consensus.cc:2229] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:56.651486 1176 raft_consensus.cc:2258] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:56.652144 1176 ts_tablet_manager.cc:1875] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:56.654415 1176 ts_tablet_manager.cc:1888] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.12
I20240502 01:59:56.654495 1176 log.cc:1196] T 5c23922560934ef3be8f4659d8727995 P 257826b7ad7e4abb8499b6687e8c83eb: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-6/wal/wals/5c23922560934ef3be8f4659d8727995
I20240502 01:59:56.655036 27565 catalog_manager.cc:4830] TS 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629): tablet 5c23922560934ef3be8f4659d8727995 (table rebalance_test_table_3 [id=55144e06a000427c9fb64ad5a218fd2e]) successfully deleted
I20240502 01:59:56.655558 28400 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.662320 28132 raft_consensus.cc:2932] T 5c23922560934ef3be8f4659d8727995 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, VOTER 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } attrs { promote: false } } }
I20240502 01:59:56.677671 27843 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:56.680810 28246 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:59:56.683127 27707 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:56.688681 27978 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:56.827247 28380 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:59:56.827764 29987 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:56.831619 28513 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:59:56.843602 30124 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:56.844756 27978 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:56.845005 28246 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:59:56.845464 28112 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:56.872006 27843 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:56.880653 27707 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:56.884191 29852 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:56.988509 28380 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:59:56.989137 29852 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:56.993718 28513 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:59:57.000449 30124 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:57.001186 27978 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:57.005692 27707 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:57.021457 28246 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:59:57.025171 29987 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:57.025915 28112 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:57.039727 27843 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:57.252177 27576 ts_manager.cc:292] Set tserver state for 86e11777d9d744d0a5a8139c99e89f4f to MAINTENANCE_MODE
I20240502 01:59:57.482133 29852 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:57.484463 28380 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:59:57.486613 28513 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:59:57.494866 27978 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:57.496948 29987 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:57.497280 28246 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:59:57.513855 27707 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:57.521766 30124 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:57.522137 27843 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:57.522446 28112 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:57.654930 28513 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:59:57.655771 28380 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:59:57.662195 28112 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:57.662765 29852 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:57.671298 27978 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:57.677358 29987 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:57.680976 27843 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:57.684715 30124 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:57.685590 28246 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:59:57.719457 27707 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:57.854732 29852 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:57.855041 28513 tablet_service.cc:1429] Tablet server has 4 leaders and 0 scanners
I20240502 01:59:57.863683 27978 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:57.865582 30124 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:57.866674 28380 tablet_service.cc:1429] Tablet server has 3 leaders and 0 scanners
I20240502 01:59:57.875229 28112 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20240502 01:59:57.875682 28246 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
I20240502 01:59:57.893407 29987 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20240502 01:59:57.893429 27843 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:57.903425 27707 tablet_service.cc:1429] Tablet server has 5 leaders and 0 scanners
I20240502 01:59:57.959388 27728 consensus_queue.cc:237] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:57.961334 28534 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:57.961472 28400 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:57.961956 27998 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:57.961979 1558 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:57.962251 27863 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:57.962456 1120 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:57.962625 29869 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:57.963054 1120 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:57.963215 1413 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:57.963634 28265 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:57.964097 1413 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:57.965025 1558 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20240502 01:59:57.966122 1559 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:57.966684 27863 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:57.967094 29869 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:57.967656 28534 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:57.969148 28400 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:57.969568 28265 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:57.970363 27998 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:57.970965 27574 catalog_manager.cc:5484] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index 10 to 11. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:57.976686 27728 consensus_queue.cc:237] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:57.978870 28265 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:57.979406 1559 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:57.979461 28534 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:57.979974 1577 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:57.980260 28400 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:57.980664 1413 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:57.981115 29869 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:57.981480 27863 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:57.981839 27998 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:57.982242 1577 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20240502 01:59:57.982614 27662 consensus_peers.cc:485] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 -> Peer 845294d663994245b540c006dca93b7d (127.10.133.202:45645): Couldn't send request to peer 845294d663994245b540c006dca93b7d. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:57.982868 1559 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:57.982985 1577 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:57.984762 1559 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:57.985932 28400 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:57.987378 27565 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 110a6faea0904da9970934cb2aba94c6 with cas_config_opid_index 11: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:57.987980 28534 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:57.988888 27577 catalog_manager.cc:5484] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 11 to 12, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:57.989602 27998 consensus_queue.cc:237] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:57.990670 28266 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:57.992501 27998 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:57.992945 29869 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:57.994356 27862 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:57.994877 29870 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:57.995432 1585 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:57.995532 28265 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:57.995678 28534 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:57.995913 1164 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:57.996256 1164 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:57.996929 28400 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:57.997506 1585 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:57.998771 30009 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:57.999197 1585 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:58.000069 27862 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:58.000805 1585 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:58.001560 1164 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:58.001955 28265 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:58.004248 28534 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:58.004585 27571 catalog_manager.cc:5484] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 10 to 11. New cstate: current_term: 1 leader_uuid: "86e11777d9d744d0a5a8139c99e89f4f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:58.004638 28400 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:58.006848 29870 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:58.011134 27862 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:58.012900 27998 consensus_queue.cc:237] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:58.012995 30009 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:58.015524 28534 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:58.015904 28265 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:58.016238 1583 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:58.016343 27862 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:58.016717 1583 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:58.017127 28400 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:58.017537 1583 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:58.017675 29870 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:58.018379 1583 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:58.018676 1580 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:58.018951 30009 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20240502 01:59:58.019511 1164 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20240502 01:59:58.021490 1583 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:58.022572 30009 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:58.022560 27862 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:58.024045 28265 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:58.025326 28534 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:58.025833 27564 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet dc925cbedd00454dbaa0e6b5e38b94d7 with cas_config_opid_index 11: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:58.026718 28535 consensus_queue.cc:237] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } }
I20240502 01:59:58.026544 27577 catalog_manager.cc:5484] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f reported cstate change: config changed from index 11 to 12, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New cstate: current_term: 1 leader_uuid: "86e11777d9d744d0a5a8139c99e89f4f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:58.028108 29870 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:58.029202 28265 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:58.029739 29869 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:58.030421 28399 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:58.030460 27998 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:58.030974 1145 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:58.031136 1604 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:58.031435 1604 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:58.031670 27728 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:58.031772 1604 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:58.032243 1604 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20240502 01:59:58.032862 27862 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20240502 01:59:58.033578 1604 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20240502 01:59:58.036543 27931 consensus_peers.cc:485] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f -> Peer 845294d663994245b540c006dca93b7d (127.10.133.202:45645): Couldn't send request to peer 845294d663994245b540c006dca93b7d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dc925cbedd00454dbaa0e6b5e38b94d7. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:58.036803 1145 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:58.037086 29869 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:58.038420 28400 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:58.040217 28265 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:58.040580 27576 catalog_manager.cc:5484] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2 reported cstate change: config changed from index 7 to 8. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:58.042941 28400 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:58.043291 27862 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:58.043529 27728 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:58.045333 27998 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } }
I20240502 01:59:58.049585 28535 consensus_queue.cc:237] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:58.051674 28400 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:58.051754 28265 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:58.051838 29869 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:58.053072 27728 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
W20240502 01:59:58.053272 28468 consensus_peers.cc:485] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb -> Peer 845294d663994245b540c006dca93b7d (127.10.133.202:45645): Couldn't send request to peer 845294d663994245b540c006dca93b7d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fea2267a27de4324948a5549eb399267. This is attempt 1: this message will repeat every 5th retry.
I20240502 01:59:58.053486 1602 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:58.053637 1600 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:58.053800 1603 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:58.054260 1603 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:58.055075 27862 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:58.055658 27998 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20240502 01:59:58.055817 1602 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:58.056144 1603 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20240502 01:59:58.056562 28265 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:58.056630 1602 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 8 to 9, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:58.057570 27727 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:58.058801 27565 catalog_manager.cc:4997] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet fea2267a27de4324948a5549eb399267 with cas_config_opid_index 8: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20240502 01:59:58.059329 27579 catalog_manager.cc:5484] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 8 to 9, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:58.059619 29869 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:58.060026 27862 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:58.061228 27998 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:58.063180 28400 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 8 to 9, NON_VOTER 845294d663994245b540c006dca93b7d (127.10.133.202) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } } }
I20240502 01:59:58.396912 1642 ts_tablet_manager.cc:902] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: Initiating tablet copy from peer da58b5341d344efd833502f214e69ff1 (127.10.133.193:40835)
I20240502 01:59:58.397408 1642 tablet_copy_client.cc:308] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.193:40835
I20240502 01:59:58.397853 27749 tablet_copy_service.cc:140] P da58b5341d344efd833502f214e69ff1: Received BeginTabletCopySession request for tablet 110a6faea0904da9970934cb2aba94c6 from peer 845294d663994245b540c006dca93b7d ({username='slave'} at 127.10.133.202:52171)
I20240502 01:59:58.397962 27749 tablet_copy_service.cc:161] P da58b5341d344efd833502f214e69ff1: Beginning new tablet copy session on tablet 110a6faea0904da9970934cb2aba94c6 from peer 845294d663994245b540c006dca93b7d at {username='slave'} at 127.10.133.202:52171: session id = 845294d663994245b540c006dca93b7d-110a6faea0904da9970934cb2aba94c6
I20240502 01:59:58.398778 27749 tablet_copy_source_session.cc:205] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:58.399516 1642 ts_tablet_manager.cc:1875] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 01:59:58.401690 1642 ts_tablet_manager.cc:1888] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.9
I20240502 01:59:58.401872 1642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 110a6faea0904da9970934cb2aba94c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:58.402952 1642 tablet_copy_client.cc:783] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:58.403106 1642 tablet_copy_client.cc:647] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:58.404249 1642 tablet_copy_client.cc:523] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:58.405272 1642 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: Bootstrap starting.
I20240502 01:59:58.430984 1642 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:58.431239 1642 tablet_bootstrap.cc:492] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: Bootstrap complete.
I20240502 01:59:58.431404 1642 ts_tablet_manager.cc:1367] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: Time spent bootstrapping tablet: real 0.026s user 0.022s sys 0.004s
I20240502 01:59:58.431803 1642 raft_consensus.cc:348] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:58.431921 1642 raft_consensus.cc:729] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 845294d663994245b540c006dca93b7d, State: Initialized, Role: LEARNER
I20240502 01:59:58.432009 1642 consensus_queue.cc:260] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:58.432358 1642 ts_tablet_manager.cc:1398] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20240502 01:59:58.432876 27749 tablet_copy_service.cc:342] P da58b5341d344efd833502f214e69ff1: Request end of tablet copy session 845294d663994245b540c006dca93b7d-110a6faea0904da9970934cb2aba94c6 received from {username='slave'} at 127.10.133.202:52171
I20240502 01:59:58.432979 27749 tablet_copy_service.cc:433] P da58b5341d344efd833502f214e69ff1: ending tablet copy session 845294d663994245b540c006dca93b7d-110a6faea0904da9970934cb2aba94c6 on tablet 110a6faea0904da9970934cb2aba94c6 with peer 845294d663994245b540c006dca93b7d
I20240502 01:59:58.574189 1642 ts_tablet_manager.cc:902] T dc925cbedd00454dbaa0e6b5e38b94d7 P 845294d663994245b540c006dca93b7d: Initiating tablet copy from peer 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917)
I20240502 01:59:58.574725 1642 tablet_copy_client.cc:308] T dc925cbedd00454dbaa0e6b5e38b94d7 P 845294d663994245b540c006dca93b7d: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.195:42917
I20240502 01:59:58.578649 28020 tablet_copy_service.cc:140] P 86e11777d9d744d0a5a8139c99e89f4f: Received BeginTabletCopySession request for tablet dc925cbedd00454dbaa0e6b5e38b94d7 from peer 845294d663994245b540c006dca93b7d ({username='slave'} at 127.10.133.202:46867)
I20240502 01:59:58.578764 28020 tablet_copy_service.cc:161] P 86e11777d9d744d0a5a8139c99e89f4f: Beginning new tablet copy session on tablet dc925cbedd00454dbaa0e6b5e38b94d7 from peer 845294d663994245b540c006dca93b7d at {username='slave'} at 127.10.133.202:46867: session id = 845294d663994245b540c006dca93b7d-dc925cbedd00454dbaa0e6b5e38b94d7
I20240502 01:59:58.579645 28020 tablet_copy_source_session.cc:205] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:58.580507 1642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc925cbedd00454dbaa0e6b5e38b94d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:58.582480 1642 tablet_copy_client.cc:783] T dc925cbedd00454dbaa0e6b5e38b94d7 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:58.582621 1642 tablet_copy_client.cc:647] T dc925cbedd00454dbaa0e6b5e38b94d7 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:58.583823 1642 tablet_copy_client.cc:523] T dc925cbedd00454dbaa0e6b5e38b94d7 P 845294d663994245b540c006dca93b7d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:58.585156 1642 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P 845294d663994245b540c006dca93b7d: Bootstrap starting.
I20240502 01:59:58.606201 1642 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P 845294d663994245b540c006dca93b7d: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:58.606576 1642 tablet_bootstrap.cc:492] T dc925cbedd00454dbaa0e6b5e38b94d7 P 845294d663994245b540c006dca93b7d: Bootstrap complete.
I20240502 01:59:58.606729 1642 ts_tablet_manager.cc:1367] T dc925cbedd00454dbaa0e6b5e38b94d7 P 845294d663994245b540c006dca93b7d: Time spent bootstrapping tablet: real 0.022s user 0.021s sys 0.000s
I20240502 01:59:58.607228 1642 raft_consensus.cc:348] T dc925cbedd00454dbaa0e6b5e38b94d7 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:58.607348 1642 raft_consensus.cc:729] T dc925cbedd00454dbaa0e6b5e38b94d7 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 845294d663994245b540c006dca93b7d, State: Initialized, Role: LEARNER
I20240502 01:59:58.607436 1642 consensus_queue.cc:260] T dc925cbedd00454dbaa0e6b5e38b94d7 P 845294d663994245b540c006dca93b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:58.607767 1642 ts_tablet_manager.cc:1398] T dc925cbedd00454dbaa0e6b5e38b94d7 P 845294d663994245b540c006dca93b7d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20240502 01:59:58.608281 28020 tablet_copy_service.cc:342] P 86e11777d9d744d0a5a8139c99e89f4f: Request end of tablet copy session 845294d663994245b540c006dca93b7d-dc925cbedd00454dbaa0e6b5e38b94d7 received from {username='slave'} at 127.10.133.202:46867
I20240502 01:59:58.608381 28020 tablet_copy_service.cc:433] P 86e11777d9d744d0a5a8139c99e89f4f: ending tablet copy session 845294d663994245b540c006dca93b7d-dc925cbedd00454dbaa0e6b5e38b94d7 on tablet dc925cbedd00454dbaa0e6b5e38b94d7 with peer 845294d663994245b540c006dca93b7d
I20240502 01:59:58.609098 1671 ts_tablet_manager.cc:902] T fea2267a27de4324948a5549eb399267 P 845294d663994245b540c006dca93b7d: Initiating tablet copy from peer 257826b7ad7e4abb8499b6687e8c83eb (127.10.133.199:35629)
I20240502 01:59:58.609645 1671 tablet_copy_client.cc:308] T fea2267a27de4324948a5549eb399267 P 845294d663994245b540c006dca93b7d: tablet copy: Beginning tablet copy session from remote peer at address 127.10.133.199:35629
I20240502 01:59:58.610116 28555 tablet_copy_service.cc:140] P 257826b7ad7e4abb8499b6687e8c83eb: Received BeginTabletCopySession request for tablet fea2267a27de4324948a5549eb399267 from peer 845294d663994245b540c006dca93b7d ({username='slave'} at 127.10.133.202:57109)
I20240502 01:59:58.610222 28555 tablet_copy_service.cc:161] P 257826b7ad7e4abb8499b6687e8c83eb: Beginning new tablet copy session on tablet fea2267a27de4324948a5549eb399267 from peer 845294d663994245b540c006dca93b7d at {username='slave'} at 127.10.133.202:57109: session id = 845294d663994245b540c006dca93b7d-fea2267a27de4324948a5549eb399267
I20240502 01:59:58.611184 28555 tablet_copy_source_session.cc:205] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 01:59:58.612021 1671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fea2267a27de4324948a5549eb399267. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 01:59:58.613726 1671 tablet_copy_client.cc:783] T fea2267a27de4324948a5549eb399267 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 0 data blocks...
I20240502 01:59:58.613883 1671 tablet_copy_client.cc:647] T fea2267a27de4324948a5549eb399267 P 845294d663994245b540c006dca93b7d: tablet copy: Starting download of 1 WAL segments...
I20240502 01:59:58.614987 1671 tablet_copy_client.cc:523] T fea2267a27de4324948a5549eb399267 P 845294d663994245b540c006dca93b7d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 01:59:58.616017 1671 tablet_bootstrap.cc:492] T fea2267a27de4324948a5549eb399267 P 845294d663994245b540c006dca93b7d: Bootstrap starting.
I20240502 01:59:58.636121 1671 tablet_bootstrap.cc:492] T fea2267a27de4324948a5549eb399267 P 845294d663994245b540c006dca93b7d: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=689 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 01:59:58.636421 1671 tablet_bootstrap.cc:492] T fea2267a27de4324948a5549eb399267 P 845294d663994245b540c006dca93b7d: Bootstrap complete.
I20240502 01:59:58.636600 1671 ts_tablet_manager.cc:1367] T fea2267a27de4324948a5549eb399267 P 845294d663994245b540c006dca93b7d: Time spent bootstrapping tablet: real 0.021s user 0.019s sys 0.000s
I20240502 01:59:58.637003 1671 raft_consensus.cc:348] T fea2267a27de4324948a5549eb399267 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:58.637116 1671 raft_consensus.cc:729] T fea2267a27de4324948a5549eb399267 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 845294d663994245b540c006dca93b7d, State: Initialized, Role: LEARNER
I20240502 01:59:58.637217 1671 consensus_queue.cc:260] T fea2267a27de4324948a5549eb399267 P 845294d663994245b540c006dca93b7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 1.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: NON_VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: true } }
I20240502 01:59:58.637493 1671 ts_tablet_manager.cc:1398] T fea2267a27de4324948a5549eb399267 P 845294d663994245b540c006dca93b7d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20240502 01:59:58.638049 28555 tablet_copy_service.cc:342] P 257826b7ad7e4abb8499b6687e8c83eb: Request end of tablet copy session 845294d663994245b540c006dca93b7d-fea2267a27de4324948a5549eb399267 received from {username='slave'} at 127.10.133.202:57109
I20240502 01:59:58.638136 28555 tablet_copy_service.cc:433] P 257826b7ad7e4abb8499b6687e8c83eb: ending tablet copy session 845294d663994245b540c006dca93b7d-fea2267a27de4324948a5549eb399267 on tablet fea2267a27de4324948a5549eb399267 with peer 845294d663994245b540c006dca93b7d
I20240502 01:59:58.833070 30146 raft_consensus.cc:1203] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.11->[1.12-1.12] Dedup: 1.12->[]
I20240502 01:59:59.128919 30145 raft_consensus.cc:1203] T dc925cbedd00454dbaa0e6b5e38b94d7 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.11->[1.12-1.12] Dedup: 1.12->[]
I20240502 01:59:59.186501 30145 raft_consensus.cc:1203] T fea2267a27de4324948a5549eb399267 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.8->[1.9-1.9] Dedup: 1.9->[]
I20240502 01:59:59.215451 1577 raft_consensus.cc:1050] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1: attempting to promote NON_VOTER 845294d663994245b540c006dca93b7d to VOTER
I20240502 01:59:59.215970 1577 consensus_queue.cc:237] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:59.218024 28266 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:59.218156 30145 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:59.218156 28535 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:59.218309 29869 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:59.218576 1692 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:59.218784 1577 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:59.219197 27996 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:59.219544 28400 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:59.219983 1577 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:59.220801 1729 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:59.221045 27862 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:59.221302 1692 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:59.221428 1577 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:59.222054 1729 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:59.223894 1730 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.224323 28266 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.225284 28535 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.226328 28400 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.226822 27996 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.227790 30145 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.228667 27576 catalog_manager.cc:5484] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index 12 to 13, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20240502 01:59:59.229738 29869 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.231911 27862 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.239679 27728 consensus_queue.cc:237] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 1.13, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:59.241133 29869 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20240502 01:59:59.241510 30145 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20240502 01:59:59.241556 28400 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20240502 01:59:59.241561 28266 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20240502 01:59:59.241827 27862 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20240502 01:59:59.241890 1729 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20240502 01:59:59.242410 28535 raft_consensus.cc:1261] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
I20240502 01:59:59.242527 1692 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20240502 01:59:59.242867 1692 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20240502 01:59:59.243177 1692 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20240502 01:59:59.243312 1728 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20240502 01:59:59.243463 1577 consensus_queue.cc:1035] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20240502 01:59:59.245559 1577 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.246205 28535 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.247767 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet 110a6faea0904da9970934cb2aba94c6 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:59.247964 29869 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.249236 27579 catalog_manager.cc:5484] T 110a6faea0904da9970934cb2aba94c6 P 257826b7ad7e4abb8499b6687e8c83eb reported cstate change: config changed from index 13 to 14, VOTER 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195) evicted. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.250180 28400 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.250869 28266 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.253060 27862 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.253177 30145 raft_consensus.cc:2932] T 110a6faea0904da9970934cb2aba94c6 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.256464 27978 tablet_service.cc:1514] Processing DeleteTablet for tablet 110a6faea0904da9970934cb2aba94c6 with delete_type TABLET_DATA_TOMBSTONED (TS 86e11777d9d744d0a5a8139c99e89f4f not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:37532
I20240502 01:59:59.257033 1745 tablet_replica.cc:330] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f: stopping tablet replica
I20240502 01:59:59.257495 1745 raft_consensus.cc:2229] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:59.257876 1745 raft_consensus.cc:2258] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:59.259482 1745 ts_tablet_manager.cc:1875] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:59.261469 1745 ts_tablet_manager.cc:1888] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.13
I20240502 01:59:59.261546 1745 log.cc:1196] T 110a6faea0904da9970934cb2aba94c6 P 86e11777d9d744d0a5a8139c99e89f4f: Deleting WAL directory at /tmp/dist-test-taskVdqkLT/test-tmp/rebalancer_tool-test.7.LocationAwareRebalancingParamTest.RebalanceWithIgnoredTServer_idx6_rf7_t7_l_3_4_3.1714615077573736-10775-0/raft_consensus-itest-cluster/ts-2/wal/wals/110a6faea0904da9970934cb2aba94c6
I20240502 01:59:59.262127 27564 catalog_manager.cc:4830] TS 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195:42917): tablet 110a6faea0904da9970934cb2aba94c6 (table rebalance_test_table_2 [id=a629d25a0bcb4e9fa11f470ffa5ad853]) successfully deleted
I20240502 01:59:59.592483 1710 raft_consensus.cc:1050] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f: attempting to promote NON_VOTER 845294d663994245b540c006dca93b7d to VOTER
I20240502 01:59:59.593070 1710 consensus_queue.cc:237] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:59.594111 1601 raft_consensus.cc:1050] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb: attempting to promote NON_VOTER 845294d663994245b540c006dca93b7d to VOTER
I20240502 01:59:59.594779 1601 consensus_queue.cc:237] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 5, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:59.595212 28535 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:59.595341 30009 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:59.595573 1763 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:59.595760 1709 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:59.596299 30145 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:59.596709 29869 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:59.596870 27862 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:59.597164 28400 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:59.597903 1709 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:59.598011 27727 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:59.598291 28400 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:59.598295 1709 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:59.598817 28266 raft_consensus.cc:1261] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 86e11777d9d744d0a5a8139c99e89f4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20240502 01:59:59.598826 1709 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:59.598891 30146 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 845294d663994245b540c006dca93b7d [term 1 LEARNER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:59.599164 1726 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:59.599216 27862 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:59.599464 1763 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:59.599509 1726 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:59.599793 27996 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:59.600296 1616 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:59.600807 1769 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:59.601150 1769 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:59.603341 1764 consensus_queue.cc:1035] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20240502 01:59:59.603492 29869 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:59.604676 28266 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20240502 01:59:59.605007 1726 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:59.605290 1770 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20240502 01:59:59.606034 1770 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 9 to 10, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.608130 1763 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.608139 28399 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.610357 28266 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.610348 30009 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.610728 28535 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.611074 29869 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.612193 27727 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.612762 27862 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.613862 28400 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.614850 27578 catalog_manager.cc:5484] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 reported cstate change: config changed from index 9 to 10, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.616533 29870 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.618538 27571 catalog_manager.cc:5484] T dc925cbedd00454dbaa0e6b5e38b94d7 P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 12 to 13, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "86e11777d9d744d0a5a8139c99e89f4f" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.619877 27996 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.622714 30146 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.625205 27727 consensus_queue.cc:237] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } }
I20240502 01:59:59.625217 27862 raft_consensus.cc:2932] T dc925cbedd00454dbaa0e6b5e38b94d7 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.627103 30146 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.629056 28400 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:59.629117 28535 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:59.629421 1578 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:59.629510 28130 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:59.630409 1577 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:59.630759 1577 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:59.632859 27996 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:59.633136 29870 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:59.633404 30009 raft_consensus.cc:1261] T 77e62ec43c8d442b9846f05439ac7a99 P 7332064716f04e84ba81c1f2b70821f9 [term 1 FOLLOWER]: Refusing update from remote peer da58b5341d344efd833502f214e69ff1: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:59.633387 1578 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:59.633617 1577 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:59.634063 1577 consensus_queue.cc:1035] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:59.635636 28265 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 9 to 10, 845294d663994245b540c006dca93b7d (127.10.133.202) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.638510 1728 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:59.638886 28535 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:59.640184 28534 consensus_queue.cc:237] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } }
I20240502 01:59:59.640936 28130 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 82e8cba6ed104c2c9869ea0365bbe482 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:59.641424 27996 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:59.642259 28400 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:59.642850 28265 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:59.643139 28399 raft_consensus.cc:2932] T 77e62ec43c8d442b9846f05439ac7a99 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } } }
I20240502 01:59:59.643324 1726 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:59.644290 27862 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:59.644522 27578 catalog_manager.cc:5484] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 reported cstate change: config changed from index 10 to 11. New cstate: current_term: 1 leader_uuid: "da58b5341d344efd833502f214e69ff1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7332064716f04e84ba81c1f2b70821f9" member_type: VOTER last_known_addr { host: "127.10.133.201" port: 40597 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20240502 01:59:59.644740 27727 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:59.645012 1726 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:59.645313 1616 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:59.646190 1616 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:59.646440 29869 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 0003837e2d88424093594ed169d82cd2 [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:59.646862 1616 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:59.647521 30145 raft_consensus.cc:1261] T fea2267a27de4324948a5549eb399267 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Refusing update from remote peer 257826b7ad7e4abb8499b6687e8c83eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20240502 01:59:59.648303 1772 consensus_queue.cc:1035] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20240502 01:59:59.649657 1769 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 257826b7ad7e4abb8499b6687e8c83eb [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.650214 28265 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.651428 27565 catalog_manager.cc:4997] ChangeConfig:REMOVE_PEER RPC for tablet fea2267a27de4324948a5549eb399267 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20240502 01:59:59.651787 30145 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 845294d663994245b540c006dca93b7d [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.653183 27862 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P a8c1908b1c554e7cbbb9bf9751b8ee98 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.653836 27572 catalog_manager.cc:5484] T fea2267a27de4324948a5549eb399267 P 8ed4b4242123404f86485ec57dc34e88 reported cstate change: config changed from index 10 to 11, VOTER 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195) evicted. New cstate: current_term: 1 leader_uuid: "257826b7ad7e4abb8499b6687e8c83eb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.654263 28400 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P 12f527e76eff4669924a898d5029e3d1 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.656565 27728 raft_consensus.cc:2932] T fea2267a27de4324948a5549eb399267 P da58b5341d344efd833502f214e69ff1 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, VOTER 86e11777d9d744d0a5a8139c99e89f4f (127.10.133.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "a8c1908b1c554e7cbbb9bf9751b8ee98" member_type: VOTER last_known_addr { host: "127.10.133.194" port: 37731 } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193" port: 40835 } } peers { permanent_uuid: "8ed4b4242123404f86485ec57dc34e88" member_type: VOTER last_known_addr { host: "127.10.133.197" port: 46567 } } peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "0003837e2d88424093594ed169d82cd2" member_type: VOTER last_known_addr { host: "127.10.133.200" port: 45585 } attrs { promote: false } } peers { permanent_uuid: "845294d663994245b540c006dca93b7d" member_type: VOTER last_known_addr { host: "127.10.133.202" port: 45645 } attrs { promote: false } } }
I20240502 01:59:59.658146 27978 tablet_service.cc:1514] Processing DeleteTablet for tablet fea2267a27de4324948a5549eb399267 with delete_type TABLET_DATA_TOMBSTONED (TS 86e11777d9d744d0a5a8139c99e89f4f not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:37532
I20240502 01:59:59.658704 1745 tablet_replica.cc:330] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f: stopping tablet replica
I20240502 01:59:59.658859 1745 raft_consensus.cc:2229] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20240502 01:59:59.659121 1745 raft_consensus.cc:2258] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20240502 01:59:59.659900 1745 ts_tablet_manager.cc:1875] T fea2267a27de4324948a5549eb399267 P 86e11777d9d744d0a5a8139c99e89f4f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 01:59:59.660833 27727 consensus_queue.cc:237] T 77e62ec43c8d442b9846f05439ac7a99 P da58b5341d344efd833502f214e69ff1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 4, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "12f527e76eff4669924a898d5029e3d1" member_type: VOTER last_known_addr { host: "127.10.133.198" port: 44921 } } peers { permanent_uuid: "257826b7ad7e4abb8499b6687e8c83eb" member_type: VOTER last_known_addr { host: "127.10.133.199" port: 35629 } } peers { permanent_uuid: "82e8cba6ed104c2c9869ea0365bbe482" member_type: VOTER last_known_addr { host: "127.10.133.196" port: 41553 } } peers { permanent_uuid: "86e11777d9d744d0a5a8139c99e89f4f" member_type: VOTER last_known_addr { host: "127.10.133.195" port: 42917 } attrs { replace: true } } peers { permanent_uuid: "da58b5341d344efd833502f214e69ff1" member_type: VOTER last_known_addr { host: "127.10.133.193"